That's according to a study in the Journal of the American College of Cardiology.
But scientists found the worst off were people who started smoking in adolescence and kept up the habit their entire lives. They were twice as likely to die early as were non-smokers.
Scientists say the risks are cumulative, and the positive message is, it's never too late to stop.