Emergency crews were told the man had been sitting around with a friend near the harbor when he decided to go into the water. The water temperature was only around 50 degrees.
Fire officials say the man had become wedged between rocks 10 feet deep in the lake.
The Cook County medical examiner's office identified the man as Jorge Martinez. He was pronounced dead at Advocate Illinois Masonic Medical Center.
The Associated Press contributed to this report.