Emergency rescue crews arrived around 2 a.m. Friday. A rip current and high wave warning was in effect.
"We were surprised to find him he was clinging on to a wall. About as far as we expected the way the buildings are set up there's private access we had to climb some fences and jump around to and go to each yard and see if we could find him eventually we did find him," Glenn Polanek, Chicago Police Department, said.
Officials said the man was at Rogers Park Beach around 1:30 a.m. when a dog jumped in the water. He and another man jumped in to save the dog. When the 41-year old wasn't able to get out of the water, the second man called 911.
"After 20 minutes of searching for the man, one of the officers was able to spot him and hold him while other officers responded. And we were all able to pull him out of the water and bring him to safety and pass him off to the ambulance to take him to the hospital for observation," Polanek said.
The victim, who is visiting Chicago from Missouri, was treated and released at St. Francis Hospital. The dog was not injured.
The rip current and high wave warning, issued by the National Weather Service, remains in effect until Saturday morning.