A crowd of mourners gathered at house of hope on the south side for the service.
Martin's coffin was draped with the Illinois flag.
Officers in attendance wore their dress blues.
Many recalled Martin's compassion and his dedication.
"If officers took a little bit of Leroy Martin with them every day when they go out in the street, this city will be a more peaceful, safer and better place," said Jeremy Margolis, former director, Illinois State Police.
"He always gave you good, sound, sober, common sense advice, and I think that's what I'm going to remember him for. You know, what he thought about his cops, and what he thought about this city," said Terry Hilliard, former Chicago Police Superintendent.
Martin served the city of Chicago for 36 years and was superintendent from 1987 to 1992.