The 63-year-old is the former head of Chicago's community policing program. He left the city in 1998 after Mayor Daley hired Terry Hillard as police superintendent.
Ramsey spent nine years in Washington, D.C. before moving on to Philadelphia.
Emanuel will be sworn in on May 16.