Gayles was reportedly in the mayor's doghouse for his handling of minority business fraud.
The City Department of Procurement Services provides support for 44 city departments and oversees the procurement of more than $2 billion a year in goods and services.
So far there is no word on a replacement.