Most of the local Muslims wanted him to apologize for remarks he made two weeks ago warning of Muslim extremists in the community.
"The community is hurt, grieved," said Moon Khan, DuPage County committeeman.
The congressman says the vast majority of Muslims are honest hard-working Americans. But there is also a radical element.
"There is a threat. We can't let political correctness get in the way of that threat. But we cannot malign the 99.99% of Muslim Americans who are wonderful people," Walsh said.
"Our religion is peace, and I was very hurt by that statement," said Sameena Parveen.
Congressman Walsh initiated the meeting, asking Khan to organize a meeting with area Muslims. Many said the congressman is endangering them with his characterizations.
A week ago police say a 52-year-old man fired shots from a pellet gun at a mosque in Morton Grove.
"He has jeopardized the lives of so many people because of his factually incorrect statement. He owes Muslim Americans an apology," said Aliya Husain.
The meeting ended without the apology many in the group wanted from him.