Rush was making a statement about racial profiling when he took off his jacket and pulled a hoodie over his head.
A hoodie violates the dress code on the House floor. The presiding officer slammed the gavel in an attempt to break Rush's speech and warn him about breaking the dress code.
Rush finally left the floor on his own.
Members were then reminded of rules that prohibit the wearing of hats in the chamber when the House is in session.
On Tuesday the 17-year-old Martin's parents spoke on Capitol Hill at a Democratic-sponsored panel on racial profiling.
The Associated Press contributed to this report.
