It happened around 4:40 p.m. Sunday in the 2900-block of West Devon, according to police.
Investigators said someone spray-painted graffiti on the synagogue, then went a block up and spray-painted graffiti on a cargo container.
The suspect then tackled a man to the ground before running off.
Area Three Detectives are investigating.