The sign quoted a bible verse that read, "Act justly, love mercy, walk humbly with God" followed by "Black Lives Matter."
The community claims the banner has been damaged twice in the past week.
Frustrated residents showed their support for the message the church was trying to send at a small rally.
RELATED: Chicago firefighters accused of removing Black Lives Matter banner on South Side
Most of the banner has been taped back together.
Police say they are investigating the incident.