The graffiti was painted on a garage door and sidewalk near Leland and Campbell avenues.
The sidewalk said "you will not replace us" in white and in black lettering on a garage, "make Weimar SS great again,"
Volunteers repainted that garage door white Saturday and someone also left this message in chalk on the sidewalk, "hate has no home here" alongside a sketch of two pink hearts.
But neighbors took it a step farther with the rally, denouncing Nazis and white supremacy and reminding people that the neighborhood is welcome to all people.
"It's not terribly surprising to me...it's awful and we don't want to have it here in this neighborhood, but at the same time it's graffiti and it's probably just someone seeking attention," said neighbor Paul DuPont.
The rally and march began at 5 p.m. at Sunnyside and Campbell avenues.
Two weeks ago, a woman was killed and dozens injured in Charlottesville. During a counter-rally against white nationalists, neo-Nazis and other groups.
Also on Sunday, a solidarity march drew hundreds to downtown Chicago where they spoke out against hate and in support of tolerance.