Barbara Walters criticized her co-hosts for walking off stage during the live show. But she said O'Reilly should make the distinction that extremists committed the terrorist act.
Behar and Goldberg returned after O'Reilly said that "if anyone felt that I was demeaning all Muslims, I apologize."
The 16-story Islamic center and mosque is planned for lower Manhattan, two blocks north of where the World Trade Center once stood.