Security at the Las Vegas Hard Rock Hotel and Casino allegedly escorted him off the card table after they suspected he was counting cards.
Counting cards is legal but casinos frown upon it because it helps your odds.
The source says Affleck is allowed to play other games at the casino, but not blackjack.
The casino said that it is its policy "not to comment" on guests' gaming play.
ABC News contributed to this report.
