The sheriff's department says Kevin Long had the knives inside a briefcase Tuesday afternoon as he went into the building.
He's now facing felony charges because of the incident.
Previously, Long was on a law enforcement task force list of people who could be a threat to judges or other court officials.