Peterson is a suspect in the October disappearance of his wife, Stacy.
He hasn't been charged and denies any wrongdoing.
A judge already ordered the state police to return Peterson's two vehicles and other items.
Peterson wants his son to hold the weapons while Peterson appeals the revocation of his Firearm Owner's Identification Card.
