The agency says Toyota received more than 27,000 warranty claims on the issue involving 2006 and 2007 Prius hybrids.
The safety administration says it did not issue a recall because in most cases only one of the headlights failed.
Toyota is facing a class-action lawsuit over the headlight failures.
The automaker says it will be conducting a service campaign to address customer dissatisfaction over the issue.