People
I never forget a face, but in your case I'll make an exception.
— Groucho Marx
Behind the line May contain spoilers.
Our reading
An editorial interpretation.
A classic insult dressed as a compliment. The first half claims a great memory for faces, and the second half twists it: this face is so unwelcome that the speaker will make a deliberate exception. The joke lands because the setup sounds flattering right up to the swerve.
Context reviewed