More importantly, Nazis aren’t just people who are a bit racist, like your typical conservative. The are exterminationists. They explicitly ally themselves with those who deliberately committed genocide on an unimaginable scale (colonial and imperial atrocities are not entirely dissimilar, but the technocratic genocidal program of Hitler was somewhat unique). Someone who wears a Swastika isn’t simply saying “I don’t much like Jews and Blacks.” They are saying they are on board with a program to exterminate them. Should you punch them? I dunno. Captain America would. That’s why he’s a comic book hero.