Well it isn't fine you're still making a complete twat of yourself if you say it. Just the fact it wasn't a wide spread racial slur used by loads of people means it doesn't have the history behind it and it isn't as offensive.
Calling a German a kraut is just as bad though and they're white.