It's not rude to fail to return a wave. There are a million reasons why they don't such as folk like myself with serious mental health problems.Rather most don't understand how people can be rude enough to not return a wave.
IMHO, it's worse to judge somebody without knowing, than failing to return a wave.