That doesn't make it right! I guess it's a bit like when seatbelts became law and lots of people objected but probably because none of them had been thrown through a windscreen. I am guessing from your post you have never seen someone clipped by a car and hit their head on the kerb. Some things are better prevented than cured
You can't prevent every risk and the risk of cycling without a helmet is over-egged. Many pedestrians sustain severe head injuries from "trivial" slips and stumbles.
It's been shown many times that helmet enforcement deters folk from riding and that the health benefits of riding without a helmet outweigh the risks.
Each to his own of course and I frequently wear one myself these days but I would never describe not wearing one as "madness".
Tim