It depends for its effectiveness on a good fit of the soft rubber seal around the ear.
I've often thought that the solution would be some kind of inflatable seal that you pump up with a small squeeze bulb and release with a twist valve. Think of a donut that surrounds your ear, attached one side to the helmet, that you could inflate to your desired pressure once your helmet is on.
Anyone have the tools and meterials to prototype one of these?