I used to think like you.AdamW said:expecting the thousands of motorists driving through their village to use more petrol and take more time to complete their journey.
And then one day I actually took some measurements of how long it took to do a particular piece of road, and how long the stretches were where I had to reduce my speed.
And you know what?
It was "costing" me at worst 5 minutes in a 45 minute journey.
And I thought "just how pathetic and self-obsessed do you have to be to get bent out of shape about a journey taking 45 minutes instead of 40?"
And I stopped worrying.
If you are really leading the kind of life where a few minutes extra on a journey are a real problem to you, then IMHO you need a different life.