I suspect it would be a minority who would actually know or care (and if they shoot off to some other ISP as they may well be the heaviest traffic users, it wouldn't bother me in the slightest)
I know my download speed has tested at around 10 Mbps (though I have to say I was slightly annoyed to have buffering when using iPlayer to watch some snooker {not a live game, but a previous broadcast} just a day or two ago), but as for my upload speed, I've no idea, and for many, unless they're doing online backups etc, it's probably a low priority...