I understand your thinking. It is a simple explanation and is compelling. But there often is more going on, just like in our discussion of digital cables. See, here.
Remember, expectation bias goes both ways. It is just as easy to not hear something that is there, as it is to hear something which is not.