It all matters, but in an electric guitar, body wood is far lower on the list than many would like to believe. I can pick up 5 of the same guitar and they all sound slightly different acoustically even though they are the same materials. Then hook up to an amp and the variances in pot values alone can make far larger impacts than what was acoustically present. Then we have strats made of cardboard, concrete, acrylic, etc, and they all sound like what is expected of strats. The materials used for the body have very slight differences that most people probably wouldn't hear if you blindfolded them. Taking a guitar out of a players hands and blindfolding them to see if they could tell the difference would be a startling revelation for most players. Your age, occupation (how much hearing damage), and natural individual variance in hearing ability is going to probably have a bigger impact than the body wood changes on an electric guitar. For an electric guitar, the body materials matter, but much less than is expected and the majority of people would never be able to pick up the difference blindfolded, and what can be possibly heard is probably at the point of splitting hairs. Changing pickups and speakers would be noticed by the most indifferent listeners. For the few people that enjoy the splitting of hairs, enjoy it. It is another layer of fun to have with your hobby/passion.