The fact that all guitar sites and magazines are shills and receive payment for their rankings and that any modeler can sound drastically different overnight with a firmware upgrade, all cursory reviews are meaningless and are more for entertainment purposes and advertising campaigns.
Even on the outside chance they were valid at one point, they are dated as soon as new code develops.
The only way to rank the devices is to try them all out.
OR..just watch Pete Thorn make everything sound great and be happy knowing that they can all do the job.
Sadly, there is a lot of truth to this. It seems like the review sites and major reviewers land into 2 catagories:
- Paid by one or more OEM to slant the discussion in favor of their product
- Click bait designed to drive more traffic through their channel
Neither one of which ends up being a good indicator of the usefulness of one device over the other to a particular user.
I would argue that most people aren't going to purchase one of each of the units, and use them with enough depth to determine (on their own with their own experiences) which device best fits their needs. This is very costly and very time consuming.
While I have to agree with you that the reviews all seem to lack objectivity, some are still much better than others.
What I did was to find people who had moved from a high end boutique tube amp rig, that gigged like I do with their rig, and see which digital amp they used. These people are my gold standard. Most anyone who was using a VHT, Fender Blackface, Friedman, Soldano, Dumble, etc that were very satisfied with their digital amp would likely be right up my alley of taste.
I looked at what worked for people that previously used the best tube amp rigs money could buy. When I did this (in 2013), Kemper and Fractal were the only serious contenders in THAT space.
Today, Line 6 has significantly upped their game from the old pods of the past, QC has entered the market and did "Kemper Profiling" better than Kemper did it, and even Fender has an up-and-coming digital amp that is improving quickly.
If I were to change lanes again today, there would be many more contenders for me to consider.
Now, I have had time on most of these devices as I have friends that gig that own them. Not the kind of time it would take to get each one as dialed in as my Kemper, but enough to see what they can do. That is also a good exercise ..... but seriously, how many people are going to take even this amount of time to qualify a device?
I think the best resource is people doing what you want to do with their rigs that previously had tube amp rigs that were top of the line they were using to do it.