RGA
Wouldn't listening to music in order to determine sonic differences between components, a critical listening session, involve the left hemisphere?
Also DBT is done to determine differences - a potential result being none.
A DBT can never prove that A=B. It can only statistically conclud that a person under test could not differentiate A and B within (and ONLY within) the confines of that particular test. The problem isn't with the DBT as a tool - it is the conclusion that some guy named Billy Bob did a 16 trial test of cable a and cable B in 1983 between cable Zima and Cable Alpha and he was able to identify cable A correctly 8 times and therefore he didn't statistically meet significance to the .05 level so no one can tell the difference between cables.
The problem just in the statistics is that the more subtle something is (harder to differentiate) the more reliability and validity is needed. So if I have a test set up where I want someone to differentiate the colour Red versus Green (assuming the person isn't colour blind and the room is lit) then I only need one trial - hold up the colour card - the subject says Green correct.
If however the test is between say 3 cards and all three are variations of red and I am asking which variation of Red it is - I will need to show the cards more than once to get reliable findings.
In audio statistical significance to the .05 level would be 9 correct out of 10. So if the subject correctly identifies the Krell amp over the Crown amp then he will be deemed to get the result better than chance. (This meets the statistical requirement and some would then say "he can hear audible differences therefore the Krell sounds different that the Crown). These some people would be wrong. The Krell has not been proven to sound different - the SUBJECT has been proven to be able to differentiate better than chance is all.
With subtle differences it would stand to reason that "more trials" would be required because of the level of difficulty to differentiate sound.
For instance - if you had a subject who got 6/10 he would be deemed a failure statistically. The problem with this notion is that if the subject scored 6/10 ten times with one miss for 59/100 he would meet statistical significance to the exact same 0.5 level (equal to 9/10). In both cases the subject would be deemed to be able to differentiate A from B and thus PASS the DBT. More trials increases reliability of the test. Like I say the issue here is most of thes trials are small - John got 6/10 he can't hear the difference - if he scored that or better 10 times - in fact he would be deemed to be able to tell the difference. It's quite a glaring issue.
As to your first point about critical listening you make a valid point. It would engage the left hemisphere because you are still determining which is better - which is a decision. The main difference though is there is no "test stress factor" or any sort of time limit or over the shoulder factor to be concerned with. We make decisions all the time that can be largely passive ones. Once the exercise becomes an artificial recreation then it's removed from the normal valid way of doing things.
I want to be clear - I am not dumping on blind tests. I mean I can;t argue with anyone who wants to back them over the usual subjective biased non level matched practices that go on. Blind takes out a lot of the bias associated with price, looks, name brand prestige, weight, salesperson influences, advertising influences etc. The blind test may introduce a stress test issue but it's probably less damaging than the alternative. However it is there and it should be something to pause over.
When people argue of amps sounding the same - usually it's Solid State amplifiers with negative feedback. The numbers typically all look excellent and below the threshold of audibility. If they are integrated amps people need to account for the gain. I think it's easy to choose the louder product (see Munson) and people can be tricked into think the $5k amp is better than the $500 amp because they may see the volume knobs at 8'oclock but the $5k amp may be playing 3dB louder. You have to watch those dealers like a hawk. Wow the $5k amp sounded so much more alive and crisp etc - yes because it was louder.
Hi-Fi Choice magazine does a reasonable job - they often review products blind and level matched. They have a panel of listeners - manufacturers/reviewers who sit and choose the best product. They get comment cards and tallies and overall winner is chosen. It's not as strict a methodology but nor does it have a test stress aspect. Manufacturers have had products in the tests and have actually chosen competing products as sounding better. They take out the important biases at least - price, name brand, appearance etc.