.....
I've heard the really good stuff. IMO it's worth every cent being asked.
There are so many variables to the "worth it" equation, and it's different for everyone. We all have to determine the importance of each of the following, rank them accordingly, and then decide the OVERALL importance of having a quality audio reproduction system in our home balanced against everything else in life we value and purchase with our money, time, and effort.
1. Sound quality
2. One's total net worth/income
3. Price tag of equipment
4. Amount of improvement gained for increased outlay of cash (see my previous graph..

)
5. WAF/Acceptance or availability of dedicated listening room, treatments, intrusive/physically imposing gear.
.. and the list goes on. Once that list has been prioritized and one has decided that $100K is a comfortable amount spend without sacrificing more than wished elsewhere, AND one values the perhaps 1% - 5% increase in perceived quality gained by a 100% increase in expenditure, then to that person, it's worth every cent. Same with ANY dollar figure. All I'm postulating is that to a person with a $200 system, $2000 buys an INFINITELY better system... almost always, regardless of what gear is purchased. To a person with a $2000 system, a $4000 system may or may not yield noticeable improvement depending upon gear chosen, and even if chosen very wisely would certainly not yield the amount of improvement the $2k system did over the $200 system. However, if your net worth is such that the extra $2000 isn't real noticeable, it doesn't matter.. go for it. Add a zero to every figure, including net worth...and the equation doesn't change.
I'm not sure how much I have tied up in my systems. I've built most of my speakers except for the Magnepan 3.6Rs and MGIIIs. Most of them have decent drivers and quality (but not boutique) XO components, and the cabinets are extremely overbuilt... lots of time, and some money. Next to those, the most expensive single component I have is a VPI Scout turntable. Our casual listening/daily living room speakers are an Audio Concepts LV Sat/Sub system built from a kit. Used hybrid Van Alstine amp bought from Frank himself that he reconditioned, Hafler XL-280 I built, one of the beefier Onkyo receivers in a small homebrew theater, two B&K ST-140s, Adcom GFP-565, Hafler DH110, and Akitika PR102 preamps, a Thorens table, Sumiko BluePoint and BluePoint No.2 cartridges, Parts Connection's Assemblage DAC (assembled by my friend Gary Galo for a review he did many years ago), Audio Alchemy's Dac-in-the-box (with homebrewed power supply), and Cambridge DacMagic X/S. Digital sources (CD players, Raspberry Pi streamers) are very much average stuff. I have no idea how much dough I have wrapped up in all that stuff, but it's well under $10K over a long period of time, and probably closer to $5k.
Our main system (Akitika-Van Alstine-Maggies) in a pretty much perfect setting in a loft with a sloped ceiling and virtually nothing behind the Maggies is pretty breathtaking. My words, but also the words of pretty much anyone who's heard the system. I've heard, maybe on one or two occasions, systems that were as good or maybe a bit better in a few aspects, and I've heard, very recently in fact, a $100,000 system that didn't sound near as real or as involving. OK.. I'll say it... it simply didn't sound as good. I am definitely aware that better systems than mine exist... LOTS of them. For me, personally, where I am in life financially (comfortable, no worries for which I'm grateful), I can't imagine spending the kind of dough I'd need to spend to get a significantly better system, and it's certainly not because I don't value or appreciate great sound. My father (who is also a professional musician, in his 80s) already thinks I'm insane for the gear I DO have. I've found my personal sweet spot for diminishing returns.
Everyone's sweet spot will be different.
It's not about being a cheapskate either (although I admit I certainly have more than a streak of frugality incorporated in my being). When a big gain can be had for extra cash, the extra cash will be spent. I have more money invested in four channels of mic preamps and seven good mics in my recording gear than I do all of my home audio stuff combined. The differences THERE are mindboggling.
Just more thoughts. Not to be a broken record, but this really isn't about right or wrong, good or bad. Just sharing thoughts and perceptions. No value judgements at all.