Fisher like other US companies put out some fantastic US made product. At the time they switched to offshore production, Japan did not have a reputation for quality nor did Korea. Sort of akin to China today. The kids during the time did not want to be associated with their parents so if there was a Fisher in the house, more likely than not it was not on the to-buy list of the kids. The older gen when they looked at the imports it did not have the quality and feel of the US units so they were disappointed and many simply kept what they had. Also, there was still a lot of bad feeling from WWII to deal with.
Lastly, Japan was receiving huge economic advantages compared to the US companies and when the electronic companies invaded the US they overwhelmed the industry with advertising and product as well as distribution. From memory, except for Sony they did not try to control pricing while the US makers still did and hence street prices for imports generally were less expensive than the US counterparts or from the otherside of the coin, the US companies were selling the equiv units for much more and hence less value for the money. In those years the problem was not that the public felt they were poor for the most part but overpriced and hence less value for the money. To the lay person that translated into quality though it was not so. Today, the stigmatism is going away and were the vintage crowd is realizing the value of these is equal to their equiv from Pioneer, Marantz, etc. Value is better now than for most of the big import name brands that so many fantasize over. You can buy the biggest Fisher receiver for instance for probably less than half the price of a comparable Marantz.