I haven't had any experience with the Philharmonic models but I've always been impressed by the quality of the Custom Electras - the next model up. I find the model name "Philharmonic" very appealing as it connects back to Avery Fisher's first company of the same name and is representative of his 'no compromise' console philosophy. The Philharmonics are a bit of an contradiction, though: as the entry-level model of a high-end brand you'd figure that if someone thought of himself as a "Fisher man", so to speak, that he wouldn't feel the need to compromise on size or watts or whatever. I don't know what the numbers are but I suspect that the Custom Electras far outsold the Philharmonics.
The specific model you're looking at, the Modern cabinet from the Philharmonic's debut year, 1961, is arguably the most desirable. As the sixties wore on the styling got busier and, at times - stranger. The Philharmonic also experienced a yearly size increase in the same way that many car models (especially the economy-sized ones) suffer from the creeping bloat that allows the sales department to advertise ever bigger numbers. The '61 Philharmonic is a petite 40" wide - by 1967 it had bulked up to 46" and was fully transistorized to boot.
One good thing to remember about the Philharmonic models, however, is that they were the last to be transistorized. They were the lone remaining tube holdout as late as 1966, by which time the rest of the line-up had made the switch.
I seriously doubt you'd be disappointed by the Philharmonic. Its chief weakness is certainly the record changer. If you're already planning to change that I'd say you're well on your way to becoming a "Fisher man".
Here's the copy from the '61 catalog on the Philharmonic - note the six position input selector has AUX MONO and AUX STEREO positions: