Osprey books are very hit and miss but they do often cover topics not well represented in the English language market. For this thread, it may be worthwhile to look at the following title:
Yasuho Izawa has done some excellent work on Japanese aircraft and for this title he has talked with a number of veterans. Opinions on the J2M from combat and test pilots are included as is the Allied report on the aircraft. Development of the type and its teething troubles are also examined.
The Raiden was a "hot" aircraft that required extensive training to fly well. Lt. Takeo Kurosawa who oversaw the transition of 381st Kokutai found the type to "be better than the A6Ms he had previously flown in combat. However he quickly realised that it would take time for his less experienced charges to master the J2M" (Izawa p 25).
From page 28, Ensign Akio Matsuba's [301 Kokutai Sento 601st Hikotai) experience with the J2M: " The engine in his brand new fighter suffered a sudden loss of oil pressure and then seized during a test flight from Suzuka, forcing Matsuba to conduct a high speed forced landing with the fighter's undercarriage retracted. Not a fan of the Raiden before this incident, Matsuba (who claimed the J2M was "difficult to fly') duly reverted to flying an A6M5 whenever possible"
Another view on page 31 from Ens Chitoshi Isozaki (302 then 343 Kokutai): "He thought that the J2M was inferior to the A6M in horizontal manoeuvrability, however, although its greater speed and rate of climb made it a better bomber interceptor"
From the book it appears teething troubles with the J2M soured many pilots on it and for others, the fact it faired better at dive and zoom techniques as opposed to the more dogfight, twist and turn style of the A6M meant many veteran pilots had to adjust their technique. As Graham has pointed out, often how an aircraft is viewed can be traced to what pilots are comfortable (the old open versus closed cockpit debate of the early war years for example) with and what flying style and fighting techniques they prefer (aerobatic dogfighting versus boom and zoom attacks).