My criticisim would be that the 51J has a lot of background hiss and noise compared to the 75A4 when using it in the SSB mode. My guess is that the problem lies in the mixer, not the product detector. The only thing I'd like to see with this product detector is a fast/slow speed which as I understand it is complicated, so it's absence is not that big of a deal.
But in conclusion, TWO THUMBS UP FOR THIS PRODUCT!!
Mike WB0SND
Inadequate filtering of the output of the product detector, I'd bet. Look for remaining 500 KC components at its output with a scope.
If you can live without an IF output jack, using the existing 1/2 12AU7 IF out cathode follower as a product detector is a very easy mod. Almost all the work is done for you, just run BFO into it, add a few resistors and caps, and run audio up to the AM/CW switch (which requires dropping the front panel) to switch the audio.