Do I need to know Japanese to work in Japan?

Not always. For SSW visas, JLPT N4 or JFT-Basic is mandatory. For E/SH/IS and HSP, Japanese is preferred but not required, especially in global companies.