Japanese Language

Definitely not. ChatGPT is known to "hallucinate", i.e. make things up, so you can't trust that everything it says will be accurate.

ChatGPT, being generative AI, is strong in fabrication. This is stuff like writing an email, producing a table of contents for a book, creating a python program to spec, or, as DigitalAudio suggested, proofreading.

It is not very strong in fact-checking, or explaining things in a different way. See this recent MDN issue, for example: https://github.com/mdn/yari/issues/9208

I think ChatGPT works fine for reviewing your text. It will usually manage to point out the bits that sound wrong or inaccurate in your text, and it’s surprisingly precise at doing it.

However, as everybody else pointed out, don’t expect accurate or well-researched answers from it, and take any grammatical or nuanced statements with a mountain of salt, because it’s highly likely that it’s completely wrong.

But I’ve also asked ChatGPT to proofread and adjust my emails for coworkers and clients, and to make sure they sound formal and are respectful enough, and I’ve found it to be very good at this. But I would suggest knowing enough Japanese to be able to fix anything that sounds off or is lost in translation.

I wouldn’t recommend it as a tool for beginners, but I definitely encourage advanced learners to give it a shot, since it really does improve, summarise and rephrase texts successfully a lot of the time.

I don’t remember where I read this first, but I liked this quote:

What’s so confusing about AI is that it’s good at things you wouldn’t expect it to, and it’s terrible at tasks that are stereotypically machine-like. Fact checking? Sourcing? Citations? It’s awful. But writing human-like text? Proofreading? Maintaining natural conversations? It’s awesome at that.

Bing AI is better as it gives sources etc etc