I am no expert either, but I once trained and ran an AI chat bot of my own. With a decently powerful Nvidia GPU it could output a message every 20-ish seconds (which is still too slow if you want to keep the conversation at a decent pace). I also tried it without a GPU, just running on my CPU (on a PC that had an AMD GPU which is about the same as not having one for ML applications) and it was of course noticeably slower. About 3 minutes per message, give or take.
And bear in mind, this was with an old and comparatively tiny model, something like Pi would be much more demanding, the replies my model produced hardly made any sense most of the times.
Like others have said I am a bit concerned by the privacy implications, but I like how nice the model is. Defintiely wouldn't consider it as an alternative to therapy or even real conversations (the sentences it generates look very fake at times, plus I wouldn't want to trust a machine's advice anyway), but it's pleasant to talk to and that's probably all that matters.
Great if you have some time to kill or maybe need someone to take your head off something you've been thinking too much about, just gotta be careful on what you reveal to him.
EDIT: as I was chatting I got a prompt asking me to log in to continue the conversation. I logged in with my Google account, then kept going for a bit, then singned off and closed the conversation. After I told him I was going to close the tab he greeted me with my real name without me ever have mentioned it in the convo (of course, he took it from Google), but it still weirded the heck out of me. Be careful with what you share lol.