There is this concept called "crityhype". It's a type of marketing mascarading as criticism. "Careful, AI might become too powerful" is exactly that

A lot of the folks worried about AI x-risk are also worried about climate, and pandemics, and lots of other things too. It's not like there's only one threat.

Clearly because actually explaining it doesn't generate clicks and controversy

Solving real problems is hard because if it wasn't they would be solved already, but making up fake problems is really easy.

Discreet object recognition. Right now they can't answer the simplest questions that require counting discrete objects. Which to me implies they have no discreet object sense at all. They're just looking for word patterns.

I'll give you an example, If you were to ask one of these. "I was on my way to the store when I saw a sow with six piglets, how many feet do we have?"

We could have a lively debate about what potential answers would be acceptable. Maybe there's only 2 feet because the rest are hooves, maybe there's 30 because that's how many foot like appendages there are in total, but the answer it will give you will make absolutely no sense.

Chat GPT will be like, "11" or "15" and if you ask it any questions or follow up it genuinely does not have any answer for how any of these objects could be discreetly counted or partitioned. It can try to explain itself but quickly starts babbling nonsense.

Sentience