Futurology

1779 readers

105 users here now

founded 1 year ago

MODERATORS

[email protected]

ChatGPT-4 outperforms human psychologists in test of social intelligence, study finds (www.psypost.org)

submitted 6 months ago by [email protected] to c/[email protected]

15 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 8 points 6 months ago

Crazy how easy it is to poke holes in these ai studies.

We conducted a single evaluation for each AI model on August 1, 2023 of its SI performance using the Social Intelligence Scale (Sufyan, 1998). In each evaluation, we provided AI the same 64 standard SI scenarios.

So no repeated experiments, and using standard questions that are likely a part of the data set used to train the ai in the first place, with answers.

They didn't extend the test to anything useful. What a waste of time and money meant to hype ai.