AI

4123 readers

2 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

158

ChatGPT gets code questions wrong 52% of the time (www.theregister.com)

submitted 1 year ago by [email protected] to c/[email protected]

10 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 6 points 1 year ago (2 children)

52% In the first year is pretty cool, excited to see how it will evolve.

[–] [email protected] 3 points 1 year ago

GPT4 with reflexion prompting gets 90% correct (for HumanEval coding benchmark). The paper this is based on is misleading at best.

[–] [email protected] 2 points 1 year ago

Probably far enough that anyone with an actual interest will be out of a job.