this post was submitted on 10 Aug 2023
158 points (97.0% liked)

AI

4123 readers
2 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago
158
ChatGPT gets code questions wrong 52% of the time (www.theregister.com)
submitted 1 year ago by [email protected] to c/[email protected]
10 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 3 points 1 year ago

GPT4 with reflexion prompting gets 90% correct (for HumanEval coding benchmark). The paper this is based on is misleading at best.