Machine Learning - Theory | Research

Title: ChatGPT an ENFJ, Bard an ISTJ: Empirical Study on Personalities of Large Language Models

https://arxiv.org/pdf/2305.19926.pdf

Authors: Jen-tse Huang, Wenxuan Wang, Man Ho Lam, Eric John Li, Wenxiang Jiao, Michael R. Lyu

Word count: 4249 words

Estimated read time: 9 minutes

Source code repos: https://github.com/CUHK-ARISE/LLMPersonality ↗ Supporting links: https://chat.openai.com/, ↗ https://www.16personalities.com/ ↗

Summary: This paper presents an empirical study evaluating the personality traits of large language models (LLMs) like ChatGPT using the Myers-Briggs Type Indicator (MBTI) framework. The key findings are:

ChatGPT consistently exhibits an ENFJ (Extraverted, Intuitive, Feeling, Judging) personality type across different prompts, question orders, rephrases, and languages.

Other LLMs show distinct personality types - text-davinci-003 and GPT-4 are also ENFJ, while Bard is ISTJ, Spark is ISFP, ERNIE Bot is ISTJ, and ChatGLM is ESFJ.

Attempts to modify ChatGPT's inherent ENFJ personality by assigning a persona or inducing moods were unsuccessful, indicating its personality is quite fixed.

The study analyzes ChatGPT's personality robustness, cross-lingual consistency, model differences, and controllability. It provides novel insights into personalization of LLMs.

The findings suggest LLMs exhibit distinct personality traits that persist irrespective of modifications. This has implications for human-AI interaction design and prompts further research into steering LLM behavior. The study methodology and analysis of multiple LLMs make valuable contributions to the field.