Semantic Entropy to Detect Confabulation in Large Language Models (Farquhar et al.)

Tue, 25 Jun 2024 00:00:00 +0000

LLMs Can Make Stuff Up
#

Most people who play around with ChatGPT or another LLM (and are not famous) have had the experience of asking about themselves and receiving convincing but wrong BS. Here’s what happens when I ask Llama 3 about myself:

>>> Tell me about Scott Gilmore, M.D. who trained at Christiana.

Scott Gilmore, MD, is an American orthopedic surgeon and researcher. He received his medical degree from Jefferson Medical College and completed his residency in orthopedic surgery at ChristianaCare Health System (then known as Christiana Healthcare System) in Wilmington, Delaware.

I’m not an orthopedic surgeon (I trained in EM), and I didn’t go to Jefferson (Wake Forest), etc. etc. …

Hallucinations on Scott Gilmore, MD

Semantic Entropy to Detect Confabulation in Large Language Models (Farquhar et al.)

LLMs Can Make Stuff Up #

LLMs Can Make Stuff Up
#