Explainable Explainability for Clinical LLMs

Mon, 15 Jul 2024 00:00:00 +0000

Discussions of explainability for large language models (LLMs) tend to focus on methods that identify what parts of a neural network encode certain concepts or words, with the hope that by illuminating the meaning of parts of the LLM “black box” we can be certain of how it is making a decision. These methods resemble those used in convolutional neural network architectures processing imaging data from, say, a CT scan, where parts of the source image important to the label are highlighted to help humans understand how the categorization was performed.

Explainability on Scott Gilmore, MD

Explainable Explainability for Clinical LLMs