Position: Uncertainty Quantification in LLMs is Just Unsupervised Clustering

This research paper argues that current methods for Uncertainty Quantification (UQ) in large language models are fundamentally flawed because they function as unsupervised clustering rather than measures of factual accuracy. The authors contend that these techniques merely track internal consistency, which fails to identify confident hallucinations where a model is consistently wrong. This reliance on internal stability creates a false sense of security and suffers from issues like hyperparameter sensitivity and a lack of objective ground truth. To fix these problems, the paper proposes a paradigm shift that anchors model confidence in external reality and objective verification. Ultimately, the researchers p...