SuperThoughts: Reasoning Tokens in Superposition

SuperThoughts is a novel framework designed to accelerate the Chain-of-Thought (CoT) reasoning process in large language models by processing tokens in superposition. Unlike traditional models that generate tokens sequentially, this method uses a compressor to fuse pairs of consecutive tokens into single latent representations, effectively halving the number of required forward passes. To ensure accuracy is not sacrificed for speed, the system employs a Multi-Token Prediction (MTP) module and a confidence-based adaptive mechanism that reverts to standard decoding when the model is uncertain. Experimental results on complex mathematical and scientific benchmarks show that SuperThoughts reduces reasoning length by 20–35% while ma...