Context Language Models: Self-Managing Context to Improve Performance and Reduce Compute Costs
Researchers from Meta, MIT and the University of Washington introduce Context Language Models, which let models manage and edit their own context instead of relying on predefined summarization, compression and retrieval mechanisms. They report gains in performance and computational efficiency.
AI-written summary, checked against the cited sources. How summaries work
