Context Language Models: Self-Managing Context to Improve Performance and Reduce Compute Costs
Researchers from Meta, MIT and the University of Washington introduce Context Language Models, which let models manage and edit their own context instead of relying on predefined summarization, compression and retrieval mechanisms. They report gains in performance and computational efficiency.
