MemGPT: Towards LLMs as Operating Systems

Authors: P. Groeneveld, I. K. et al.
Year: 2023
Summary: This paper presents MemGPT, a system that manages the limited context window of LLMs using techniques from traditional operating systems. It uses a tiered memory system (main context and external context) and intelligent paging to provide the illusion of an infinite context window, which is crucial for long-term memory.
Link: https://arxiv.org/abs/2310.08560