AIOS
AIOS treats the LLM as the "brain" of an operating-system kernel for agents, providing scheduling, memory, storage, tool, and access-control services so agent apps can share resources safely.
Ask this paper
Kernel-style isolation: LLM-specific services (scheduler, context manager, memory/storage managers, tool manager, access manager) are separated from application code, mirroring traditional OS architecture.
Concurrent agents: The scheduler allows multiple agents to share the same LLM backend with context switching, making multi-agent workloads far more efficient than ad-hoc orchestration.
SDK for developers: Agent apps talk to the kernel through a standardized SDK, so tool services, memory stores, and permissions are consistent across frameworks.
Performance: Serving agents built with various agent frameworks on top of AIOS yields up to 2.1x faster execution compared to running them independently.