Kosong — a new open-source AI agent development framework from Moonshot AI

What is Kosong?

Kosong is a new open-source AI agent development framework released by Moonshot AI (Moonshot). It provides developers with a lightweight, flexible, and highly scalable foundation for building next-generation intelligent agent applications.
With its asynchronous tool-orchestration engine, Kosong can efficiently schedule multiple tools to run in parallel—for example, calling a weather API, map service, and calendar system at the same time—greatly improving agent responsiveness and task success rates.
Kosong adopts a plugin-based architecture, supporting pluggable Chat Providers, allowing developers to switch between or mix different models such as Kimi, DeepSeek, and Llama 3 without modifying core business logic.

Key Features of Kosong

• Efficient parallel execution:
  Kosong’s asynchronous orchestration engine allows multiple tools to run simultaneously—such as weather APIs, mapping services, and calendar systems—substantially improving task-processing efficiency.

• Support for complex task flows:
  Enables the construction of sophisticated workflows, such as automatically adjusting schedules based on weather conditions, allowing agents to handle more complex user needs.

• Flexible model switching:
  With pluggable Chat Providers, developers can freely switch between or mix models (e.g., Kimi, DeepSeek, Llama 3) without changing core business logic.

Technical Principles Behind Kosong

• Asynchronous tool-orchestration engine:
  Kosong uses asynchronous programming to efficiently schedule multiple tools in parallel. Through async task queues and event-driven mechanisms, the framework can process multiple API calls or tool executions simultaneously, significantly improving responsiveness.

• Plugin-based architecture and standardized components:
  Supports pluggable chat providers and tool modules. Standardized interfaces encapsulate different models and tool functions, allowing developers to mix and match models without altering core logic—improving flexibility and scalability.

• Unified LLM abstraction layer:
  Kosong provides a unified abstraction layer for large language models (LLMs), encapsulating different models, tool functions, and memory modules into standardized components. This mitigates tool fragmentation and interface incompatibility, reducing integration complexity.

• Modern Python ecosystem support:
  Built for Python 3.13+, Kosong leverages modern asynchronous features. It also recommends the next-generation package manager uv for installation and dependency management, ensuring strong compatibility with today’s Python ecosystem.

• Out-of-the-box experience:
  Comes with complete example code and built-in demo agents. Developers can configure a few environment variables and immediately launch and test the framework, allowing them to focus on actual application logic.

Project Link

GitHub repository: https://github.com/MoonshotAI/kosong

Application Scenarios of Kosong

• Intelligent customer service & automation:
  Build customer service agents that asynchronously call multiple tools (user info lookup, order processing, knowledge base search, etc.) to deliver fast, efficient responses.

• Personal assistant & schedule management:
  Create personal assistant applications that adjust schedules, send reminders, and make smart decisions based on real-time data such as weather and traffic conditions.

• Multi-model hybrid workflows:
  Kosong’s plugin design allows mixing multiple AI models—useful for scenarios requiring different model strengths such as content creation, data analysis, or translation.

• Enterprise application integration:
  Standardized components and flexible plugins enable seamless integration with existing enterprise systems (ERP, CRM), enabling intelligent workflow automation.

• Education & learning tools:
  Build intelligent education applications that leverage knowledge bases, online learning resources, and real-time feedback tools to offer personalized learning experiences.

• Smart home control:
  Connect and control various smart home devices through voice or text commands, enabling automated device management and enhancing home convenience.