Get Started

Architecture

The new era requires a new architecture. This new architecture is managable, but takes some adjustment.

It primarily consists of three main components: orchestration, memory, and skills. For more on memory, please see here. For more on orchestration, please see this excellent post. For more on skills and function calling in LLMs, please see this article.

Orchestration consists of determining which skill, if any, should be taken. Memory consists in storing and using information to improve the performance of the application. Skills consist of what the AI application is enabled to do.

Additional AI Architecture Resources

Patterns for Building LLM-Based Systems and Products

Understanding Retrieval Augmented Generation

Understanding GraphRAG

The Architecture of Today's LLM Applications