Glossary term
Glossary term
Agentic Systems
Architecture where multiple AI models, retrievers, and non-AI components are combined to achieve capabilities no single model could deliver alone.
The LMSYS Compound AI Systems blog (2024) coined the term, citing AlphaCode 2, Medprompt, and Gemini as examples. AlphaCode 2 combines a code generation model, a clustering model, and a filter model to achieve a 43% improvement over AlphaCode on competitive programming.
Perplexity AI is a compound AI system: a user query triggers a web search engine, a reranker, an LLM to generate an answer, and a citation-verification component - no single model produces the final grounded response.
Microsoft 365 Copilot is a compound AI system integrating GPT-4o for language, Bing for grounding, Semantic Index for enterprise search, Microsoft Graph for user context, and Power Automate for action execution.