Glossary term
Glossary term
Agentic Systems
Architecture where multiple LLMs act as proposers generating candidate responses and an aggregator LLM synthesises them into a final answer.
Mixture of Agents (Together AI, 2024) uses three rounds of 3-model proposers feeding a GPT-4o aggregator, achieving higher quality than any individual model - scoring 65.1% on AlpacaEval 2.0 vs GPT-4o's 57.5% standalone.
Mixture of Agents is used in enterprise report-generation workflows where diverse analytical perspectives are valuable - a financial research firm uses three analyst-role LLMs to propose investment theses and a synthesis LLM to produce the final memo.
OpenAI's o3 reasoning process implicitly implements a Mixture of Agents pattern at inference time, generating multiple candidate reasoning chains and selecting the most consistent answer via a learned aggregation mechanism.