Glossary term
Glossary term
Product and Operations
Cost charged based on input and output tokens processed.
OpenAI GPT-4o is priced at $5/1M input tokens and $15/1M output tokens - a SaaS company processing 1M customer-service queries per month at avg 1,000 tokens budgets $5,000/month in input cost alone.
Anthropic Claude 3 Haiku at $0.25/1M input tokens enables a document-classification company to process 50M documents per month at $12,500 - viable where GPT-4o ($250,000) would be cost-prohibitive.
Google Gemini 1.5 Flash at $0.075/1M tokens is used by a startup to build a real-time language-translation feature for their mobile app, keeping per-user monthly AI cost below $0.02 at scale.