Applied filters1 selected

90 resources

Resources

Evaluation, Testing & ObservabilityFree

WebArena: Realistic Web Environment

Developer

Publisher: Emergentmind
Type Group: Benchmarks & Datasets
Type: Benchmark
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

WebArena: A Realistic Web Environment for Building Autonomous Agents - ADS

Developer

Publisher: Harvard
Type Group: Benchmarks & Datasets
Type: Benchmark
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Published in Transactions on Machine Learning Research (05/2025)

Developer

Publisher: Openreview
Type Group: Research & Papers
Type: Paper
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

GAIA:A Benchmark for General AI Assistants - ar5iv - arXiv

Developer

Publisher: arXiv
Type Group: Research & Papers
Type: Paper
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Synthesizing Agent Trajectories via Test-Time Exploration ...

Developer

Publisher: arXiv
Type Group: Research & Papers
Type: Paper
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents

Developer

Publisher: arXiv
Type Group: Research & Papers
Type: Paper
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Webarena

Developer

Publisher: arXiv
Type Group: Research & Papers
Type: Paper
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

WebArena: A Realistic Web Environment for Building Autonomous Agents

Developer

Publisher: arXiv
Type Group: Research & Papers
Type: Paper
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Best AI Agent Evaluation Benchmarks: 2025 Complete Guide

Developer

Publisher: O Mega
Type Group: Benchmarks & Datasets
Type: Benchmark
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Beyond Accuracy: A Multi-Dimensional Framework for Evaluating Enterprise Agentic AI Systems

Developer

Publisher: arXiv
Type Group: Research & Papers
Type: Paper
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

How We Broke Top AI Agent Benchmarks: And What Comes Next | Hao Wang

Developer

Publisher: Github
Type Group: Benchmarks & Datasets
Type: Benchmark
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Hermes Agent Benchmark: The Complete Guide | Armalo AI

Developer

Publisher: Armalo
Type Group: Benchmarks & Datasets
Type: Benchmark
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

GitHub - philschmid/ai-agent-benchmark-compendium: Compendium of over 50 benchmarks for evaluating AI agents, categorized into Function Calling & Tool Use, General Assistant & Reasoning, Coding & Software Engineering, and Computer Interaction. · GitHub

Developer

Publisher: GitHub
Type Group: Benchmarks & Datasets
Type: Benchmark
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Establishing Best Practices for Building Rigorous Agentic Benchmarks

Developer

Publisher: arXiv
Type Group: Research & Papers
Type: Paper
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

UC Berkeley Exposes Flaws in Major AI Agent Benchmarks | AIToolly

Developer

Publisher: Aitoolly
Type Group: Benchmarks & Datasets
Type: Benchmark
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Center for Responsible, Decentralized Intelligence at Berkeley

Developer

Publisher: Berkeley
Type Group: Tools & Platforms
Type: Tool
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

AI Agent Benchmark Results Index | Steel.dev

Developer

Publisher: Steel
Type Group: Benchmarks & Datasets
Type: Benchmark
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Assertions and Metrics - LLM Output Validation | Promptfoo

Developer

Publisher: Promptfoo
Type Group: Docs & Guides
Type: Docs
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree/Paid

Generative AI Evaluation with Promptfoo: A Comprehensive Guide | by Yuki Nagae | Medium

Developer

Publisher: Medium
Type Group: Benchmarks & Datasets
Type: Benchmark
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Configuration Reference - Complete API Documentation | Promptfoo

Developer

Publisher: Promptfoo
Type Group: Docs & Guides
Type: Docs
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Evaluate Coding Agents | Promptfoo

Developer

Publisher: Promptfoo
Type Group: Docs & Guides
Type: Docs
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Agent Skill for Writing Evals | Promptfoo

Developer

Publisher: Promptfoo
Type Group: Docs & Guides
Type: Docs
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

GitHub - promptfoo/promptfoo: Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic. · GitHub

Developer

Publisher: GitHub
Type Group: Tools & Platforms
Type: Tool
Level: Intermediate
Topic: Agent evaluation

Open

Evaluation, Testing & ObservabilityFree

Intro | Promptfoo

Developer

Publisher: Promptfoo
Type Group: Docs & Guides
Type: Docs
Level: Intermediate
Topic: Agent evaluation

Open

Loading resources…

Resources

Browse Agentic AI Resources