History

Reinier van der Leer f2cb553c9a chore(agent, forge, benchmark): Update `pyright` to v1.1.366		2024-06-08 21:48:25 +02:00
..
.vscode	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
agbenchmark	fix typos (#7123 )	2024-05-31 11:16:23 +02:00
agbenchmark_config	Add more challenges + cleanup (#5368 )	2023-09-27 17:58:58 -07:00
backend	Refactor benchmark (#5247 )	2023-09-17 06:55:20 -07:00
frontend	Fix challenges (#5561 )	2023-10-05 10:59:50 -07:00
notebooks	chore(benchmark): Upgrade OpenAI client lib from v0 to v1	2024-01-16 15:49:46 +01:00
reports	Set up unified pre-commit + CI w/ linting + type checking & FIX EVERYTHING (#7171 )	2024-05-28 05:04:21 +02:00
tests	Set up unified pre-commit + CI w/ linting + type checking & FIX EVERYTHING (#7171 )	2024-05-28 05:04:21 +02:00
.env.example	feat(benchmark): Make report output folder configurable	2024-02-15 18:07:45 +01:00
.flake8	Set up unified pre-commit + CI w/ linting + type checking & FIX EVERYTHING (#7171 )	2024-05-28 05:04:21 +02:00
.gitignore	Add eval_id and sync Skill Tree with Frontend(#5287 )	2023-09-21 13:36:17 -07:00
.python-version	Auto-GPT-20230905085638	2023-09-05 10:10:03 -07:00
LICENSE	clean(benchmark): Remove Depreciated Challenges (#7144 )	2024-05-20 15:01:36 +02:00
README.md	Rename Auto-GPT to AutoGPT (#5301 )	2023-09-22 15:49:29 -07:00
agents_to_benchmark.json	Rename Auto-GPT to AutoGPT (#5301 )	2023-09-22 15:49:29 -07:00
poetry.lock	chore(agent, forge, benchmark): Update `pyright` to v1.1.366	2024-06-08 21:48:25 +02:00
pyproject.toml	Set up unified pre-commit + CI w/ linting + type checking & FIX EVERYTHING (#7171 )	2024-05-28 05:04:21 +02:00
run.sh	Fixing benchmarks	2023-09-11 17:41:27 -07:00

README.md

Auto-GPT Benchmarks

Built for the purpose of benchmarking the performance of agents regardless of how they work.

Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.

Save time and money while doing it through smart dependencies. The best part? It's all automated.

Scores:

Ranking overall:

Detailed results:

Click here to see the results and the raw data!!

More agents coming soon !