WindyMadman/Auto-GPT
1
0
Fork 0
mirror of https://github.com/Significant-Gravitas/Auto-GPT.git synced 2025-01-08 11:57:32 +08:00
Code Issues Packages Projects Releases Wiki Activity
78d83bb3ce
Auto-GPT/benchmark
History
Reinier van der Leer c26c79c34c
fix(benchmark/reports): Resolve error in format.py on attempt.cost is None
2024-02-29 19:01:47 +01:00
..
.vscode Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
agbenchmark fix(benchmark/challenges): Improve spec and eval of TicTacToe challenge 2024-02-20 11:52:59 +01:00
agbenchmark_config Add more challenges + cleanup (#5368) 2023-09-27 17:58:58 -07:00
backend Refactor benchmark (#5247) 2023-09-17 06:55:20 -07:00
frontend Fix challenges (#5561) 2023-10-05 10:59:50 -07:00
notebooks chore(benchmark): Upgrade OpenAI client lib from v0 to v1 2024-01-16 15:49:46 +01:00
reports fix(benchmark/reports): Resolve error in format.py on attempt.cost is None 2024-02-29 19:01:47 +01:00
tests Fix benchmark ci (#5478) 2023-10-02 12:41:32 -07:00
.env.example feat(benchmark): Make report output folder configurable 2024-02-15 18:07:45 +01:00
.flake8 Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.gitignore Add eval_id and sync Skill Tree with Frontend(#5287) 2023-09-21 13:36:17 -07:00
.pre-commit-config.yaml Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
.python-version Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
agents_to_benchmark.json Rename Auto-GPT to AutoGPT (#5301) 2023-09-22 15:49:29 -07:00
LICENSE Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
mypy.ini Auto-GPT-20230905085638 2023-09-05 10:10:03 -07:00
poetry.lock feat(benchmark/cli): Add challenge list, challenge info subcommands 2024-02-16 15:17:11 +01:00
pyproject.toml feat(benchmark/cli): Add challenge list, challenge info subcommands 2024-02-16 15:17:11 +01:00
README.md Rename Auto-GPT to AutoGPT (#5301) 2023-09-22 15:49:29 -07:00
run.sh Fixing benchmarks 2023-09-11 17:41:27 -07:00

README.md

Auto-GPT Benchmarks

Built for the purpose of benchmarking the performance of agents regardless of how they work.

Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.

Save time and money while doing it through smart dependencies. The best part? It's all automated.

Scores:

Screenshot 2023-07-25 at 10 35 01 AM

Ranking overall:

Detailed results:

Screenshot 2023-07-25 at 10 42 15 AM

Click here to see the results and the raw data!!

More agents coming soon !