AgentRewardBench Leaderboard

💾Code	📄Paper	🌐Website
🤗Dataset	💻Demo	🏆Leaderboard

This is the leaderboard for the AgentRewardBench. The scores are based on the results of the agents on the benchmark. We report the precision score. Open an issue to submit your results to the leadeboard. We will review your results and add them to the leaderboard.

Judge	Overall	AB	VWA	WA	Work	Work++
Rule-based	83.8	25	85.2	79	100	83.3
AER-C	67.7	83.3	56	68.8	100	66.7
AER-V	67.6	83.3	61.2	67.6	96.4	59.3
NNetNav	52.5	20.8	54.5	54.3	77.3	43.2
Claude 3.7 S. (A)	68.8	87.5	61	69.3	85	66.7
GPT-4o (A)	69.8	77.8	63	70.2	94.6	63
GPT-4o Mini (A)	61.5	80	57.9	63.5	84.2	49.4
Llama 3.3 (A)	67.7	75	59.6	68.2	94.3	62.7
Qwen2.5-VL (A)	64.3	72.7	59.3	63.6	87.2	60.3
Claude 3.7 S. (S)	69.4	71.4	64.8	69.3	85.3	66.7
GPT-4o (S)	68.1	77.8	60.7	69.9	93.8	59.6
GPT-4o Mini (S)	64.5	80	57.4	66.9	90.3	54.8
Qwen2.5-VL (S)	64.5	70	58.5	62.9	93.8	64.4