JADE: Expert-Grounded Dynamic Evaluation for Open-Ended Professional Tasks
Updated
Updated · arxiv.org · Jul 13
JADE: Expert-Grounded Dynamic Evaluation for Open-Ended Professional Tasks
1 articles · Updated · arxiv.org · Jul 13
Summary
Researchers have introduced JADE, a two-layer evaluation framework for assessing AI agents on open-ended professional tasks.
JADE combines expert-grounded evaluation skills with dynamic, claim-level verification to provide both stable and adaptive assessments of AI-generated reports.
Tested on the new BizBench benchmark, JADE reveals critical failure modes in current AI agents, such as evidence–reasoning gaps and citation laundering, enhancing evaluation transparency.