BizFinBench.v2: Towards Reliable LLMs in Finance via Real-User Data and Offline/Online Bilingual Evaluation
Updated
Updated · arxiv.org · Jul 13
BizFinBench.v2: Towards Reliable LLMs in Finance via Real-User Data and Offline/Online Bilingual Evaluation
1 articles · Updated · arxiv.org · Jul 13
Summary
Researchers have released BizFinBench.v2, a benchmark using real user data to evaluate large language models (LLMs) in financial scenarios.
The benchmark covers both Chinese and U.S. equity markets, featuring 28,860 questions across offline and online tasks, including investment and risk analysis.
Results show leading models like GPT-5 still fall short of business requirements, highlighting the need for further improvement in LLMs for financial applications.