Chainforge.aiExpert-Driven Leaderboards
Community-owned LLM rankings from domain experts across industries — beyond automated benchmarks.
Medical Diagnosis Chain-of-Thought Evaluation
Comprehensive evaluation of LLM diagnostic reasoning capabilities using real clinical cases. Measures diagnostic accuracy, reasoning coherence, and consideration of alternative diagnoses.
Top 3 Models
Bug-Fix and Refactor
Evaluates models on reading, refactoring, and fixing real-world code snippets with tests. Weighted scoring for safety and style.
Top 3 Models
Earnings Call Summarization
Ranks models on accuracy and fidelity for summarizing earnings calls and extracting KPIs, with hallucination penalties.
Top 3 Models
Bug-Fix and Refactor
Evaluates models on reading, refactoring, and fixing real-world code snippets with tests. Weighted scoring for safety and style.
Top 3 Models
Style Transfer
Measures stylistic fidelity, coherence, and constraint following for author-style transfer tasks.
Top 3 Models
Medical Diagnosis Chain-of-Thought Evaluation
Comprehensive evaluation of LLM diagnostic reasoning capabilities using real clinical cases. Measures diagnostic accuracy, reasoning coherence, and consideration of alternative diagnoses.
Top 3 Models
Earnings Call Summarization
Ranks models on accuracy and fidelity for summarizing earnings calls and extracting KPIs, with hallucination penalties.