Applied AI benchmarksSandboxesApplied AIModels and agents scored on 51 tax returns and 21 legal cases.Tax returns0%20%40%60%80%100%Line accuracy91.4%GPT-5.5CodexGPT-5.5Codex91.2%Claude OpusClaude CodeClaude OpusClaude Code90.1%Claude SonnetClaude CodeClaude SonnetClaude Code72.8%Claude HaikuClaude CodeClaude HaikuClaude Code70.7%GPT-5.1GPT-5.1Direct API callGPT-5.5 on CodexLine accuracy91.4%51 returnsInterval87.2%–95.7% (95% Student's t)Claude Opus on Claude CodeLine accuracy91.2%51 returnsInterval87.1%–95.3% (95% Student's t)Claude Sonnet on Claude CodeLine accuracy90.1%51 returnsInterval85.8%–94.4% (95% Student's t)Claude Haiku on Claude CodeLine accuracy72.8%51 returnsInterval68.3%–77.2% (95% Student's t)GPT-5.1 on Direct API callLine accuracy70.7%51 returnsInterval65.7%–75.7% (95% Student's t)0%20%40%60%80%100%Line accuracy91.4%GPT-5.5CodexGPT-5.5Codex91.2%Claude OpusClaude CodeClaudeOpusClaudeCode90.1%Claude SonnetClaude CodeClaudeSonnetClaudeCode72.8%Claude HaikuClaude CodeClaudeHaikuClaudeCode70.7%GPT-5.1GPT-5.1Direct APIcallGPT-5.5 on CodexLine accuracy91.4%51 returnsInterval87.2%–95.7% (95% Student's t)Claude Opus on Claude CodeLine accuracy91.2%51 returnsInterval87.1%–95.3% (95% Student's t)Claude Sonnet on Claude CodeLine accuracy90.1%51 returnsInterval85.8%–94.4% (95% Student's t)Claude Haiku on Claude CodeLine accuracy72.8%51 returnsInterval68.3%–77.2% (95% Student's t)GPT-5.1 on Direct API callLine accuracy70.7%51 returnsInterval65.7%–75.7% (95% Student's t)Line accuracy by setupSetupLine accuracyObservationsRecorded intervalGPT-5.5 on Codex91.4%51 returns87.2%–95.7% (95% Student's t)Claude Opus on Claude Code91.2%51 returns87.1%–95.3% (95% Student's t)Claude Sonnet on Claude Code90.1%51 returns85.8%–94.4% (95% Student's t)Claude Haiku on Claude Code72.8%51 returns68.3%–77.2% (95% Student's t)GPT-5.1 on Direct API call70.7%51 returns65.7%–75.7% (95% Student's t)Legal work020406080100Score out of 10098.6Claude Sonnet 4.5ClaudeSonnet 4.5Tangle legalagentlowest 9297.7Claude Haiku 4.5ClaudeHaiku 4.5Tangle legalagentlowest 87Claude Sonnet 4.5 on Tangle legal agentScore out of 10098.621 clientsInterval97.5–99.6 (95% Student's t)Claude Haiku 4.5 on Tangle legal agentScore out of 10097.721 clientsInterval95.8–99.5 (95% Student's t)020406080100Score out of 10098.6Claude Sonnet 4.5Claude Sonnet 4.5Tangle legal agentlowest 9297.7Claude Haiku 4.5Claude Haiku 4.5Tangle legal agentlowest 87Claude Sonnet 4.5 on Tangle legal agentScore out of 10098.621 clientsInterval97.5–99.6 (95% Student's t)Claude Haiku 4.5 on Tangle legal agentScore out of 10097.721 clientsInterval95.8–99.5 (95% Student's t)Score out of 100 by setupSetupScore out of 100ObservationsRecorded intervalClaude Sonnet 4.5 on Tangle legal agent98.621 clients97.5–99.6 (95% Student's t)Claude Haiku 4.5 on Tangle legal agent97.721 clients95.8–99.5 (95% Student's t)Cost per return$0.00$0.05$0.10$0.15$0.20$0.25Cost per return$0.03GPT-5.1GPT-5.1Direct API call$0.06Claude HaikuClaude CodeClaude HaikuClaude Code$0.17Claude SonnetClaude CodeClaude SonnetClaude Code$0.18GPT-5.5CodexGPT-5.5Codex$0.21Claude OpusClaude CodeClaude OpusClaude CodeGPT-5.1 on Direct API callCost per return$0.0351 returnsClaude Haiku on Claude CodeCost per return$0.0651 returnsClaude Sonnet on Claude CodeCost per return$0.1751 returnsGPT-5.5 on CodexCost per return$0.1851 returnsClaude Opus on Claude CodeCost per return$0.2151 returns$0.00$0.05$0.10$0.15$0.20$0.25Cost per return$0.03GPT-5.1GPT-5.1Direct APIcall$0.06Claude HaikuClaude CodeClaudeHaikuClaudeCode$0.17Claude SonnetClaude CodeClaudeSonnetClaudeCode$0.18GPT-5.5CodexGPT-5.5Codex$0.21Claude OpusClaude CodeClaudeOpusClaudeCodeGPT-5.1 on Direct API callCost per return$0.0351 returnsClaude Haiku on Claude CodeCost per return$0.0651 returnsClaude Sonnet on Claude CodeCost per return$0.1751 returnsGPT-5.5 on CodexCost per return$0.1851 returnsClaude Opus on Claude CodeCost per return$0.2151 returnsCost per return by setupSetupCost per returnObservationsRecorded intervalGPT-5.1 on Direct API call$0.0351 returnsnot recordedClaude Haiku on Claude Code$0.0651 returnsnot recordedClaude Sonnet on Claude Code$0.1751 returnsnot recordedGPT-5.5 on Codex$0.1851 returnsnot recordedClaude Opus on Claude Code$0.2151 returnsnot recorded