Qwen 27B Benchmark: Tools Lift Professional Finance Score to 98%
offgridai · reddit · 2026-08-25
A detailed benchmark of Qwen 3.8 27B on real estate and private equity tasks. Running on a 5090 via vLLM with specific quantization, the model scored 95.25% on a custom 600-question professional suite without tools.
Adding an MCP layer (finance calculators, capped web search) lifted the score to 98.05%. Further hinting the model to use specific professional sources like SEC Edgar nudged the score to 98.44%. The results demonstrate that while the base model is strong, tools and guided search significantly enhance professional capabilities.
More from coding & agent
- A versioned bootstrap loader pattern for keeping AI-generated code always shippable — NickPassig · 2026-10-15
- Amazon blocks AI shopping agents; Maritime offers $1/month Android MCP workaround — Scobleizer · 2026-10-15
- Dev vibe-codes open-source newsletter platform, 83% cheaper than Beehiiv from $19/mo — marclou · 2026-10-15
- ERP AI launches Proto: 'headless SaaS' business software built for AI agents — Aiden_Tech_Ai · 2026-10-15
- Engineering managers need deep reading, not just agent summaries: 5 recommended resources — rseroter · 2026-10-15
- Adding motion graphics with just a prompt: the Claude Motion x ElevenLabs MCP workflow — CurieuxExplorer · 2026-10-15