How the experiment was built: 10 document-processing jobs, 4-5 prompt variants each

santiviquez · x · 2026-11-17

The author describes the experiment design: 10 use cases covering financial tables, legal contracts, invoices, receipts and paper forms, each with 4-5 phrasing variants — direct recommendation requests, problem-first framings, casual asks — plus variants asking models to write the implementation code, to test whether phrasing changes what gets recommended.

Related event: 3,600-Query Experiment: 79% of API Recommendations Go to Big Cloud(2 posts)→

Original post →

More from Research

Research channel →