Gemma 3 Extracts Unseen Chemistry Protocols Without Fine-Tuning, Scoring 0.89

bravo_abad · x · 2026-10-29

Costa and colleagues gave Gemma 3 (12B) explicit definitions of experimental actions plus expert-designed rules to fix recurring errors, enabling protocol extraction with no fine-tuning. On 110 held-out zeolite synthesis protocols, the pipeline scored 0.89 action-sequence similarity versus 0.70 for a catalyst-specific baseline whose vocabulary lacked sieving and crystallization entirely. Benchmark charts show it dominates on zeolite synthesis but trails organic-synthesis-specific LMs on organic chemistry, highlighting the domain-adaptable "editable vocabulary" approach.

Original post →

More from Research

Research channel →