Protein LM embeddings + similarity-based label augmentation improve pKa prediction

bravo_abad · x · 2026-10-27

Predicting amino acid protonation (pKa) matters for understanding enzyme activity, but experimental measurements are scarce. Shen et al. trained a small neural network on ESM protein-language-model embeddings to predict pKa directly from sequence.

The data-augmentation trick is worth borrowing: starting from an amino acid with a measured pKa, they search protein databases for other residues with highly similar embeddings and assign them the measured value as a synthetic label, assuming representation similarity implies similar biochemical environments. The RMSE chart shows GAINES augmentation at a high similarity threshold (0.8–1.0) clearly cuts error versus no augmentation or naive duplication.

Original post →

More from Research

Research channel →