LLM2R recasts 3D part assembly as sequence modeling with a decoder-only LLM

NationalUniversityofSingapore · hf · 2026-10-21

Researchers from NUS and PolyU present LLM2R, which treats 3D part assembly as sequence modeling: a Point-BERT encoder and Q-Former compress each part into geometric tokens, and a LoRA-adapted causal decoder-only LLM predicts all SE(3) part poses in a single forward pass. Learnable summary tokens after each part block let hidden states aggregate the whole assembly at constant token cost, and a part-aware pose head fuses each part's states for rotation and translation. One architecture handles semantic and geometric assembly, improving scalability over pairwise-relation or iterative generate-and-verify methods.

Original post →

More from Embodied

Embodied channel →