TorchJD: A PyTorch Library for Multi-Loss Training
Skeylos2 · reddit · 2026-07-08
Introduces the PyTorch library TorchJD, designed for multi-loss training. It contrasts scalarization (combining multiple losses into a single loss before performing gradient descent) with Jacobian descent (computing gradients for each loss individually and then aggregating them into an update vector that simultaneously reduces all losses). The latter is superior when multi-objective conflicts are severe. The library implements the two main methods found in the literature and has been officially incorporated into the PyTorch ecosystem.
More from coding & agent
- AI agents are starting to strain code hosting platforms — craigsdennis · 2026-07-21
- Omnigent 0.6.0 adds Claude Code imports, Slack approvals and desktop apps — matei_zaharia · 2026-07-21
- Google appears to have quietly shipped Gemini 3.6 Flash, with lower pricing and better agentic scores — xiaohu · 2026-07-21
- Coding agents feel less stressful when the 5-hour limits are temporarily removed — iamrobotbear · 2026-07-21
- OpenAI’s London Codex event packed a room with teams shipping in one day — paw_lean · 2026-07-21
- TWSE MCP Server brings Taiwan stock data into natural-language workflows — modelcontextprotocol · 2026-07-21