Developer's talk on running on-device AI praised for great insights
carrycooldude · x · 2026-10-04
Developer @carrycooldude gave the closing talk of the day, "Running on device AI", at a tech event, sharing practical insights on running AI locally on devices. Attendee @tapasadhikary praised the talk for its valuable takeaways.
More from Infra
- Ex-OpenAI researcher flags: SPV shills from six months ago are now selling you data centers — suchenzang · 2026-10-04
- MTPLX Ships New Version: Cache Copies Cut to One, Much Faster Decoding Past 140k Tokens — HankYeomans · 2026-10-04
- Open-source marin project pushes single-rack training MFU from 28.2% to 31.1% — dlwh · 2026-10-04
- Samsung: HBM to consume 30% of DRAM wafer capacity by 2027, up from ~20% — Beth_Kindig · 2026-10-04
- Nebius up 160% vs CoreWeave's 10%: the deciding factor isn't revenue or backlog — Beth_Kindig · 2026-10-04
- US Data Center Construction Spending Surged 73% YoY to a Record $85B Annualized — FlorianGallwitz · 2026-10-04