AUSM: open-source local-first context layer for context-aware macOS apps
HaijunXia · x · 2026-11-19
The team open-sourced AUSM (Activity Understanding and Scaffolding Medium), an MIT-licensed, local-first framework for prototyping context-aware interactions on macOS, arguing 'context understanding is still the missing layer.' It ships three concepts: Sensors (typed events for selection, typing, copy/paste, screenshots, window focus), Materials (files/tabs you viewed and screen-stream keyframes kept in local SQLite — not a list of links like 'connect Gmail'), and Detectors (rules written in a Markdown file checked by a vision model against the focused window, working with Gemini, Cerebras, any OpenAI-compatible endpoint, or local models). Available as an npm package, a Swift package, and a demo Mac app, with Anind K. Dey's 2001 context-computing paper as theoretical grounding.
More from coding & agent
- Hot take: low-level programming is easier than your containerized dependency mess — shauseth · 2026-11-19
- Remotion ships real motion blur via HTML-in-canvas and WebGPU — Vjeux · 2026-11-19
- Immunologist builds research-grade flow cytometry app with GPT-6.2, plans to open-source it — DeryaTR_ · 2026-11-19
- Switch Buddy builds a full dev team from one prompt: coder, reviewer, debugger in shared rooms — cneuralnetwork · 2026-11-19
- Unverified: Google's rumored Gemini Neon wows with one-shot working Olivetti typewriter — dreamwieber · 2026-11-19
- Zed dev: Gemini 4 Neon solves in one round what 3 frontier models couldn't crack in 9 — vivnat · 2026-11-19