Developer Open-Sources Screenshot Classifiers for Screen Type and Intent Detection
Developer drstoney open-sourced a multi-task screenshot classifier for categorizing screens like chats, albums and feeds with safety labels, plus a fine-tuned intent classifier that determines from conversation history when a user wants an LLM to look at their screen.
2026-09-02 ~ 2026-09-04 · 2 related posts
- Open-Source Screenshot Intent Classifier: Detecting When Users Want the LLM to See Their Screen — TheMoonMidas · 2026-09-02
- Open-sourced: training code for a mobile screenshot classifier (feeds, gallery, chats) — TheMoonMidas · 2026-09-04