By-Its-Cover: A CLIP-Only Book Recommendation System
LaidbyKool-aid · reddit · 2026-08-22
The author built 'By-Its-Cover', a recommendation system relying solely on book cover CLIP embeddings.
System Architecture:
- Semantic Search: Combines CLIP search with GLiNER (ONNX) keyword extraction, fetching data via Hardcover API and merging results with Reciprocal Rank Fusion.
- Collaborative Filtering: Uses a two-tower neural network trained on user feedback, diversified via Determinantal Point Process (DPP).
Engineering Stack:
- Deployed on AWS (Lambda, ECS, SQS, Cognito, S3) using Terraform and GitHub Actions.
- Offline update pipeline: Recommendations fine-tuned every 2 hours, full model retraining daily.
Next Steps: Replacing CLIP with SigLIP for better visual representation.
More from Apps
- AI agent runs LinkedIn 24/7 to find desperate buyers — julianweisser · 2026-08-22
- Nuance launches marketplace for Dragon Copilot AI apps and agents — luisdans · 2026-08-22
- X Ads launches MCP: AI agents can now manage ad campaigns via conversation — XFreeze · 2026-08-22
- Musk: Grok Bot lets non-technical people run entire businesses with AI agents — elonmusk · 2026-08-22
- Cheat Sheet: Start with Claude Fable 5, Switch to Opus 5 for Execution — alex_verem · 2026-08-22
- Devin AI Integrates with Slack: DM Support and Team Collaboration — DevinAI · 2026-08-22