Open-Source Ref2V Workflow Auto-Transcribes Media and Formats Prompts for H3 Video Generation
bstr3k · reddit · 2026-09-10
A Redditor spent 2.5 weeks building a beginner-friendly H3 Ref2V workflow (on Hugging Face) with two custom nodes: one transcribes/captions your reference video and images, another loads a small LLM of your choice to write properly formatted Ref2V prompts from your intent. The full workflow generates the video too.
Hard-won tips included:
- On low VRAM, run the prompt enhancer separately and review output before generating
- H3's context window appears tied to system resources; exceeding it garbles audio/motion—lower output length and resolution
- Specify emotions explicitly or you get expressionless characters: "slop prompt in, slop video out"
- When the replacement person looks too similar to the original, the model converges back—swap via a faceless green intermediate person or use Sam3 character replacement
- Describe multi-person scenes specifically; "replace the man wearing white shorts with the man in <picture 1>" beats vague prompts
- Adding one-line scene context for the LLM (e.g. "<video 1> is a video of two girls eating chocolate ice cream") helps a lot
Related event: Open-source Minimax H3 video workflows gain traction(2 posts)→
More from coding & agent
- Resin lets an agent build standalone LLM inference engines; vLLM and SGLang optimize DeepSeek kernels differently — AccBalanced · 2026-10-27
- How I let my cloud Grok Bot code on my Mac mini via Tailscale, no public ports — talkaboutdesign · 2026-10-27
- Context layout is a cost decision: one memory edit can bust your entire agent prompt cache — dscape · 2026-10-27
- Alchemy adds effect/Workflow support across Durable Objects, Workflows and Lambda Durable Functions — samgoodwin89 · 2026-10-27
- Alchemy's Lambda Web Functions run plain Node web servers on Lambda, no OpenNext needed — samgoodwin89 · 2026-10-27
- Alchemy makes all ~2,850 AWS bindings work from any cloud, not just S3/Lambda/DynamoDB — samgoodwin89 · 2026-10-27