The Problem
Creating short videos for product marketing, social media, or customer demos usually means: hire a video editor, wait days, pay thousands. Or open a desktop app, learn the timeline, export, re-export when something's wrong.
What if your AI agent could do it? Text in, MP4 out. Server-side. No desktop app, no manual editing, no waiting for renders.
Introducing AI Video Studio
AI Video Studio is an open-source OpenClaw skill that chains two powerful tools:
- Seedance 2.0 (ByteDance Doubao) — AI video generation from text/image prompts
- FFmpeg — Server-side rendering: clip concatenation, subtitle burn-in, BGM mixing
- CapCut Mate (optional) — Jianying draft creation for advanced timeline editing
How It Works
Write a storyboard in JSON, run one command, get an MP4:
{
"title": "Product Ad",
"ratio": "16:9",
"shots": [
{"prompt": "Smartphone floating in space", "duration": 5, "caption": "Next-Gen Design"},
{"prompt": "Hands holding phone with holographic UI", "duration": 5, "caption": "Intelligence at Your Fingertips"}
]
}python3 studio.py pipeline storyboard.jsonBehind the scenes:
- Each shot is submitted to Seedance 2.0 in parallel (3-10 min generation)
- Generated clips are downloaded and normalized to the target resolution
- FFmpeg concatenates clips, burns SRT subtitles, and mixes BGM
- Final MP4 is saved to disk — ready to post
Four CLI Commands
| Command | Use Case |
|---|---|
generate | Generate a single AI video clip |
render | FFmpeg render: concat + subtitles + BGM → MP4 |
compose | CapCut Mate: create Jianying draft with effects |
pipeline | End-to-end: storyboard JSON → final MP4 |
OpenClaw Integration
As an OpenClaw skill, AI Video Studio is invoked through natural language:
"Make a 3-shot product video, 16:9, 5 seconds each, with captions."
The agent builds a storyboard, calls studio.py pipeline, and returns the MP4 — through Telegram, WhatsApp, or any channel.
Why FFmpeg Over Cloud Rendering?
- Zero dependencies — No Windows machine, no desktop client
- Sub-second render — Near-instant concatenation and subtitle burn
- Server-side — Runs on any Linux box with ffmpeg
- Free — No cloud rendering fees
Get Started
git clone https://github.com/iPythoning/ai-video-studio.git
cp -r ai-video-studio/skills/ai-video-studio ~/.openclaw/workspace/skills/
export SEEDANCE_API_KEY="your-key"
python3 studio.py pipeline storyboard.jsonStar the repo: github.com/iPythoning/ai-video-studio
Built with OpenClaw · Seedance 2.0 · CapCut Mate · FFmpeg