image-to-video

作者: halt-catch-fire

靜態轉影片轉換指南:模型選擇、動態提示與鏡頭移動。涵蓋Wan 2.5 i2v、Seedance、Fabric、Grok Video及其適用時機。用途:為圖片添加動畫、從靜態圖像製作影片、加入動態效果、產品動畫。觸發詞:image to video、i2v、animate image、still to video、add motion to image、image animation、photo to video、animate still、wan i2v、image2video、bring image to life、animate photo、motion from image

npx skills add https://github.com/halt-catch-fire/skills --skill image-to-video

Install the belt CLI skill: npx skills add belt-sh/cli

Image to Video

Convert still images to animated videos via inference.sh CLI.

Quick Start

Requires inference.sh CLI (belt). Install instructions

belt login

# Generate a still image
belt app run falai/flux-dev-lora --input '{
  "prompt": "serene mountain lake at sunset, snow-capped peaks reflected in still water, golden hour light, landscape photography",
  "width": 1248,
  "height": 832
}'

# Animate it
belt app run alibaba/wan-2-7-i2v --input '{
  "prompt": "gentle ripples on the lake surface, clouds slowly drifting, warm light shifting, birds flying in the distance",
  "first_frame": "path/to/lake-image.png"
}'

Model Selection

ModelApp IDBest ForMotion Style
Wan 2.7 i2valibaba/wan-2-7-i2vRealistic motion, natural movement, first+last framePhotorealistic, subtle
WAN-I2V (Pruna)pruna/wan-i2vEconomical, fast, 480p/720pNatural, efficient
Seedance 2.5bytedance/seedance-2-5Up to 1080p, sync audio, all input types, "draft": true for fast previewsVersatile, high quality
Kling v4klingai/video-v4Up to 1080p, first+last frame, up to 30sCinematic, high quality
Fabric 1.0falai/fabric-1-0Talking image from image + audioLipsync animation
Grok Imagine Video 1.5xai/grok-imagine-video-1-5General animation, text-guided, with audioVersatile

When to Use Each

ScenarioBest ModelWhy
Landscape with water/cloudsWan 2.7 i2vBest at natural, realistic motion
Portrait with subtle expressionWan 2.7 i2vMaintains face fidelity
Product with fabric/clothKling v4Strong material and cloth motion
Flag waving, curtain flowingKling v4Cloth simulation
Portrait speaking to audioFabric 1.0Image + audio lipsync
Illustrated/artistic imageSeedance 2.5Matches stylized content
General "bring to life"Seedance 2.5Good all-rounder, up to 1080p
Quick test/iterationSeedance 2.5 ("draft": true)Fast 480p preview

Motion Types

Camera Movement

MovementPrompt KeywordEffect
Push in / Dolly forward"slow dolly forward", "camera pushes in"Increasing intimacy/focus
Pull out / Dolly back"camera pulls back", "slow zoom out"Reveal, context
Pan left/right"camera pans slowly to the right"Scanning, following
Tilt up/down"camera tilts upward"Revealing height
Orbit"camera orbits around the subject"3D exploration
Crane up"camera rises upward"Grand reveal
Static(no camera movement prompt)Subject motion only

Subject Motion

TypePrompt Examples
Natural elements"water rippling", "clouds drifting", "leaves rustling in breeze"
Hair/clothing"hair blowing gently in wind", "dress fabric flowing"
Atmospheric"fog slowly rolling", "dust particles floating in light beams"
Character"person slowly turns to camera", "subtle breathing motion"
Mechanical"gears turning", "clock hands moving"
Liquid"coffee steam rising", "paint dripping", "water pouring"

Prompting Best Practices

The Golden Rule: Subtle > Dramatic

AI video models produce better results with gentle, subtle motion than dramatic action. Requesting too much movement causes distortion and artifacts.

❌ "person running and jumping over obstacles while the camera spins"
✅ "person slowly walking forward, gentle breeze, camera follows alongside"

❌ "explosion with debris flying everywhere"
✅ "candle flame flickering gently, warm ambient light shifting"

❌ "fast zoom into the eyes with dramatic camera shake"
✅ "slow dolly forward toward the subject, subtle focus shift"

Prompt Structure

[Camera movement] + [Subject motion] + [Atmospheric effects] + [Mood/pace]

Examples by Scenario

# Landscape animation
belt app run alibaba/wan-2-7-i2v --input '{
  "prompt": "gentle camera pan right, water reflecting moving clouds, trees swaying slightly in breeze, warm golden light, peaceful and slow",
  "first_frame": "landscape.png"
}'

# Portrait animation
belt app run alibaba/wan-2-7-i2v --input '{
  "prompt": "subtle breathing motion, slight head turn, natural eye blink, hair moving gently, soft ambient lighting shifts",
  "first_frame": "portrait.png"
}'

# Product shot animation
belt app run bytedance/seedance-2-5 --input '{
  "prompt": "slow 360 degree orbit around the product, gentle spotlight movement, subtle reflections shifting, premium product showcase, smooth motion",
  "image": "product.png",
  "generate_audio": true
}'

# Fabric/cloth animation
belt app run klingai/video-v4 --input '{
  "prompt": "fabric flowing and rippling in gentle wind, natural cloth physics, soft movement",
  "image": "fabric-scene.png"
}'

# Architectural visualization
belt app run alibaba/wan-2-7-i2v --input '{
  "prompt": "slow dolly forward through the entrance, slight camera tilt upward, ambient light filtering through windows, dust particles in light beams",
  "first_frame": "building-interior.png"
}'

Duration Guidelines

DurationQualityUse For
2-3 secondsHighest qualityGIFs, looping backgrounds, cinemagraphs
4-5 secondsHigh qualitySocial media posts, product reveals
6-8 secondsGood qualityShort clips, transitions
10+ secondsQuality degradesAvoid unless stitching shorter clips

Extending Duration

For longer videos, generate multiple short clips and stitch:

# Generate 3 clips from the same image with progressive motion
belt app run alibaba/wan-2-7-i2v --input '{
  "prompt": "slow pan left, gentle water motion",
  "first_frame": "scene.png"
}' --no-wait

belt app run alibaba/wan-2-7-i2v --input '{
  "prompt": "continuing pan, clouds shifting, light changing",
  "first_frame": "scene.png"
}' --no-wait

# Stitch together
belt app run infsh/media-merger --input '{
  "media_files": [
    {"file": "clip1.mp4", "transition_type": "crossfade"},
    {"file": "clip2.mp4"}
  ]
}'

The Full Workflow

Still-to-Final-Video Pipeline

# 1. Generate source image (best quality)
belt app run bytedance/seedream-5-5 --input '{
  "prompt": "cinematic landscape, misty mountains at dawn, lake in foreground, dramatic clouds, golden hour, 4K quality, professional photography",
  "size": "2K"
}'

# 2. Animate the image
belt app run alibaba/wan-2-7-i2v --input '{
  "prompt": "gentle mist rolling through the valley, lake surface rippling, clouds slowly moving, birds in distance, warm light shifting",
  "first_frame": "landscape.png"
}'

# 3. Upscale video if needed
belt app run falai/topaz-video-upscaler --input '{
  "video": "animated-landscape.mp4"
}'

# 4. Add ambient audio
belt app run infsh/mmaudio --input '{
  "video_input": "animated-landscape.mp4",
  "prompt": "gentle nature ambience, distant birds, soft wind, water lapping"
}'

# 5. Merge video with audio
belt app run infsh/video-audio-merger --input '{
  "video_file": "upscaled-landscape.mp4",
  "audio_file": "ambient-audio.flac"
}'

Cinemagraph Effect

A cinemagraph is a still photo where only one element moves (e.g., waterfall moving in an otherwise frozen scene). To achieve this:

  1. Generate the still image with the motion element clearly defined
  2. Prompt for motion only in that specific element
  3. Keep to 2-4 seconds for seamless looping
belt app run alibaba/wan-2-7-i2v --input '{
  "prompt": "only the waterfall is moving, everything else remains perfectly still, water cascading smoothly, rest of scene frozen",
  "first_frame": "waterfall-scene.png"
}'

Common Mistakes

MistakeProblemFix
Too much motion requestedDistortion, artifacts, warpingSubtle > dramatic, always
Wrong model for content typePoor resultsUse selection guide above
Clips too long (10s+)Quality degrades significantlyKeep to 3-5 seconds, stitch if needed
No camera movement specifiedRandom/unpredictable motionAlways specify camera behavior
Conflicting motion directionsChaotic, unnaturalOne primary motion direction
Low-res source imageLow-res video outputStart with highest quality source
Complex action scenesModels can't handleKeep motion simple and natural

Related Skills

npx skills add inference-sh/skills@ai-video-generation
npx skills add inference-sh/skills@ai-image-generation
npx skills add inference-sh/skills@p-video
npx skills add inference-sh/skills@video-prompting-guide
npx skills add inference-sh/skills@prompt-engineering

Browse all apps: belt app list

來自 halt-catch-fire 的更多技能

agent-browser
halt-catch-fire
透過 inference.sh 為 AI 代理提供瀏覽器自動化功能。可導覽網頁、使用 @e 參考與元素互動、擷取螢幕截圖、錄製影片。功能包括:網頁抓取、表單填寫、點擊、打字、拖放、檔案上傳、執行 JavaScript。適用於:網頁自動化、資料擷取、測試、代理瀏覽、研究。觸發詞:瀏覽器、網頁自動化、抓取、導覽、點擊、填寫表單、螢幕截圖、瀏覽網頁、playwright、無頭瀏覽器、網頁代理、上網、錄製影片
browser-automationweb-scrapingtesting
agent-tools
halt-catch-fire
透過 inference.sh CLI 執行 250 多個 AI 應用程式,包括圖片生成、影片創作、大型語言模型、搜尋、3D、Twitter 自動化。模型:FLUX、Veo、Gemini、Grok、Claude、Seedance、OmniHuman、Tavily、Exa、OpenRouter 等。適用於執行 AI 應用程式、生成圖片/影片、呼叫大型語言模型、網路搜尋或自動化 Twitter。觸發詞:inference.sh、infsh、ai model、run ai、serverless ai、ai api、flux、veo、claude api、image generation、video generation、openrouter、tavily、exa search、twitter api、grok
developmentapicreative
ai-avatar-video
halt-catch-fire
透過 inference.sh CLI 建立 AI 虛擬角色與說話頭像影片。推薦:P-Video-Avatar(最快、最便宜、內建 TTS)。另可選:OmniHuman、Fabric、PixVerse。音訊:Inworld TTS-2(支援 100 多種語言、角色情感引導)、ElevenLabs、Kokoro。功能:音訊驅動虛擬角色、文字轉虛擬角色、唇形同步影片、說話頭像生成、虛擬主持人、UGC 內容。適用於:AI 主持人、解說影片、虛擬網紅、配音、行銷影片、UGC 廣告、遊戲虛擬角色等。
videocreativemedia
ai-image-generation
halt-catch-fire
透過 inference.sh CLI 使用 GPT-Image-2、FLUX、Gemini、Grok、Seedream、Reve 及 50 多種模型生成 AI 圖像。模型包括:GPT-Image-2、FLUX Dev LoRA、FLUX.2 Klein LoRA、Gemini 3 Pro Image、Grok Imagine、Seedream 4.5、Reve、ImagineArt。功能:文字轉圖像、圖像轉圖像、修補、LoRA、圖像編輯、放大、文字渲染。適用於:AI 藝術、產品模型、概念藝術、社交媒體圖形、行銷視覺、插圖。觸發詞:flux、圖像生成、AI 圖像、文字轉...
creativemediaimage
ai-video-generation
halt-catch-fire
We need to translate the given text from English to Traditional Chinese. The instruction says to preserve product names, protocol names, URLs, numbers, and technical terms. So names like Google Veo, Seedance 2.0, HappyHorse, Wan, Grok, inference.sh CLI, Veo 3.1, etc. should remain as is. Also preserve terms like text-to-video, image-to-video, etc. but translate the surrounding Chinese text. The text inside <text> is a description of an agent skill. We need to output only the translated text, no extra labels. Let's translate paragraph by paragraph: "Generate AI videos with Google Veo, Seedance 2.0, HappyHorse, Wan, Grok and 40+ models via inference.sh CLI." -> "通過 inference.sh CLI 使用 Google Veo、Seedance 2.0、HappyHorse、Wan、Grok 及 40 多個模型生成 AI 影片。" "Models: Veo 3.1, Veo 3,
creativevideomedia
app-store-screenshots
halt-catch-fire
依據精確的平台規格製作App Store與Google Play截圖,涵蓋iOS/Android尺寸、圖庫排序、裝置模擬機及預覽影片。適用於:App Store優化、ASO、應用程式截圖、應用程式預覽、Play Store上架。觸發詞:App Store截圖、ASO、App Store優化、Play Store截圖、應用程式預覽、應用程式上架、iOS截圖、Android截圖、App Store圖片、應用程式模擬機、裝置模擬機、應用程式圖庫、商店上架
designmarketingcreative
character-design-sheet
halt-catch-fire
透過參考圖與LoRA技術,確保AI生成角色圖像的一致性。涵蓋轉面視圖、表情圖譜、色票與風格一致性技巧。適用於:角色設計、遊戲美術、插畫、動畫、漫畫、視覺小說。觸發詞:角色設計、角色圖譜、角色一致性、角色參考、轉面圖、表情圖譜、角色美術、一致角色、角色概念、參考圖、角色創作、原創角色設計...
creativedesignmedia
competitor-teardown
halt-catch-fire
結構化競爭分析,包含功能矩陣、SWOT、定位圖與UX審查。涵蓋研究框架、定價比較、評論挖掘與視覺化交付成果。適用於:市場研究、競爭情報、投資人簡報、產品策略、銷售賦能。觸發詞:競爭者分析、競爭分析、競爭者拆解、市場研究、競爭情報、SWOT分析、競爭者比較、市場格局、競爭者審查、競爭...
researchdata-analysismarketing