ai-avatar-video

作成者: whytryharder

inference.sh CLIでAIアバターやトーキングヘッド動画を生成。おすすめ:P-Video-Avatar(最速、最安、TTS内蔵)。ほかにOmniHuman、Fabric、PixVerse。音声:Inworld TTS-2(100以上の言語に対応、キャラクターの感情を調整可能)、ElevenLabs、Kokoro。機能:音声駆動アバター、テキストからアバターを生成、リップシンク動画、トーキングヘッド生成、バーチャルプレゼンター、UGCコンテンツ。用途:AIプレゼンター、解説動画、バーチャルインフルエンサー、吹き替え、マーケティング動画、UGC広告、ゲームアバターなど。

npx skills add https://github.com/whytryharder/superpowers --skill ai-avatar-video

Install the belt CLI skill: npx skills add belt-sh/cli

AI Avatar & Talking Head Videos

Create AI avatars and talking head videos via inference.sh CLI.

AI Avatar & Talking Head Videos

Quick Start

Requires inference.sh CLI (belt). Install instructions

belt login

# Recommended: P-Video-Avatar (fastest, cheapest, built-in TTS)
belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "Hello, welcome to our product demo!",
  "voice": "Zephyr (Female)"
}'

Available Models

Start with P-Video-Avatar — it's 18x faster and 6x cheaper than alternatives, with built-in TTS, dynamic backgrounds, and 1080p support.

ModelApp IDBest ForBuilt-in TTS
P-Video-Avatarpruna/p-video-avatarBest overall: speed, cost, quality, controlYes (30 voices, 10 languages)
OmniHuman 1.5bytedance/omnihuman-1-5Multi-character, audio-drivenNo
Fabric 1.0falai/fabric-1-0Image talks with lipsyncYes
PixVerse Lipsyncfalai/pixverse-lipsyncLipsync an existing videoYes

Cost & Speed Comparison

ModelSpeed (per sec of video)Cost per second
P-Video-Avatar~1.83s/s$0.025
OmniHuman 1.5~28s/s (15x slower)$0.16 (6.4x more)
Fabric 1.0~34s/s (18x slower)$0.14 (5.6x more)

Examples

P-Video-Avatar (Recommended)

Generate avatar from portrait + text script with built-in TTS:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "Welcome to our product walkthrough. Today I will show you three key features.",
  "voice": "Puck (Male)",
  "voice_language": "English (US)",
  "resolution": "720p"
}'

With custom style control:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "voice_script": "This is exciting news!",
  "voice": "Aoede (Female)",
  "voice_prompt": "Enthusiastic and energetic tone",
  "video_prompt": "The person is presenting on stage with dramatic lighting",
  "resolution": "1080p"
}'

With audio file instead of TTS:

belt app run pruna/p-video-avatar --input '{
  "image": "https://portrait.jpg",
  "audio": "https://speech.mp3"
}'

Full Workflow: Generate Portrait + Avatar

Use Pruna P-Image to generate the portrait, then create the avatar:

# 1. Generate a portrait image
belt app run pruna/p-image --input '{
  "prompt": "professional headshot portrait of a young woman, neutral background, looking at camera, studio lighting, photorealistic",
  "aspect_ratio": "9:16"
}'

# 2. Create avatar video with built-in TTS
belt app run pruna/p-video-avatar --input '{
  "image": "<image-url-from-step-1>",
  "voice_script": "Hi there! Let me walk you through our latest features.",
  "voice": "Zephyr (Female)"
}'

OmniHuman 1.5 (Multi-Character)

belt app run bytedance/omnihuman-1-5 --input '{
  "image": "https://portrait.jpg",
  "audio": "https://speech.mp3"
}'

Supports specifying which character to drive in multi-person images.

Fabric 1.0 (Image Talks)

belt app run falai/fabric-1-0 --input '{
  "image": "https://face.jpg",
  "audio": "https://audio.mp3"
}'

PixVerse Lipsync

belt app run falai/pixverse-lipsync --input '{
  "video": "https://talking-head.mp4",
  "audio": "https://speech.mp3"
}'

Takes a video, not a still image. Omit audio and pass text (plus optional voice_id) to use the built-in TTS.

Full Workflow: TTS + Avatar (Non-TTS Models)

For models without built-in TTS (OmniHuman), generate speech first:

# 1. Generate speech — Inworld TTS-2 for expressive character voices
belt app run inworld/text-to-speech-2 --input '{
  "text": "[friendly] Welcome to our product demo! [excited] Let me show you three features that will change how you work.",
  "voice_id": "Sarah",
  "delivery_mode": "CREATIVE"
}' > speech.json

# 2. Create avatar video with the speech
belt app run bytedance/omnihuman-1-5 --input '{
  "image": "https://presenter-photo.jpg",
  "audio": "<audio-url-from-step-1>"
}'

Tip: For most use cases, P-Video-Avatar with built-in TTS is simpler — no separate audio step needed. Use this workflow only when you specifically need OmniHuman (multi-character) or PixVerse (realistic lipsync).

Full Workflow: Dub Video in Another Language

# 1. Transcribe original video
belt app run openai/gpt-transcribe --input '{"audio": "https://video.mp4"}' > transcript.json

# 2. Translate text (manually or with an LLM)

# 3. Generate speech in new language
belt app run falai/kokoro-tts --input '{"prompt": "<translated-text>"}' > new_speech.json

# 4. Lipsync the original video with new audio
belt app run infsh/latentsync-1-6 --input '{
  "video_path": "https://original-video.mp4",
  "audio_path": "<new-audio-url>"
}'

Avatar UGC Generation

Create UGC-style content with P-Video-Avatar — built-in TTS, no separate audio step needed:

# 1. Generate a relatable UGC-style portrait
belt app run pruna/p-image --input '{
  "prompt": "casual selfie-style photo of a young woman in a cozy room, natural lighting, looking at camera, warm smile, authentic feel",
  "aspect_ratio": "9:16"
}'

# 2. Create UGC avatar video with built-in TTS
belt app run pruna/p-video-avatar --input '{
  "image": "<image-url-from-step-1>",
  "voice_script": "Okay so I just tried this product and honestly? It is a game changer. I was not expecting to love it this much but here we are!",
  "voice": "Zephyr (Female)",
  "voice_prompt": "Excited, casual, authentic tone like talking to a friend",
  "video_prompt": "The person is talking casually to camera in their room, natural gestures",
  "resolution": "1080p"
}'

Why P-Video-Avatar for UGC

  • All-in-one — built-in TTS means no separate audio generation step
  • 30 voices, 10 languages — match your target audience
  • Voice + video prompts — control tone, emotion, body language, and background independently
  • 18x faster, 6x cheaper — produce UGC at scale vs. Fabric/OmniHuman/HeyGen
  • 1080p support — platform-ready vertical video from a single portrait image

Batch UGC: Same Product, Multiple Presenters

# Generate 3 different presenters
for voice in "Zephyr (Female)" "Puck (Male)" "Aoede (Female)"; do
  belt app run pruna/p-video-avatar --input "{
    \"image\": \"https://portrait.jpg\",
    \"voice_script\": \"This changed my morning routine completely. Five minutes and I am done.\",
    \"voice\": \"$voice\",
    \"voice_prompt\": \"Casual, authentic, like a real testimonial\",
    \"video_prompt\": \"Person talking to camera in a bright kitchen\",
    \"resolution\": \"1080p\"
  }"
done

Use Cases

  • UGC & Marketing: Product demos, UGC-style ads with AI presenters
  • Education: Course videos, explainers
  • Localization: Dub content across 10 languages from one image
  • Social Media: Consistent virtual influencer content
  • Corporate: Training videos, announcements
  • Gaming: Character avatars, NPC dialogue

Tips

  • Use high-quality portrait photos (front-facing, good lighting)
  • Audio should be clear with minimal background noise
  • P-Video-Avatar supports built-in TTS — no need for a separate speech generation step
  • P-Video-Avatar output aspect ratio matches the input image
  • Generate portraits with pruna/p-image using 9:16 aspect ratio for vertical videos
  • OmniHuman 1.5 supports multiple people in one image
  • LatentSync is best for syncing existing videos to new audio

Related Skills

# Dedicated P-Video-Avatar skill
npx skills add inference-sh/skills@p-video-avatar

# Full platform skill (all apps)
npx skills add inference-sh/skills@infsh-cli

# Text-to-speech (generate audio for non-TTS avatar models)
npx skills add inference-sh/skills@text-to-speech

# Speech-to-text (transcribe for dubbing)
npx skills add inference-sh/skills@speech-to-text

# Video generation
npx skills add inference-sh/skills@ai-video-generation

# Image generation (create avatar images)
npx skills add inference-sh/skills@ai-image-generation

Browse all video apps: belt app list --category video

Documentation

whytryharderのその他のスキル

agent-browser
whytryharder
inference.sh経由でAIエージェント向けのブラウザー自動化を実行。Webページの移動、@e refsを使った要素の操作、スクリーンショットの撮影、動画の録画が可能。機能:Webスクレイピング、フォーム入力、クリック、文字入力、ドラッグ&ドロップ、ファイルのアップロード、JavaScriptの実行。用途:Web自動化、データ抽出、テスト、エージェントによるブラウジング、調査。トリガー:browser、web automation、scrape、navigate、click、fill form、screenshot、browse web、playwright、headless browser、web agent、surf internet、record video
browser-automationweb-scrapingtesting
agent-tools
whytryharder
inference.sh CLIでAIアプリを実行 — 画像生成、動画作成、LLM、検索、3D、Twitter自動化。モデル:FLUX、Veo、Gemini、Grok、Claude、Seedance、OmniHuman、Tavily、Exaなど多数。AIアプリの実行、画像・動画の生成、LLMの呼び出し、ウェブ検索、Twitterの自動化に使用。トリガー:inference.sh、infsh、AIモデル、AI実行、サーバーレスAI、AI API、flux、veo、claude api、画像生成、動画生成、tavily、exa search、twitter api、grok
apiimagevideo
ai-image-generation
whytryharder
inference.sh CLIを使って、GPT-Image-2.6、FLUX、Gemini、Grok、Seedream、Reveなど、50以上のモデルでAI画像を生成。モデル:GPT-Image-2.6 Flare、GPT-Image-2.6 Sunburst、FLUX Dev LoRA、FLUX.2 Klein LoRA、Nano Banana 2.1、Gemini 3 Pro Image、Grok Imagine 2.0、Seedream 5.5、Reve、ImagineArt。機能:テキストから画像生成、画像から画像生成、インペインティング、LoRA、画像編集、アップスケーリング、テキスト描画。用途:AIアート、製品モックアップ、コンセプトアート、ソーシャルメディア用グラフィック、マーケティングビジュアル、イラストなど。
imagecreativemarketing
ai-video-generation
whytryharder
inference.sh CLIを通じて、Google Veo、Seedance 2.5、Kling、HappyHorse、Wan、Grokなど40以上のモデルでAI動画を生成。モデル:Veo 3.1、Seedance 2.5、Kling v4、Runway Gen-4.5、FLUX 3 Video、HappyHorse 1.0、Wan 2.7、Grok Imagine Video 1.5、P-Video 2、OmniHuman、Fabric。機能:テキストから動画、画像から動画、参照素材から動画、動画編集、リップシンク、アバターアニメーション、動画のアップスケーリング、フォーリーサウンド。用途:ソーシャルメディア動画、マーケティングコンテンツ、解説動画、製品デモ、AIアバターなど。
videomediacreative
infsh-cli
whytryharder
inference.sh CLIでAIアプリを実行 — 画像生成、動画作成、LLM、検索、3D、Twitter自動化。モデル:FLUX、Veo、Gemini、Grok、Claude、Seedance、OmniHuman、Tavily、Exaなど多数。AIアプリの実行、画像・動画の生成、LLMの呼び出し、ウェブ検索、Twitterの自動化に使用。トリガー:inference.sh、infsh、AIモデル、AI実行、サーバーレスAI、AI API、flux、veo、claude API、画像生成、動画生成、tavily、exa検索、twitter API、grok
apiimagevideo
python-executor
whytryharder
Execute Python code in a safe sandboxed environment via [inference.sh](https://inference.sh). Pre-installed: NumPy, Pandas, Matplotlib, requests, BeautifulSoup, Selenium, Playwright, MoviePy, Pillow, OpenCV, trimesh, and 100+ more libraries. Use for: data processing, web scraping, image manipulation, video creation, 3D model processing, PDF generation, API calls, automation scripts. Triggers: python, execute code, run script, web scraping, data analysis, image processing, video editing, 3D...
developmentdata-analysisweb-scraping
remotion-render
whytryharder
inference.sh 経由で、React/Remotion コンポーネントコードから動画をレンダリングします。TSX コードを渡すと、MP4 を取得できます。Remotion のすべての API(useCurrentFrame、useVideoConfig、spring、interpolate、AbsoluteFill、Sequence)に対応。解像度、FPS、長さ、コーデックを設定できます。用途:プログラムによる動画生成、アニメーショングラフィックス、モーションデザイン、データ駆動型動画、React アニメーションの動画化。トリガー:remotion、コードから動画をレンダリング、TSX から動画、React 動画、プログラムによる動画生成、remotion render、コードから動画、アニメーション...
videodevelopmentcreative
twitter-automation
whytryharder
inference.sh CLIを使って、投稿、エンゲージメント、ユーザー管理を自動化します。アプリ: x/post-create(テキストとメディア)、x/post-like、x/post-retweet、x/dm-send、x/user-follow。機能: ツイートの投稿、コンテンツの予約、投稿への「いいね」、リツイート、DMの送信、ユーザーのフォロー、プロフィールの取得。用途: ソーシャルメディアの自動化、コンテンツの予約、エンゲージメントボット、オーディエンスの拡大、X API。トリガー: twitter api、x api、tweet automation、post to twitter、twitter bot、social media automation、x automation,...
browser-automationmarketingcommunication