elevenlabs-music-generation

作者: agentspace-so

Generate full songs and instrumental tracks with ElevenLabs Music on RunComfy via the `runcomfy` CLI. ElevenLabs Music turns a style description plus structured lyrics into studio-quality 44.1 kHz stereo audio — 5 seconds to 5 minutes — with section-level control (Intro / Verse / Chorus / Bridge), multilingual vocals, and commercial-friendly output. Generate a backing track, a full vocal song, a jingle, a podcast intro, a game loop, or an instrumental bed. Calls `runcomfy run...

npx skills add https://github.com/agentspace-so/runcomfy-agent-skills --skill elevenlabs-music-generation

ElevenLabs AI Music Generation — Pro Pack on RunComfy

Generate full songs and instrumental tracks from a text description — studio-quality 44.1 kHz stereo, 5 seconds to 5 minutes, with section-level structure control. ElevenLabs Music on the RunComfy Model API, called through the runcomfy CLI.

runcomfy.com · ElevenLabs Music model · CLI docs

Install this skill

npx skills add agentspace-so/runcomfy-agent-skills --skill elevenlabs-music-generation -g

Powered by the RunComfy CLI

# 1. Install (one of — see runcomfy-cli skill for details)
npm i -g @runcomfy/cli                              # global install
npx -y @runcomfy/cli --version                      # zero-install

# 2. Sign in
runcomfy login                                      # or in CI: export RUNCOMFY_TOKEN=<token>

# 3. Generate music
runcomfy run elevenlabs/elevenlabs/music-generation \
  --input '{"prompt": "..."}' \
  --output-dir ./out

CLI deep dive: runcomfy-cli skill.

When to use ElevenLabs Music

ElevenLabs Music's strength is structured songs with real vocals — it takes a style brief plus lyrics with section markers and returns a coherent, mixed track. Pick it for:

  • Full vocal songs — verse/chorus structure, multilingual lyrics, consistent meter
  • Instrumental bedsforce_instrumental: true for background music, podcast intros, game loops
  • Short brand assets — jingles, stingers, theme music (5–30 s)
  • Long-form tracks — up to 5 minutes in a single call
  • Commercial work — output is commercial-friendly

If the user just wants ambient sound or a one-off SFX (thunder, footsteps), that's a sound-effects task, not music — ElevenLabs Music is for songs and tracks.

Endpoint + input schema

Model: elevenlabs/elevenlabs/music-generation

FieldTypeRequiredDefaultNotes
promptstringyesStyle description and lyrics with section markers. See prompting tips
music_length_msintno40000Output duration in ms. 5000–300000 (5 s – 5 min)
force_instrumentalboolnofalsetrue = instrumental only, no vocals
output_formatstringnomp3_standardmp3_standard (default), or WAV — see the model page API tab for the full format list

Output: 44.1 kHz stereo audio. The result JSON contains the generated audio URL — the CLI downloads it into --output-dir.

Pricing: ~$0.0083 per second of generated audio (30 s ≈ $0.25, 60 s ≈ $0.50, 5 min ≈ $2.49). Cost scales with music_length_ms, so draft short and finalize long.

How to invoke

Full vocal song with structure:

runcomfy run elevenlabs/elevenlabs/music-generation \
  --input '{
    "prompt": "Upbeat indie-pop anthem, bright electric guitars, driving drums, 120 BPM, female lead vocal. [Intro 8 bars] instrumental build. [Verse] Chalk on the palms, laces double-knotted, morning on the ridge. [Chorus] We rise, we strike, we never fade out. [Bridge] soft breakdown, just piano and voice. [Outro] full band, fade.",
    "music_length_ms": 60000
  }' \
  --output-dir ./out

Instrumental background bed:

runcomfy run elevenlabs/elevenlabs/music-generation \
  --input '{
    "prompt": "Calm lo-fi hip-hop instrumental for a study playlist. Warm Rhodes piano, soft vinyl crackle, mellow boom-bap drums, 75 BPM. No vocals. Consistent loop-friendly groove throughout.",
    "music_length_ms": 90000,
    "force_instrumental": true
  }' \
  --output-dir ./out

Short brand jingle:

runcomfy run elevenlabs/elevenlabs/music-generation \
  --input '{
    "prompt": "5-second cheerful brand stinger, bright marimba and a single uplifting chord resolve, no vocals.",
    "music_length_ms": 5000,
    "force_instrumental": true
  }' \
  --output-dir ./out

Prompting tips

ElevenLabs Music reads one prompt field that carries both the style brief and the lyrics. Structure it well:

  • Lead with the style brief: genre, mood, tempo (BPM), key instruments, vocal type. "Upbeat indie-pop anthem, bright electric guitars, 120 BPM, female lead vocal."
  • Then the lyrics with section markers: [Intro], [Verse], [Chorus], [Bridge], [Outro]. Add approximate durations or bar counts — [Intro 8 bars], [Verse 16 bars].
  • Keep lyrical meter consistent — even syllable counts per line, clear rhyme scheme. The model follows meter; sloppy meter produces awkward phrasing.
  • Name lead instruments and mix priorities"electric guitar carries the chorus, drums sit back in the verse."
  • For instrumental, set force_instrumental: true AND say "no vocals" in the prompt — belt and suspenders.
  • Multilingual: write the lyrics in the target language; annotate accent/language inline if needed ([Verse] (sung in Brazilian Portuguese) ...).
  • Avoid contradictory style instructions — "aggressive metal" + "soft lullaby" in one prompt confuses the model. One coherent direction per call.
  • Draft short, finalize long: validate the direction with a 30–45 s draft (music_length_ms: 35000) before paying for a 5-minute render.

Common patterns

Theme song for a video

  • Full brief + lyrics + [Intro]/[Verse]/[Chorus] structure, music_length_ms matched to the video length

Podcast intro / outro

  • force_instrumental: true, 10–20 s, "loop-friendly, clean ending"

Game background loop

  • force_instrumental: true, describe "seamless loop", 60–120 s, consistent groove

Multilingual release (same song, multiple languages)

  • One call per language, identical style brief, swap only the lyric lines

Iterate then commit

  • Draft at music_length_ms: 35000 to lock genre/tempo/structure → final render at full length

Limitations

  • One prompt field carries everything (style + lyrics). There is no separate "lyrics" parameter.
  • 5 s – 5 min per call (music_length_ms 5000–300000). For longer pieces, generate sections and stitch externally.
  • Cost scales with duration — a 5-minute render is ~10× a 30-second one.
  • force_instrumental is the only vocal toggle — you can't request specific voice identities or clone a singer through this endpoint.
  • This skill pins ElevenLabs Music specifically. For sound effects, text-to-speech, or voice cloning, that's a different ElevenLabs capability not exposed through this endpoint.

Exit codes

codemeaning
0success
64bad CLI args
65bad input JSON / schema mismatch
69upstream 5xx
75retryable: timeout / 429
77not signed in or token rejected

Full reference: docs.runcomfy.com/cli/troubleshooting.

How it works

The skill invokes runcomfy run elevenlabs/elevenlabs/music-generation with the JSON body. The CLI POSTs to the RunComfy Model API, polls request status, fetches the result, and downloads the generated audio file into --output-dir. Ctrl-C cancels the remote request before exit.

Security & Privacy

  • Install via verified package manager only. Use npm i -g @runcomfy/cli or npx -y @runcomfy/cli. Agents must not pipe an arbitrary remote install script into a shell on the user's behalf — if the operator wants the curl-pipe path documented at docs.runcomfy.com/cli/install, they should review the script first.
  • Token storage: runcomfy login writes the API token to ~/.config/runcomfy/token.json with mode 0600. Set RUNCOMFY_TOKEN env var to bypass the file in CI / containers. Never echo the token into a prompt, log it, or check it in.
  • Input boundary (shell injection): the prompt is passed as a JSON string via --input. The CLI does not shell-expand prompt content; it transmits the JSON body directly to the Model API over HTTPS. No shell-injection surface from prompt content, even with backticks, quotes, or $(...) patterns.
  • Lyrics provenance: if the user supplies lyrics, confirm they have the rights to them. Generating music around copyrighted lyrics is the operator's responsibility — the skill does not check.
  • Outbound endpoints (allowlist): only model-api.runcomfy.net (request submission) and *.runcomfy.net / *.runcomfy.com (download whitelist for generated audio). No telemetry, no callbacks.
  • Generated-file size cap: the CLI aborts any single download > 2 GiB.
  • Scope of bash usage: the skill only invokes runcomfy <subcommand>npm / npx lines are one-time operator setup, not commands the skill executes per call.

See also

来自 agentspace-so 的更多技能

ai-avatar-video
agentspace-so
We need to translate the given English text into Simplified Chinese. The instruction says to preserve product names, protocol names, URLs, numbers, and technical terms. The name "ai-avatar-video" is not in the text, so we don't include it. We must not add any labels or extra commentary. Just translate the text inside <text>. The text describes creating AI avatar videos using runcomfy CLI, mentioning various models: ByteDance OmniHuman, Wan-AI Wan 2-7, HappyHorse 1.0, Seedance v2 Pro. Also mentions user intents like UGC voiceover, virtual presenter, etc. We need to translate accurately, keeping technical terms and names as is. For example, "talking-head" might be translated as "说话头像" or keep as "talking-head"? Probably keep as "talking-head" or translate? The instruction says preserve technical terms, but "talking-head" is a common term. I'll translate it as "说话头像" but maybe keep English? Better to translate common terms
videocreativemedia
ai-music
agentspace-so
Generate AI music on RunComfy via the `runcomfy` CLI — a smart router across the music-model catalog. Routes to ElevenLabs AI Music Generation (premium 44.1 kHz stereo vocal tracks, 5 s–5 min, $0.0083/s) and ACE Step / ACE Step 1.5 (StepFun-AI open-weights, tag-driven composition, multilingual lyrics, $0.0002–0.0003/s, ~27× cheaper), plus ACE Step audio-inpaint (regenerate a time range inside an existing track) and ACE Step audio-outpaint (extend a track before or after). Picks the right...
creativeaudioapi
video-edit
agentspace-so
编辑RunComfy上的现有视频——此技能是一个智能路由器,将用户意图匹配到RunComfy目录中的正确编辑模型。选择Wan 2.7 Edit-Video(通用重风格化/背景替换/包装替换,保留身份+动作)、Kling 2.6 Pro Motion Control(将参考视频的精确动作迁移到目标角色)或Lucy Edit Restyle(轻量级身份稳定重风格化/服装替换)。整合每个模型记录的提示模式,使该技能...
videocreativemedia
relight
agentspace-so
Relight a still image — change the lighting setup, color temperature, direction, or mood — on RunComfy via the `runcomfy` CLI. Routes to Qwen Edit 2509's dedicated `relight` LoRA endpoint for purpose-built relighting, with fallback to identity-preserving edit endpoints (Nano Banana 2 Edit, GPT Image 2 Edit, FLUX Kontext Pro) when prose lighting language is enough. Use for product relighting (studio softbox → window light), portrait mood shift (overcast → golden hour), or color-grade change....
creativeimagemedia
kling-3-0
agentspace-so
RunComfy上的Kling 3.0视频生成。Kling 3.0(也称Kling V3.0)是快手科技第三代多镜头视频模型,具备原生同步音频和跨镜头一致的角色身份。该技能涵盖全部六个Kling 3.0端点,覆盖三种渲染等级(标准、专业、4K)和两种模式(文生视频、图生视频)。通过本地RunComfy CLI调用runcomfy run kling/kling-3.0/ /。触发词为"kling"、"kling 3.0"、"kling v3"、"kling pro"等。
creativevideomedia
runcomfy-cli
agentspace-so
Run any model on RunComfy from the command line. The `runcomfy` CLI is one binary, one auth, hundreds of model endpoints — image generation, image edit, video generation, image-to-video, lip-sync, face swap, video edit, inpainting, outpainting, extend, ControlNet, relight, upscale, LoRA training and more. Submit a request, poll for status, download the output. This skill teaches the agent how to install, authenticate, discover model schemas, invoke models, stream / poll / no-wait, script in...
creativemediaapi
happyhorse-1-0
agentspace-so
在RunComfy上使用HappyHorse 1.0生成文本到视频。介绍HappyHorse 1.0的优势(在Artificial Analysis Video Arena排名第一,原生1080p并同步音频,多镜头角色一致性,支持6种语言提示),时长/宽高比/分辨率方案,以及何时转向Wan
creativevideomedia
ai-image-generation
agentspace-so
Generate and edit images on RunComfy via the `runcomfy` CLI — a smart router across the full image-model catalog: FLUX 2 (Klein 9B/4B, Pro, Dev, Flash, Turbo, Max), Google Nano Banana 2 / Pro, OpenAI GPT Image 2, ByteDance Seedream 5 / 4-5 / 4-0 and Dreamina 4-0, Alibaba Qwen Image and Z-Image Turbo, Wan 2-7. Covers both text-to-image (t2i) and image-to-image / edit (i2i) endpoints — the skill picks the right model for the user's actual intent (typography precision, photoreal portraits,...
creativemediaimage