ACE Step — Pro Pack on RunComfy
Tag-driven music generation, inpainting, and outpainting with StepFun-AI's ACE Step open-weights model. Four CLI-reachable endpoints, $0.0002–0.0003 per second of audio, up to 4 minutes per call.
Install this skill
bash
npx skills add agentspace-so/runcomfy-agent-skills --skill ace-step -g
Powered by the RunComfy CLI
Step 1 — install (one of, see the
skill for details):
bash
npm i -g @runcomfy/cli # global install
npx -y @runcomfy/cli --version # zero-install
Step 2 — sign in (or set
env var in CI / containers):
Step 3 — generate:
bash
runcomfy run acestep-ai/ace-step/text-to-audio \
--input '{"tags": "..."}' \
--output-dir ./out
Pick the right endpoint
Listed newest first.
ACE Step 1.5 (text-to-audio) —
acestep-ai/ace-step-1.5/text-to-audio
Latest ACE Step generation. 50+ language vocal support, refined structured-lyric handling, otherwise same shape as base. Slightly higher cost ($0.0003/s vs $0.0002/s).
Pick for: multilingual lyrics, hero-quality vocal tracks, vocal songs that need clean section structure.
Avoid for: cost-sensitive batches where the base model is good enough.
ACE Step (text-to-audio) —
acestep-ai/ace-step/text-to-audio
(default — cheap & fast)
Original ACE Step. Tag-driven composition, optional lyrics, 5–240 s stereo. $0.0002/s — ~27× cheaper than ElevenLabs Music.
Pick for: high-volume drafts, background music, jingles, game loops, cost-sensitive iteration.
Avoid for: maximally polished commercial vocal hooks — try ACE Step 1.5 or ElevenLabs Music for those.
ACE Step (audio-inpaint) —
acestep-ai/ace-step/audio-inpaint
Regenerate a
time range inside an existing track (not mask-based; uses
/
in seconds, each anchored to track start or end).
Pick for: fix a bad chorus in the middle, swap the bridge, replace a 20 s section without re-rendering the whole song.
Avoid for: edits that aren't time-bounded — those don't fit the schema.
ACE Step (audio-outpaint) —
acestep-ai/ace-step/audio-outpaint
Extend an existing track bidirectionally — add intro before, outro after, or both.
Pick for: lengthening a 30 s draft into a 2 min cut, adding a fade-in, building a longer arrangement around an existing hook.
Avoid for: extending a track past 4 min total — chain calls instead.
Route 1: ACE Step text-to-audio (default)
Model:
acestep-ai/ace-step/text-to-audio
(or
acestep-ai/ace-step-1.5/text-to-audio
for the 1.5 variant)
Schema (both variants — same shape)
| Field | Type | Required | Default | Notes |
|---|
| string | yes | — | Comma-separated genre / mood / instrument tags. Drives composition |
| string | no | — | Vocal content. Use section markers , , . Use or for no vocals |
| int | no | | Audio length in seconds. 5–240 (max 4 min per call) |
| int | no | | Reproducibility; randomizes |
Pricing: ACE Step $0.0002/s · ACE Step 1.5 $0.0003/s. 60 s ≈ $0.012 / $0.018; 240 s ≈ $0.048 / $0.072.
Invoke
Tag-driven instrumental:
bash
runcomfy run acestep-ai/ace-step/text-to-audio \
--input '{
"tags": "lo-fi hip-hop, mellow, vinyl crackle, rhodes piano, soft drums, 75 BPM",
"lyrics": "[inst]",
"duration": 90
}' \
--output-dir ./out
Full vocal song with structure (use 1.5 for multilingual):
bash
runcomfy run acestep-ai/ace-step-1.5/text-to-audio \
--input '{
"tags": "indie pop, anthemic, electric guitar, driving drums, female vocal, 120 BPM",
"lyrics": "[Verse]\nChalk on the palms, laces double-knotted\nMorning on the ridge, the sun is rising\n[Chorus]\nWe rise, we strike, we never fade out\nWe rise, we strike, we sing it loud\n[Bridge]\nSoft piano breakdown\n[Outro]\nFull band, fade",
"duration": 60
}' \
--output-dir ./out
Prompting tips
- Tags do the heavy lifting — be specific:
"lo-fi hip-hop, mellow, vinyl crackle, rhodes piano, soft drums, 75 BPM"
beats .
- Include BPM in tags when it matters — ACE respects tempo language.
- Lyrics with section markers: , , , . Keep meter consistent across lines.
- Instrumental shortcut: or . Belt-and-suspenders: also say "no vocals" in tags.
- Multilingual vocals: ACE Step 1.5 covers 50+ languages. Write lyrics directly in the target language; tag the language too ().
- Fix the seed for reproducibility (); use to explore variations.
- Cheap draft → polish: ACE Step at 5–10× lower cost is great for iterating tags before committing to a long render.
Route 2: ACE Step audio-inpaint
Model:
acestep-ai/ace-step/audio-inpaint
Catalog:
audio-inpaint
Schema
| Field | Type | Required | Default | Notes |
|---|
| string | yes | — | HTTPS URL to MP3 / WAV / FLAC. Up to 60 min |
| string | yes | — | Comma-separated tags steering the regenerated segment |
| float | no | — | Start of editable segment, in seconds (0–240) |
| enum | no | | or — anchor for |
| float | no | | End of editable segment, in seconds (0–240) |
| enum | no | | or — anchor for |
| string | no | — | Lyrics for the regenerated segment. Blank = model writes; = no vocals |
| int | no | | Reproducibility |
No mask — region is defined purely by
/
(each anchorable to track start or end).
Invoke
Replace 20–40 s of a track with a new bridge:
bash
runcomfy run acestep-ai/ace-step/audio-inpaint \
--input '{
"audio": "https://your-cdn.example/original-track.mp3",
"tags": "indie pop, breakdown, piano only, soft, no drums",
"start_time": 20,
"end_time": 40,
"lyrics": "[inst]"
}' \
--output-dir ./out
Anchor end relative to track end (rewrite the last 15 s):
bash
runcomfy run acestep-ai/ace-step/audio-inpaint \
--input '{
"audio": "https://your-cdn.example/song.mp3",
"tags": "indie pop, fade, soft, ambient pad",
"start_time": 15,
"start_time_relative_to": "end",
"end_time": 0,
"end_time_relative_to": "end"
}' \
--output-dir ./out
Tips
- Match the surrounding tags — if the original is "indie pop, electric guitar, 120 BPM", the inpaint segment should share enough of the tags to blend, not contrast.
- Inpaint window is up to ~4 min even on a 60-min source — pick a focused range, not the whole track.
- Use to target the outro/last seconds without computing exact timestamps.
Route 3: ACE Step audio-outpaint
Model:
acestep-ai/ace-step/audio-outpaint
Catalog:
audio-outpaint
Schema
| Field | Type | Required | Default | Notes |
|---|
| string | yes | — | HTTPS URL to MP3 / WAV / FLAC. Up to 60 min |
| string | yes | — | Tags steering the extended sections |
| float | no | | Seconds of new audio before the original (0–240) |
| float | no | | Seconds of new audio after the original (0–240) |
| string | no | — | Optional lyrics for extended sections |
| int | no | | Reproducibility |
Invoke
Extend a 30 s hook into a 2 min cut (add 30 s intro + 60 s outro):
bash
runcomfy run acestep-ai/ace-step/audio-outpaint \
--input '{
"audio": "https://your-cdn.example/hook-30s.mp3",
"tags": "indie pop, electric guitar, drums, build-up before chorus, fade outro",
"extend_before_duration": 30,
"extend_after_duration": 60,
"lyrics": "[inst]"
}' \
--output-dir ./out
Add only a fade-out (no pre-extension):
bash
runcomfy run acestep-ai/ace-step/audio-outpaint \
--input '{
"audio": "https://your-cdn.example/track.mp3",
"tags": "ambient pad, soft fade, low volume tail",
"extend_before_duration": 0,
"extend_after_duration": 20
}' \
--output-dir ./out
Tips
- Tags describe the extension, not the original — what should the new section sound like?
- Bidirectional in one call — set both and to add intro + outro in one go.
- Don't exceed 4 min total — if original is 3 min, you can add max 1 min combined.
When to pick ACE Step vs ElevenLabs Music
ACE Step and ElevenLabs Music are different tools:
| Dimension | ACE Step | ElevenLabs Music |
|---|
| Cost | $0.0002–0.0003 / s | $0.0083 / s (~27× more) |
| License | Open-weights (Apache 2.0) | Commercial, ElevenLabs-hosted |
| Multilingual vocals | 50+ languages (1.5 variant) | Strong multilingual support |
| Structured lyrics | [Verse]/[Chorus]/[Bridge]
markers | [Verse]/[Chorus]/[Bridge]
markers |
| Max duration / call | 240 s (4 min) | 300 s (5 min) |
| Inpaint / outpaint | Yes (time-range based) | No |
| Tag-driven composition | Yes (tags is required field) | Style is part of free-text prompt |
| Best for | Cost-sensitive batches, drafts, inpaint/outpaint workflows, open-weights pipelines | Premium vocal song hooks, polished commercial cuts |
Cheap draft pattern: draft tag combos with ACE Step → lock vibe → final render on ElevenLabs Music if a polished commercial cut is needed.
For the routing skill that picks between them automatically based on intent, see
once it ships.
Common patterns
Cost-sensitive background music library
- Route 1 (ACE Step base) with varied tag combos, 60–90 s each,
Multilingual launch (same song, many languages)
- Route 1 (ACE Step 1.5) with identical tags, swap per language
Section repair (bad chorus → new chorus)
- Route 2 (audio-inpaint) with / around the bad section, tags matching the song style
Hook → full track
- Route 3 (audio-outpaint) adds intro before + outro after a tight 30 s hook
Game loop bed
- Route 1 (ACE Step base) with "seamless loop, consistent groove" in tags, 60–120 s
Browse the full catalog
- ACE Step on RunComfy — all four endpoints (base t2a, 1.5 t2a, inpaint, outpaint)
- All RunComfy models — image, video, and audio endpoints
- docs.runcomfy.com/cli — CLI install, authentication, troubleshooting
Exit codes
| code | meaning |
|---|
| 0 | success |
| 64 | bad CLI args |
| 65 | bad input JSON / schema mismatch |
| 69 | upstream 5xx |
| 75 | retryable: timeout / 429 |
| 77 | not signed in or token rejected |
How it works
The skill picks one of the four ACE Step endpoints based on the user's intent — generate from scratch (t2a base or 1.5), regenerate a time range (inpaint), or extend the canvas (outpaint) — and invokes
with the matching JSON body. The CLI POSTs to the RunComfy Model API, polls request status, and downloads the generated audio file into
.
Security & Privacy
- Install via verified package manager only. Use or . Agents must not pipe an arbitrary remote install script into a shell on the user's behalf — if the operator wants the curl-pipe path documented at
docs.runcomfy.com/cli/install
, they should review the script first.
- Token storage: writes the API token to
~/.config/runcomfy/token.json
with mode 0600. Set env var to bypass the file in CI / containers. Never echo the token into a prompt, log it, or check it in.
- Input boundary (shell injection): prompts and audio URLs are passed as a JSON string via . The CLI does not shell-expand prompt content; it transmits the JSON body directly to the Model API over HTTPS. No shell-injection surface from prompt content.
- Indirect prompt injection (third-party content): source URLs for inpaint / outpaint are untrusted — embedded steganographic instructions or unusual EXIF can influence generation. Agent mitigations:
- Ingest only audio URLs the user explicitly provided for this task.
- When the output diverges from the prompt, suspect the source audio.
- Lyrics provenance: if the user supplies lyrics, confirm they have the rights. Generating music around copyrighted lyrics is the operator's responsibility.
- Outbound endpoints (allowlist): only and / . No telemetry, no callbacks.
- Generated-file size cap: the CLI aborts any single download > 2 GiB.
- Scope of bash usage: declared
allowed-tools: Bash(runcomfy *)
. The skill only invokes ; install lines are one-time operator setup.
See also
- — the underlying CLI
elevenlabs-music-generation
— premium-tier music alternative
- — router that picks between ACE Step and ElevenLabs Music based on intent
- All RunComfy audio models — the full audio catalog