Open Source AI Music

ACE-Step 1.5: The Open-Source AI Music Model

ACE-Step is ByteDance's open-source foundation model for music generation β€” combining diffusion transformers with a conditional flow matching approach. Here's everything you need to know.

Last updated: February 2026

What Is ACE-Step?

ACE-Step is an open-source text-to-music model released by ByteDance in 2025. Version 1.5 introduced significant improvements in vocal clarity, rhythmic consistency, and multi-instrument coherence. The model uses a diffusion transformer architecture conditioned on text descriptions, supporting generation up to 4 minutes.

  • Apache 2.0 licensed β€” free for commercial use
  • Runs locally on NVIDIA GPUs with 8GB+ VRAM
  • Supports lyrics-to-song generation
  • LoRA fine-tuning for custom styles

How ACE-Step Works

ACE-Step uses a Latent Diffusion Model (LDM) operating in the STFT (Short-Time Fourier Transform) domain. Unlike waveform-based models, this approach enables high-quality audio synthesis at reduced computational cost. The architecture combines a music VAE encoder-decoder with a conditional flow matching diffusion transformer.

βœ“ Strengths

  • Free and open source (Apache 2.0)
  • Strong lyrics integration and vocal quality
  • Supports long-form generation (up to 4 min)
  • Active community and LoRA ecosystem
  • No usage restrictions or watermarking

⚠ Limitations

  • β€”Requires NVIDIA GPU with 8GB+ VRAM
  • β€”Complex local setup and dependency management
  • β€”Slower generation than cloud APIs (2-5 min on RTX 3090)
  • β€”No real-time collaboration features
  • β€”Limited support for exotic instruments

FM9 vs Local ACE-Step

FM9 gives you cloud-powered music generation β€” no GPU required, no setup, no waiting for dependencies to install. While ACE-Step is remarkable for researchers and power users who want full control, FM9 delivers instant results for creators who want to focus on the music, not the infrastructure.

FAQ

Try FM9 Free β€” No Setup Required

Generate professional AI music in your browser. 50 free credits on signup.

Start Creating Free