Vibe Coding DiscoverYuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
YuE2 is a music generation stack: lyrics plus a style prompt become an editable symbolic score (ABC), then a full 48kHz stereo song via an AR-NAR mixture-of-transformers and flow-matching VAE. Ships Python API, CLI, and a yue2-music agent skill for covers and agentic score editing.
Use Cases
Generate full songs from lyrics and a style promptZero-shot cover generation from a transcribed recordingAgentic music editing via conversation about score and arrangementInspect and hand-edit editable melody/chord plans in ABC notationAudio-to-score transcription for coversMusic understanding and benchmarking (MERT2, WildSongBench)Score-conditioned generation with custom ABC scoresBuild agent skills that compose, cover and compare songs
Built With
- Language
- Python
- Frameworks
- PyTorch · Transformers · Hugging Face Hub · Accelerate · vLLM · Triton · safetensors · soundfile · tiktoken · NumPy
Tags
music-generation · audio-generation · text-to-music · symbolic-music · abc-notation · music-editing · zero-shot-covers · style-transfer · agents · agent-skill · inference · llm · transformer · flow-matching · vae · pytorch