跳到正文
ElevenLabs Blog· Renee Zhang·· 11 小时前AI 评分58

ElevenLabs 在 ElevenCreative 推出 Instant Soundtracks,可为视频生成配乐与同步音效

Introducing Instant Soundtracks

AI 导读

ElevenLabs 在 ElevenCreative 上线 Instant Soundtracks,上传视频后模型会生成原创配乐,并分析画面中的音效触发点、按时间戳生成音效并自动放到时间线上。

正文

Generate a soundtrack and synchronized sound effects for any video you upload in ElevenCreative.

Add music and sound effects to any video in ElevenCreative

Elevate any video you upload to ElevenCreative by generating sound effects alongside a soundtrack with Instant Soundtracks. The new update to ElevenCreative, launched today, allows you to upload a video, and the model scores it with original music, then analyzes the footage for sound effect cues, and generates sound effects  aligned to those timestamps.

These generated effects are automatically placed on the timeline to match the video. The model watches the video for moments that call for an effect and places each one at the right timestamp, for example, a whoosh timed to the logo at the end of an ad.

Today’s update also brings better timing for short-form content, as well as more accurate mood switching across scenes. You can now also use your video's existing audio as a reference for the new score. The model can analyze the audio — its genre, crescendos, beats per minute, or instrumentation, for example — and use it to shape the new score. The result is music that matches the character of the original, rather than starting entirely from scratch.

Keep refining in the editor

In the ElevenCreative Music Video Editor, sound effects appear as separate layers, so you can review and adjust them independently of the soundtrack. You can also add in more effects, adjust timing, swap out the music, or refine individual moments without having to start over. When you’re happy with your creation, you can export directly from ElevenCreative.

Better short-form timing, more control

Instant Soundtracks is designed for the pace of short-form video, with tighter timing around cuts, transitions, and on-screen actions. It can also shift the music’s mood across scenes. For example, if the vibe shifts from a fast-paced scene, the backing track might be EDM or R&B, but then moves to acoustic guitar for a slower, more intimate scene.

Available today in ElevenCreative, ElevenMusic and the API

Instant Soundtracks is available immediately today. Here’s how to access it:

  • The Music Video Editor in ElevenCreative’s music tab, with sound effects as a separate layer and audio-as-reference controls.
  • Creative Engine,to  adding music and sound effects to ads.
  • The ElevenMusic platform  
  • The ElevenCreative Studio API, using the new parameters: add_sfx, separate_tracks, and use_audio_as_reference.

With separate_tracks=true, the API returns a .ZIP file with the music and SFX as separate files, so you can mix them downstream in your own pipeline or in Studio.

Supports up to 10 videos per request, combined up to 200 MB and 10 minutes of video.

Get started adding music and sound effects to your next video today.

来源:ElevenLabs Blog · elevenlabs.io