YouTube has introduced a new set of generative AI tools to enhance its Shorts. The company announced this during the ‘Made on YouTube’ live event on Tuesday.
The update includes a faster version of Google’s text-to-video model Veo 3, a remixing tool, and a new “Edit with AI” feature.
Veo 3
The highlight of the update is Veo 3 Fast, a custom model built on Google’s Veo 3 system. It produces 480p video clips at lower latency.
As a result, creators can generate videos more quickly and with sound for the first time.
The rollout begins in the United States, the United Kingdom, Canada, Australia, and New Zealand. However, YouTube plans to expand to more countries in the near future.
Motion Transfer
YouTube is also adding new creative features to Shorts. Creators can now transfer motion from one video to a still image.
For example, a static picture can be animated to perform a dance taken from another clip. In addition, Veo allows creators to apply different artistic styles.
The options include pop art and origami effects. The model can also generate new objects, such as props or background characters, from text prompts.
These features will be available in the coming months.
Dialogue Into Music
Another feature is the Speech to Song remixing tool. It transforms dialogue from eligible videos into soundtracks for Shorts.
The tool relies on Google’s music model Lyria 2. Users can customize the music with moods such as “chill,” “danceable,” or “fun.”
The feature will launch in the United States first, and more regions will follow in the weeks ahead.
Edit With AI
YouTube also introduced Edit with AI, a feature that simplifies video editing. It takes raw camera roll footage and creates a first draft.
The system selects the best moments, adds transitions, and includes music. It can also generate a voice-over that responds to the video content.
The tool currently supports English and Hindi. YouTube is testing it in the Shorts platform and the YouTube Create app. But it will expand to additional markets in the coming weeks.
Also read: Netflix Quietly Rolls Out GenAI in Its Original Shows
