Wan2.1

Wan2.1: Alibaba Cloud's Newly Released Open-Source Video Generation Model

Wan2.1 is Alibaba Cloud’s latest open-source video generation model, offering significant performance advantages. It can run on personal computers and supports various video generation tasks.

Model Versions

• Wan2.1-I2V-14B: Specializes in image-to-video (I2V) generation, supporting 720P output resolution.
• Wan2.1-T2V-14B: A text-to-video (T2V) model capable of generating high-quality videos, suitable for users with demanding generation requirements.
• Wan2.1-T2V-1.3B: A lighter text-to-video model, optimized for resource-limited environments. It can run on consumer-grade GPUs with 8.2GB VRAM, producing 480P videos.

Key Features

1. High Performance

   • Wan2.1 achieves an outstanding VBench score of 86.22%, surpassing many renowned video generation models such as Sora and Minimax.
   • This performance is driven by advanced technologies, including a Video Diffusion Transformer architecture and an efficient 3D causal Variational Autoencoder (VAE) module.

2. Versatile Video Generation Capabilities

   • Supports multiple generation tasks, including:
     • Text-to-video (T2V)
     • Image-to-video (I2V)
     • Video editing
     • Text-to-image
     • Video-to-audio generation
   • This flexibility allows it to cater to a wide range of user needs.

3. Resolution and Efficiency

   • Supports 480P and 720P output resolutions.
   • The T2V-1.3B model can run on consumer GPUs and generates a 5-second 480P video in approximately four minutes, significantly lowering hardware requirements.

4. Multi-Language Support

   • Wan2.1 is the first video generation model capable of producing videos with Chinese and English text, enhancing its usability in multilingual environments.

5. Innovative Data Processing & Training Strategies

   • Implements a six-stage progressive training process, transitioning from low-resolution image pretraining to high-resolution video training, ensuring exceptional performance across various resolutions and complex scenarios.
   • Employs a four-step data filtering process to maintain high-quality and diverse training data.

Application Scenarios

1. Film & Video Production

   • Wan2.1 enables fast generation of complex scenes and special effects, making it ideal for genres like science fiction and war films, significantly reducing production costs and time.

2. Advertising & Marketing

   • The model can generate creative ad content tailored to brand identities, helping businesses enhance marketing effectiveness.

3. Personal Content Creation

   • Individual creators can use Wan2.1 for short video production, artistic animation, and image-to-video transformations, catering to personal creative needs.

4. Professional Media Production

   • In professional fields, Wan2.1 can be applied to film special effects, advertising design, and educational resource development, enhancing visual quality and engagement.

5. Education & Training

   • Wan2.1 can generate educational videos and training materials, helping institutions create engaging teaching resources and improving learning experiences.

6. Multimedia Content Generation

   • Supports text-to-video, image-to-video, video editing, text-to-image, and video-to-audio generation, making it suitable for a wide range of multimedia content creation and editing tasks.

Open-Source Release

Alibaba officially open-sourced the Wan2.1 video generation model on February 25, 2025, under the Apache 2.0 license.
All inference code and model weights have been publicly released, and developers can download and experiment with the model on GitHub, Hugging Face, and other platforms.