Description: An open-source audio-driven portrait animation project by Tencent, suitable for long video generation. It performs well in lip synchronization, expressions, and head movements.
Description: An open-source AI digital human tool that can generate animated-style dynamic videos based on user-uploaded photos and corresponding audio files.
Description: An end-to-end multimodal conditional human video generation framework launched by ByteDance. It can generate human videos based on a single human image and motion signals but is not open source.
Description: An audio-driven visual dubbing framework by ByteDance, creating lip-sync videos with dubbing while preserving personal speaking style and facial details. Not open source.
Description: An audio-driven interactive head generation tool launched by ByteDance, enabling real-time voice communication between two digital humans. Not open source.
Description: The third version of Hallo, open-sourced by Baidu, generates videos of characters speaking the corresponding voice when inputting audio and character images, including lip sync, expressions, and head movements.