DC-VideoGen: Efficient Video Generation with Deep Compression Video Autoencoder

Junyu Chen*, Wenkun He*, Yuchao Gu*, Yuyang Zhao, Jincheng Yu, Junsong Chen, Dongyun Zou, Yujun Lin, Zhekai Zhang, Muyang Li, Haocheng Xi, Ligeng Zhu, Enze Xie, Song Han, Han Cai
NVIDIA
(* indicates equal contribution)

News

Awards

No items found.

Competition Awards

No items found.

Abstract

We introduce DC-VideoGen, a post-training acceleration framework for efficient video generation. DC-VideoGen can be applied to any pre-trained video diffusion model, improving efficiency by adapting it to a deep compression latent space with lightweight fine-tuning. The framework builds on two key innovations: (i) a Deep Compression Video Autoencoder with a novel chunk-causal temporal design that achieves 32x/64x spatial and 4x temporal compression while preserving reconstruction quality and generalization to longer videos; and (ii) AE-Adapt-V, a robust adaptation strategy that enables rapid and stable transfer of pre-trained models into the new latent space. Adapting the pre-trained Wan-2.1-14B model with DC-VideoGen requires only 10 GPU days on the NVIDIA H100 GPU. The accelerated models achieve up to 14.8x lower inference latency than their base counterparts without compromising quality, and further enable 2160x3840 video generation on a single GPU.

High Resolution Videos Generated by Our DC-VideoGen-Wan

DC-VideoGen can generate high-quality videos on a single NVIDIA H100 GPU with resolutions ranging from 480px, 720px, 1080px, and 2160px. On 2160x3840 resolution, DC-VideoGen delivers 14.8x acceleration compared to the Wan-2.1-T2V-1.3B model.

A corgi perched on a branch,
tensed and ready to leap to the ground.

An astronaut and a knight
embrace in a desolate landscape.

An astronaut rides a horse
across the moon towards Earth.

I2V 720P

A cinematic video of the text 'DC-VideoGen' formed by clouds.

A poised blonde woman gracefully sips tea from a delicate cup.

I2V 1080P

A time-lapse video captures a flower's delicate and detailed bloom.

T2V 2160P

Video Autoencoder Reconstruction Visualization

Under deep compression settings, causal video autoencoders suffer from low reconstruction quality. In contrast, non-causal video autoencoders achieve better reconstruction quality but generalize poorly to longer videos.

Input
Shape: 80x256x256

LTX Video VAE (Causal)
Configuration: f32t8c128
Compression Ratio: 192
PSNR: 31.12

Video DC-AE (Non-Causal) w/o tiling
Configuration: f32t4c128
Compression Ratio: 96
PSNR: 31.52

Video DC-AE (Non-Causal) w/ tiling
Configuration: f32t4c128
Compression Ratio: 96
PSNR: 33.65

DC-AE-V (Chunk-Causal)
Configuration: f32t4c32
Compression Ratio: 192
PSNR: 32.72

Image-to-Video (I2V) Visualization

Wan2.1-I2V-14B
(27.88 mins/video)

DC-VideoGen-Wan2.1-I2V-14B
(3.67 mins/video)

Wan2.1-I2V-14B
(27.88 mins/video)

DC-VideoGen-Wan2.1-I2V-14B
(3.67 mins/video)

Prompt: A battle-scarred robot walks through a desolate city ruin.

Prompt: A trail runner sprints through a sun-dappled forest, face set with determination.

Prompt: An eaglet soars high above a vast, vibrant forest canopy.

Prompt: A rugged off-road vehicle speeds through a sunlit forest track.

Text-to-Video (T2V) Visualization

Wan2.1-T2V-14B
(27.52 mins/video)

DC-VideoGen-Wan2.1-T2V-14B
(3.58 mins/video)

Wan2.1-T2V-14B
(27.52 mins/video)

DC-VideoGen-Wan2.1-T2V-14B
(3.58 mins/video)

Prompt: A girl on a ship's deck, clutching a letter, looks back with sad determination.

Prompt: Minecraft with the most gorgeous high res 8k texture pack ever.

Prompt: Three video game characters team up in a vibrant arcade.

Prompt: A man is skiing down thick layers of clouds. Towering mountain peaks are faintly visible.

Video

Citation

@article{chen2025dc,  

title={DC-VideoGen: Efficient Video Generation with Deep Compression Video Autoencoder},  

author={Chen, Junyu and He, Wenkun and Gu, Yuchao and Zhao, Yuyang and Yu, Jincheng and Chen, Junsong and Zou, Dongyun and Lin, Yujun and Zhang, Zhekai and Li, Muyang and others},  

journal={arXiv preprint arXiv:2509.25182},  

year={2025}

}

Media

No media articles found.

Acknowledgment

Team Members