AnimateDiff Lightning AnimateDiff Lightning is a lightning fast text to video generation model. It can generate videos more than ten times faster than the original AnimateDiff. For more information, please refer to our research paper: AnimateDiff Lightning: Cross Model Diffusion Distillation. We release the model as part of the research. Our models are distilled from AnimateDiff SD1.5 v2. This repository contains checkpoints for 1 step, 2 step, 4 step, and 8 step distilled models. The generation quality of our 2 step, 4 step, and 8 step model is great. Our 1 step model is only provided for research purposes. Demo Try AnimateDiff Lightning using our text to video generation demo. Recommendation AnimateDiff Lightning produces the best results when used with stylized base models. We recommend using the following base models: Realistic epiCRealism Realistic Vision DreamShaper AbsoluteReality MajicMix Realistic Anime & Cartoon ToonYou IMP Mistoon Anime DynaVision RCNZ Cartoon 3d MajicMix Reverie Additionally, feel free to explore different settings. We find using 3 inference steps on the 2 step model produces great results. We find certain base models produces better results with CFG. W…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy