DiffSynth Studio v1.2

Now we release more features based on AnimateDiff and FastBlend!

Example 5: Text to Video

Given a prompt, DiffSynth Studio can generate a video using a Stable Diffusion model and an AnimateDiff model. We can break the limitation of number of frames! See examples/sd_text_to_video.py.

lightning.mp4

Example 6: Video Stylization

We provide an example for video stylization. In this pipeline, the rendered video is completely different from the original video, thus we need a powerful deflickering algorithm. We use FastBlend to implement the deflickering module. Please see examples/sd_video_rerender.py for more details.

winter_stone.mp4