FizzleDorf的 Deforum指南

FizzleDorf的 Deforum指南 FizzleDorf的 Deforum指南 Modified September 11, 2025 a handy expression for mimicking the behavior of the iter seed mode is "desired seed" + t Notice the bloom effect when the seed stays constant after frame 12. Step and Sampler Schedules Parameter Description Keyframe Example Step Schedule Change the amount of steps to diffuse the image over keyframes. Good on it's own, really handy for sampler scheduling. Sampler Scheduling Controls which sampler to use at a specific scheduled frames. Syntax requires quotes ("") around the sampler name. 0: ("Euler a"), 25:("DPM++ 2S a Karras") Parameter Parameter Description Description Keyframe Example Keyframe Example Step Schedule Step Schedule Change the amount of steps to diffuse the image over keyframes. Good on it's own, really handy for sampler scheduling. Change the amount of steps to diffuse the image over keyframes. Good on it's own, really handy for sampler scheduling. Sampler Scheduling Sampler Scheduling Controls which sampler to use at a specific scheduled frames. Syntax requires quotes ("") around the sampler name. Controls which sampler to use at a specific scheduled frames. Syntax requires quotes ("") around the sampler name. 0: ("Euler a"), 25:("DPM++ 2S a Karras") 0: ("Euler a"), 25:("DPM++ 2S a Karras") Checkpoint and Clip Skip Schedules Parameter Description Keyframe Example Checkpoint Scheduling Controls which checkpoint to use at the scheduled frames. Syntax requires quotes ("") around the checkpoint name. make sure you specify .ckpt or .safetensors as well! 0: ("model1.ckpt"), 100: ("model2.ckpt") Clip Skip Schedule Mainly for scheduling in conjunction with Checkpoint Scheduling to switch between NAI based models (Clip Skip 2) and SD 1.x and 2.x (Clip skip 1) based models. Parameter Parameter Description Description Keyframe Example Keyframe Example Checkpoint Scheduling Checkpoint Scheduling Controls which checkpoint to use at the scheduled frames. Syntax requires quotes ("") around the checkpoint name. make sure you specify .ckpt or .safetensors as well! Controls which checkpoint to use at the scheduled frames. Syntax requires quotes ("") around the checkpoint name. make sure you specify .ckpt or .safetensors as well! 0: ("model1.ckpt"), 100: ("model2.ckpt") 0: ("model1.ckpt"), 100: ("model2.ckpt") Clip Skip Schedule Clip Skip Schedule Mainly for scheduling in conjunction with Checkpoint Scheduling to switch between NAI based models (Clip Skip 2) and SD 1.x and 2.x (Clip skip 1) based models. Mainly for scheduling in conjunction with Checkpoint Scheduling to switch between NAI based models (Clip Skip 2) and SD 1.x and 2.x (Clip skip 1) based models. Noise Settings You can select and edit the behavior of perilin noise using the settings here. Parameter Description Example Noise type select which type of noise you would like to use. Settings below can only be used by perlin noise (reccomended). Noise Schedule The amount of graininess that is added to the image for more diffusion diversity. Noise Schedule Comparison Example Perlin Octaves The number of perlin noise octaves. Higher values are smooth and smoke like while higher values make it more organic and spotty. Perlin Persistance How much noise from each octave is added to each iteration. Higher values are straighter and sharper, lower is rounder and smoother. perlin persistance Comparison Example Noise Schedule Comparison Example perlin persistance Comparison Example Parameter Parameter Description Description Example Example Noise type Noise type select which type of noise you would like to use. Settings below can only be used by perlin noise (reccomended). select which type of noise you would like to use. Settings below can only be used by perlin noise (reccomended). Noise Schedule Noise Schedule The amount of graininess that is added to the image for more diffusion diversity. The amount of graininess that is added to the image for more diffusion diversity. Noise Schedule Comparison Example Noise Schedule Comparison Example Noise Schedule Comparison Example Noise Schedule Comparison Example Perlin Octaves Perlin Octaves The number of perlin noise octaves. Higher values are smooth and smoke like while higher values make it more organic and spotty. The number of perlin noise octaves. Higher values are smooth and smoke like while higher values make it more organic and spotty. Perlin Persistance Perlin Persistance How much noise from each octave is added to each iteration. Higher values are straighter and sharper, lower is rounder and smoother. How much noise from each octave is added to each iteration. Higher values are straighter and sharper, lower is rounder and smoother. perlin persistance Comparison Example perlin persistance Comparison Example perlin persistance Comparison Example perlin persistance Comparison Example Coherence Color Coherence : Contains 3 different CC options: LAB, HSV, RGB as well as the option to turn it off. CC Option Description LAB Perceptual Lightness A B axis color balance (search “cielab”) HSV Hue Saturation & Value color balance. RGB Red Green & Blue color balance. Video Input matches colors through a video sequence. Image matches colors of a single image.. CC Option CC Option Description Description LAB LAB Perceptual Lightness A B axis color balance (search “cielab”) Perceptual Lightness A B axis color balance (search “cielab”) HSV HSV Hue Saturation & Value color balance. Hue Saturation & Value color balance. RGB RGB Red Green & Blue color balance. Red Green & Blue color balance. Video Input Video Input matches colors through a video sequence. matches colors through a video sequence. Image Image matches colors of a single image.. matches colors of a single image.. Parameter Description Example Legacy colormatch applies colormatch before adding noise. You need to have this turned on if you plan on using tile controlnet or undesired artifacts can occur. Optical Flow Cadence Optical flow estimation for your in between (cadence) frames (cadence setting needs to be greater than 1 in order to have an effect) Optical Flow Generation Generates each frame twice in order to capture the optical flow from the previous image to the first generation, then warps the previous image and redoes the generation Contrast Schedule adjusts the overall contrast per frame (default neutral at 1.0) contrast schedule: 0: (1.0), 6: (0.5),12: (2) color force grayscale Converts the output video to grayscale. Parameter Parameter Description Description Example Example Legacy colormatch Legacy colormatch applies colormatch before adding noise. You need to have this turned on if you plan on using tile controlnet or undesired artifacts can occur. applies colormatch before adding noise. You need to have this turned on if you plan on using tile controlnet or undesired artifacts can occur. Optical Flow Cadence Optical Flow Cadence Optical flow estimation for your in between (cadence) frames (cadence setting needs to be greater than 1 in order to have an effect) Optical flow estimation for your in between (cadence) frames (cadence setting needs to be greater than 1 in order to have an effect) Optical Flow Generation Optical Flow Generation Generates each frame twice in order to capture the optical flow from the previous image to the first generation, then warps the previous image and redoes the generation Generates each frame twice in order to capture the optical flow from the previous image to the first generation, then warps the previous image and redoes the generation Contrast Schedule Contrast Schedule adjusts the overall contrast per frame (default neutral at 1.0) adjusts the overall contrast per frame (default neutral at 1.0) contrast schedule: 0: (1.0), 6: (0.5),12: (2) contrast schedule: 0: (1.0), 6: (0.5),12: (2) color force grayscale color force grayscale Converts the output video to grayscale. Converts the output video to grayscale. Anti Blur Deforum also had controlnet implementation which is really handy for rotoscoping videos. A lot of the controls are the same save for the video and video mask inputs. You will notice a lot of flickering in the raw output. There is ways to mitigate this such as the Ebsynth utility, diffusion cadence (under the Keyframes Tab) or frame interpolation (Deforum has it's own implementation of RIFE. see Outputs section for details ). Video Loopback is also another way to mitigate this (it will take trial and error to get the right settings). Video Loopback To use this implementation, select enable to reveal the parameters. Init image (under the Init tab) also needs to be checked. You can use controlnet in any of the animation modes. I'll be going more in depth with each one in time. Below are parameter explanations that can help get the most out of controlnet in animations. Any other settings not covered can be learned about in This Rentry Guide . This Rentry Guide Parameter Description Weight Schedule The amount of the controlnet influence. Similar to token weights. The more you add, the more closely the result will adhere to the controlnet guidance. This is useful for blending poses from the reference and model with the value depending on your model and/or LoRA. Start/End Control Step schedule The percentage of total steps the controlnet applies. Similar to prompt editing/shifting. Like the above, it is useful for blending poses from the reference to what the model knows. Unlike the above, it's value determines when the controlnet effect begins at a given step. ControlNet Input Video/ Image Path input for controlnet videos or image. If the video or image is already preprocessed, make sure the preprocessor is set to none. video mask input same as above but for masks. ControlNet Mask Video/ Image Path Same as above but for masks NOT WORKING, kept in UI for CN's devs testing! Control Mode Resize Mode The different options for cropping and resizing the controlnet reference to the resolution of your output. Loopback Mode when active, the reference will always be the previous generated frame. Very handy! Parameter Parameter Description Description Weight Schedule Weight Schedule The amount of the controlnet influence. Similar to token weights. The more you add, the more closely the result will adhere to the controlnet guidance. This is useful for blending poses from the reference and model with the value depending on your model and/or LoRA. The amount of the controlnet influence. Similar to token weights. The more you add, the more closely the result will adhere to the controlnet guidance. This is useful for blending poses from the reference and model with the value depending on your model and/or LoRA. Start/End Control Step schedule Start/End Control Step schedule The percentage of total steps the controlnet applies. Similar to prompt editing/shifting. Like the above, it is useful for blending poses from the reference to what the model knows. Unlike the above, it's value determines when the controlnet effect begins at a given step. The percentage of total steps the controlnet applies. Similar to prompt editing/shifting. Like the above, it is useful for blending poses from the reference to what the model knows. Unlike the above, it's value determines when the controlnet effect begins at a given step. ControlNet Input Video/ Image Path ControlNet Input Video/ Image Path input for controlnet videos or image. If the video or image is already preprocessed, make sure the preprocessor is set to none. input for controlnet videos or image. If the video or image is already preprocessed, make sure the preprocessor is set to none. video mask input video mask input same as above but for masks. same as above but for masks. ControlNet Mask Video/ Image Path ControlNet Mask Video/ Image Path Same as above but for masks NOT WORKING, kept in UI for CN's devs testing! Same as above but for masks NOT WORKING, kept in UI for CN's devs testing! Control Mode Control Mode Resize Mode Resize Mode The different options for croppin