9 Commits

Author SHA1 Message Date
u
16fc48a6c4 image T_num_channels 2024-09-03 19:51:01 +08:00
u
e30984ea4b first adds noise to the input image and keep the added noise for latter rectification. 2024-09-03 16:58:52 +08:00
u
78094bc8ec feat: Implemented image-to-video latents using noise interpolation technique
- Applied the noise interpolation method from the paper "Improving Image Fidelity in Image-to-Video Generation using Noise Interpolation" (https://arxiv.org/pdf/2403.02827.pdf) to achieve high source image fidelity in I2V generation.
- Integrated the technique into our pipeline to enhance source image information during early denoising steps, leading to improved video output quality.
- Referenced and adapted the approach from the implementation available at https://noise-rectification.github.io/.
2024-08-31 23:10:29 +08:00
u
f942ecae69 images to video latents
# Check if the number of frames needed matches the current frames
2024-08-30 16:24:04 +08:00
u
1dc10dcb16 denoise_strength (float, *optional*, defaults to 1.0): This parameter ranges from 0.1 to 1.0 and
controls the fidelity and diversity of the generated images. denoise_strength is typically used
            in models like diffusion models or similar generative models. It influences the balance between preserving image
            details and achieving diversity during the generation process. A higher denoise strength means the image will
            be closer to real images from the training data, while a lower denoise strength may retain more noise,
            leading to more abstract or creative results
2024-08-30 14:53:59 +08:00
u
4a4ac59d62 3dvae tiled_encode and tiled_decode 2024-08-30 11:03:26 +08:00
u
c4bc81d120 del get_timesteps func 2024-08-29 21:07:51 +08:00
u
40c8dc4899 - Added CogVideoSchedulerLoader and CogVideoSampler to NODE_CLASS_MAPPINGS.
- Updated node class mappings to reflect new node structure.
- Refactored nodes to ensure compatibility with ComfyUI standards, including:
  - `CogVideoModelLoader`
  - `CogVideoPipeExtra`
  - `CogVideoEncodePrompt`
  - `CogVideoImageEncodeSampler`
  - `CogVideoSamplerDecodeImages`
  - `CogVideoProcessor`
2024-08-29 20:46:58 +08:00
u
036fa14cac Refactor CogVideoXWrapper to ComfyUI standards
- Redesigned code nodes based on `kijai/ComfyUI-CogVideoXWrapper` to adhere to ComfyUI standards.
- Refactored CogVideoXPipeline operations to align with standard latents processing.
- Updated node class mappings and implemented necessary changes for seamless integration.
2024-08-29 18:13:28 +08:00