Consistent character in dance video (ComfyUI)

Updated Categorized as Workflow Tagged , , 17 Comments on Consistent character in dance video (ComfyUI)

This workflow stylizes a dance video with a consistent character.

GIF version (reduced quality):

You will learn/get:

  • A downloadable ComfyUI workflow that generates this video.
  • Customization options.
  • Notes on building this workflow. What worked and what didn’t.

Become a member of this site to see this content

Already a member? Log in here.

Avatar

By Andrew

Andrew is an experienced engineer with a specialization in Machine Learning and Artificial Intelligence. He is passionate about programming, art, photography, and education. He has a Ph.D. in engineering.

17 comments

  1. Hello Andrew, I was trying this, however unable to make it work, it says pytorch memory error, I have 8GB VRAM, Nvidia 2080Super, Not sure if it is sufficient enough, but I was able to generate photos and some animations earlier. Do you think, for this specific case, probably my setup is weak and can’t process this. Or am I doing some mistake, which I need to think about. Thanks again !!!

      1. What is ideal VRAM for such things, also I want to understand these steps, like how to know which node to be used where, I have sometimes an intuition but it is good if there is a process flow somewhere, is there any a generic process flow somewhere that you came across, or you have written, if yes, please direct it if its possible.

          1. Thank you for reply. It was a good read about comfyui, not sure how I missed it. Most of the work you presented can be done on 8GB in comfyui. AUTOMATIC1111 seems to have some memory issues, however , I realised that comfyui is more efficient . Now my question to you is this, is 16GB VRAM is sufficient enough, because 24GB is definitely is budget constraint. As per online services, I really think those are not very cheap either. Please let me know. Thanks again !!!

  2. Good day Andrew,
    I tried following your guide and encountered this error below, coming from the animatediff loader node –

    Error occurred when executing ADE_AnimateDiffLoaderWithContext:

    module ‘comfy.ops’ has no attribute ‘Linear’

    1. I can reproduce the error. Comfyui manager does not update animatediff evolve correctly. updating it manually resolves the issue.
      Run the following in command prompt:

      cd ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved
      git pull

  3. I just installed ComfyUI and I’m trying to reproduce your results w/the video. I don’t see a ‘Load Video (Upload) node’. Must I do something extra to get one?

      1. I just attempted to install any missing nodes. The manager to do this itself is missing. Looks like the install failed to include it. I’ve installed it twice now, same results. What should I do?

          1. Okay, I got everything running from looking at the log files. However, queue size says ‘0’. Shouldn’t it say ‘1’? Also, where can I get the completed video?

          2. The workflow should take some time to run so you shouldn’t miss the “1” in the queue size. Check the terminal for errors.

Leave a comment

Your email address will not be published. Required fields are marked *