AI dance video (animateDiff prompt travel)

Updated Categorized as Workflow Tagged , , 11 Comments on AI dance video (animateDiff prompt travel)

Want to use a cool dance video for your AI artwork? This post guides you through the workflow step-by-step. The ComfyUI workflow JSON file will be provided.

Become a member of this site to see this content

Already a member? Log in here.

Avatar

By Andrew

Andrew is an experienced engineer with a specialization in Machine Learning and Artificial Intelligence. He is passionate about programming, art, photography, and education. He has a Ph.D. in engineering.

11 comments

  1. Seens to be oudated:
    Do not use AnimateDiff Combine node, it is deprecated. Use Video Combine node from ComfyUI-VideoHelperSuite instead. Video nodes from VideoHelperSuite are actively maintained, more feature-rich, and also automatically attempts to get ffmpeg.

    TypeError: expected str, bytes or os.PathLike object, not NoneType

    Prompt executed in 1469.09 seconds

    Dont expect a solution – just for info 🙂

  2. I am having an error as below. Tried for entire day, but unable to fix this. Any ideas?

    Loading aborted due to error reloading workflow data

    TypeError: input.widget.config is undefined

    beforeRegisterNodeDef/nodeType.prototype.onConfigure@http://127.0.0.1:8188/extensions/core/widgetInputs.js:161:26
    beforeRegisterNodeDef/nodeType.prototype.onConfigure@http://127.0.0.1:8188/extensions/tinyterraNodes/ttNwidgets.js:380:57
    LGraphNode.prototype.configure@http://127.0.0.1:8188/lib/litegraph.core.js:2549:18
    LGraph.prototype.configure@http://127.0.0.1:8188/lib/litegraph.core.js:2240:26
    loadGraphData@http://127.0.0.1:8188/scripts/app.js:1334:15
    handleFile/reader.onload@http://127.0.0.1:8188/scripts/app.js:1642:10

    This may be due to the following script:
    /extensions/core/widgetInputs.js

      1. Finally I got it, basically the the folder is sumoehow was not a git directory and comfyui was not getting updated. This error is common and usually happens when the comfyui and animatediff have non compatible versions. Since I wasn’t able to update it , it was not working, I removed the directory and did a fresh install. It is still work in progress but I am not getting that error now. Thanks anyways

  3. I’m not seeing any progress past the KSampler:
    Requested to load BaseModel
    Requested to load ControlNet
    Loading 2 new models
    0%| | 0/25 [00:00<?, ?it/s]

    My GPU is being used but everything looks correct. Any ideas?

      1. I was able to get both tutorials working.

        The problem was Chrome, I had a few tabs open and it took quite a bit of resources on its own.

        So I turned GPU acceleration off in Chrome’s settings.

        Once I closed all the extra tabs it started to work and the progress bar finally appeared.

        Appreciate the tutorial, thanks!

Leave a comment

Your email address will not be published. Required fields are marked *