[David Rawlins]

I thought I’d found the answer to the prompt travel issue: the BatchPromptSchedule node was sized so that the print_output box was hidden and it was set to false. I only realised when I compared this workflow with the one from the previous lesson. I set it to true. But it didn’t help.

I reproduced the previous findings: with v1.0.2, the node stops with Torch errors. With v1.0, it completes but there’s no prompt travel. I tried the slightly different version of the workflow on your separate post on all this but with the same results.

https://stable-diffusion-art.com/animatediff-prompt-travel-video2video/

I then ran the previous prompt travel workflow without video and the v1.0 node worked fine and she experienced all four seasons.

I think I’ve run out of patience!

 

 

 

 

[David Rawlins]

More on this.

I had the same problem when running the video to video ADiff workflow, having started from scratch as above. It seemed from the log that the problem was related to some of the custom nodes that I installed, possibly one of the Fizznode ones, and I wondered if I’d used versions that clashed or had bugs. So I started again and installed the nodes individually only installing the most recent numbered version and in the case of the Fizznodes BatchPromptSchedule, the original v1.0. The workflow then ran without problems though the log complained that:

/content/ComfyUI/custom_nodes/comfyui_fizznodes/BatchFuncs.py:169: FutureWarning: Setting an item of incompatible dtype is deprecated and will raise an error in a future version of pandas.

No idea what pandas have to do with it! It worked with L4 and T4 runtypes.

I then reproduced the fault by reinstalling v1.2 of the node so it looks like it is buggy.

[David Rawlins]

Thanks, Andrew

I started from scratch with a new copy of the workflow and a new notebook, deleted the custom nodes folder and ran it on T4. This time it worked ok. The install custom nodes screen looked different and contained descriptions of each node which it hadn’t previously, though the nodes were the same. I’ve no idea how I messed things up.

I must remember this – pull the plug out and start again! Thanks for your patience

[David Rawlins]

Hi Andrew,

Weird. I’ve just tried it again with the same error.  I dropped the workflow in, installed custom nodes, selected dreamshaper8 and ran it. I then tried it with a different SD1.5 model with the same result.

I installed all the nodes at once without restarting in between each.

I’ve copied a bit more of the log below – please let me know if I can provide more/different:

got prompt
model weight dtype torch.float16, manual cast: None
model_type EPS
Using pytorch attention in VAE
Using pytorch attention in VAE
VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
warning, embedding:BadDream does not exist, ignoring
Requested to load SD1ClipModel
loaded completely 21284.175 235.84423828125 True
!!! Exception during processing !!! torch.cat(): expected a non-empty list of Tensors
Traceback (most recent call last):
File “/content/ComfyUI/execution.py”, line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/content/ComfyUI/execution.py”, line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/content/ComfyUI/execution.py”, line 174, in _map_node_over_list
process_inputs(input_dict, i)
File “/content/ComfyUI/execution.py”, line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/content/ComfyUI/custom_nodes/comfyui_fizznodes/ScheduledNodes.py”, line 159, in animate
return batch_prompt_schedule(settings, clip)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/content/ComfyUI/custom_nodes/comfyui_fizznodes/ScheduleTypes.py”, line 49, in batch_prompt_schedule
p = BatchPoolAnimConditioning(pos_cur_prompt, pos_nxt_prompt, weight, clip, settings)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/content/ComfyUI/custom_nodes/comfyui_fizznodes/BatchFuncs.py”, line 345, in BatchPoolAnimConditioning
final_pooled_output = torch.cat(pooled_out, dim=0)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: torch.cat(): expected a non-empty list of Tensors

[David Rawlins]

Curious, AnimateDiff worked fine with the PanLeft Lora but then when I tried ZoomOut it crashed the session and since then I’ve not been able to get it to work at all, even without Loras. I’ve completely restarted the session a couple of times. Lots of errors reported that I can post if useful. I’m using the new motion model and ngrok.

[David Rawlins]

Thanks, I did install it myself – it took 2 hours to upload! Hopefully not too many more models will need this approach.

[David Rawlins]

Thanks, seems I need to download/upload the SVD model to Colab and it’s rather large. I can’t use my automated method, unfortunately, as the download is protected. Do you know if there’s a huggingface equivalent to the civitai api?

[David Rawlins]

Thanks, Andrew

[David Rawlins]

The SVD one

[David Rawlins]

Thanks!

[David Rawlins]

Thanks, I suspected as much. A shame as I prefer to use Forge

[David Rawlins]

I’ve posted a question here:

https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/2292

If I get an answer I’ll let you know

[David Rawlins]

Further to this, the form seems sensitive to stray spaces and commas between the URLs and they cause errors. OK now I know but perhaps the parsing could be made more flexible for others?

[David Rawlins]

Thanks, Andrew,

It works if I remove the text after the model number but it still often doesn’t work if I leave it in.

I realised I had been putting in spaces after the comma between urls so removed them but it didn’t seem to make a difference.

At least I can now load all the models I need so that’s good

[David Rawlins]

here it is again

Thanks for the info about the log – that’s useful

Yes, I’m using an API.

For example, Elegance loads ok with the following URL:

https://civitai.com/api/download/models/140255?type=Model&format=SafeTensor&size=pruned&fp=fp16

But Cyberrealistic Pony with this URL gives an error:

https://civitai.com/api/download/models/953264?type=Model&format=SafeTensor&size=pruned&fp=fp16

This is the execution log

11/05 11:20:42 [ERROR] CUID#7 – Download aborted. URI=https://civitai.com/api/download/models/953264?type=Model
Exception: [AbstractCommand.cc:351] errorCode=24 URI=https://civitai.com/api/download/models/953264?type=Model
-> [HttpSkipResponseCommand.cc:215] errorCode=24 Authorization failed.

Download Results:
gid |stat|avg speed |path/URI
======+====+===========+=======================================================
c9b366|ERR | 0B/s|https://civitai.com/api/download/models/953264?type=Model

Status Legend:
(ERR):error occurred.

aria2 will resume download if the transfer is restarted.
If there are any errors, then see the log file. See ‘-l’ option in help/man page for details.
/content/stable-diffusion-webui-forge/models/Stable-diffusion

 

Both URLs were in the URL part of the form separated by a comma. I tried a different API but got the same result.

Can you advise?

Thanks

David

[Author]

Posts