Forum Replies Created
-
Posts
-
Hi, it seems that your trained model is not stable. You can:
- Train from SD 1.5 if possible. The model is in a better state compared to realistic vision.
- Try reducing the number of training steps and/or learning rate. Use the least you can get away with.
Great!
Dreambooth on SDXL consumes too much memory. I can’t find a way around it on Colab. You can try training a LoRA on SDXL.
Realistic Vision is a good starting point for what you want to achieve.
Welcome!
Dreambooth is the most powerful method, so it should work.
You can try
- Get better input pictures with quality similar to my training example images.
-
If your face doesn’t show, train more steps.
I’m not aware of such controlnet model.
The SDXL canny controlnet works pretty well.
You use SD1.5 segmentation controlnet to generate something close and use multiple rounds of img2img with controlnet to transform the image to an SDXL style.
The first image can be from an input image. But animatediff will change it big time.
It is not possible to insert an image during the video generation.
I will add this to my list.