Instruct Pix2Pix is a Stable Diffusion model that edits images with the user’s text instruction alone. We will go through how it works, what it can do, how to run it on the web and AUTOMATIC1111, and how to use it. Table of ContentsWhat can Instruct pix2pix do?How does Instruct pix2pix work?Model ArchitectureTrainingDifference from other…
Blog
Sharp blades
These swords were created using image-to-image. It did require more work but you would get images you would never be able to produce using text-to-image alone. Beauty is power; a smile is its sword. John Ray All images are generated with Colab notebook included in the Quick Start Guide. Prompt for sword: highly detailed pattern ornated…
How to use outpainting to extend images
Stable Diffusion can extend an image in any direction with outpainting. It can generate a coherent background that is outside of the view. In this article, you will learn how to perform outpainting step-by-step. Table of ContentsSoftwareStep-by-step guideStep 1: Upload the image to AUTOMATIC1111Step 2: Select an inpainting modelStep 3: Set outpainting parametersStep 4: Enable…
ChatGPT: How to generate prompts for Stable Diffusion
Can ChatGPT generate high-quality prompts for Stable Diffusion? The answer is yes. But you will need special methods to tease them out. Once you learn how to do it, the results will surprise you. In this article, I will show you how to do that step-by-step. Table of ContentsWhat is ChatGPT?How was ChatGPT trained?Does ChatGPT…
Flowery girl
A colorful illustration portrait with a lot of flowers and butterflies. Take time to smell the roses Proverb All images are generated with Colab notebook included in the Quick Start Guide. A colorful illustration portrait with a lot of flowers and butterflies. Take time to smell the roses Proverb All images are generated with Colab notebook…
How to run Stable Diffusion on Google Colab (AUTOMATIC1111)
This is a step-by-step guide for using the Google Colab notebook in the Quick Start Guide to run AUTOMATIC1111. This is one of the easiest ways to use AUTOMATIC1111 because you don’t need to deal with the installation. See installation instructions on Windows PC and Mac if you prefer to run locally. This notebook is…
How to install and run Stable Diffusion on Apple Silicon M1/M2 Macs
Stable Diffusion is a text-to-image AI that can be run on personal computers like Mac M1 or M2. In this article, you will find a step-by-step guide for installing and running Stable Diffusion on Mac. Here are the install options I will go through in this article. Alternatively, run Stable Diffusion on Google Colab using…
Paris in rainy fall
Impressionist painting of Paris in a rainy day with fall color. Just add three letters to Paris, and you have paradise Jules Renard All images are generated with Colab notebook included in the Quick Start Guide. Impressionist painting of Paris in a rainy day with fall color. Just add three letters to Paris, and you have…
How to use negative prompts?
You put what you DON’T want to see in the negative prompt. It gives you an additional way to control text-to-image generation. Many people treat it as an optional feature in Stable Diffusion v1.5. Things changed with the release of Stable Diffusion v2. The negative prompt becomes indispensable. In this post, I will walk through…
How does negative prompt work?
The negative prompt is an additional way to nudge Stable Diffusion to give you what you want. Unlike inpainting, which requires drawing a mask, you can use a negative prompt with all the convenience of text input. In fact, some images can only be generated by using negative prompts. In this article, we will review…
