Auto-Photoshop-StableDiffusion-Plugin

With Auto-Photoshop-StableDiffusion-Plugin, you can directly use the capabilities of Automatic1111 Stable Diffusion in Photoshop without switching between programs. This allows you to easily use Stable Diffusion AI in a familiar environment. You can edit your Stable Diffusion image with all your favorite tools and save it right in Photoshop.

Table of Contents

One Click Installer

Download the .ccx file and run it. that's all. you will be able to use all of stable diffusion modes (txt2img, img2img, inpainting and outpainting), check the tutorials section to master the tool.

for advance/professional users who want to use the smart masking mode, we have an optional and free automatic extension that you can install, and Here is how to do it:

1. copy Auto-Photoshop plugin url

   

2. paste the url in auto1111's extension tab and click install

1. make sure the Auto-Photoshop plugin is listed, then click "Apply and Restart UI"

Demo:

How to install Video Tutorial:

we recommend you use the one click installer. However watch the video on left if you don't have Automatic1111 Stable Diffusion installed, and the video on the right by Vladimir Chopine for clear instruction on how to install the plugin using UXP.

Instructional Tutorial (outpaint, inpaint, img2img and txt2img):

we recommend you check the tutorials section to master the tool.

How to install (Instruction for Developers):

for normal users we recommend you use the one click installer

First time running the plugin (local Automatic1111):

1. download the plugin:

git clone https://github.com/AbdullahAlfaraj/Auto-Photoshop-StableDiffusion-Plugin.git

1. run "start_server.bat" inside "Auto-Photoshop-StableDiffusion-Plugin" directory
2. go to where you have automatic1111 installed. Edit the "webui-user.bat" in automatic1111 change this line

set COMMANDLINE_ARGS= 

set COMMANDLINE_ARGS= --api

that will allow the plugin to communicate with the automatic1111 project. After saving close the "webui-user.bat" file and run it normally.

1. run photoshop. go to edit -> prefrences -> plugins
   1. make sure you check "Enable Developer Mode" checkbox
2. install "Adobe UXP Developer Tool" from here Installation (adobe.com) this tool will add the plugin into photoshop
3. run Adobe UXP Developer Tool and click on "Add Plugin" button in the top right. Navigate to where you have "Auto-Photoshop-StableDiffusion-Plugin" folder and open "manifest.json"
4. select the plugin and click on Actions -> Load Selected that's it.

First time running the plugin (remote Automatic1111):

The remote webui must also have --api set in COMMANDLINE_ARGS. You can check if api access is enabled by appending "/docs#" to the end of the url. If the documentation includes /sdapi/v1/samplers then api access is enabled.

1. download the plugin:

git clone https://github.com/AbdullahAlfaraj/Auto-Photoshop-StableDiffusion-Plugin.git

1. edit start_server.bat (or start_server.sh if on linux) to point to the remote installation of Automatic1111
2. run "start_server.bat" inside "Auto-Photoshop-StableDiffusion-Plugin" directory
3. run photoshop. go to edit -> prefrences -> plugins
   1. make sure you check "Enable Developer Mode" checkbox
4. install "Adobe UXP Developer Tool" from here Installation (adobe.com) this tool will add the plugin into photoshop
5. run Adobe UXP Developer Tool and click on "Add Plugin" button in the top right. Navigate to where you have "Auto-Photoshop-StableDiffusion-Plugin" folder and open "manifest.json"
6. select the plugin and click on Actions -> Load Selected that's it.

Steps to run the plugin for second time and onward:

1. start "webui-user.bat"
2. start "start_server.bat"
3. start "Photoshop"
4. start " Adobe UXP Developer Tool" and load the plugin

How to Use the Plugin:

watch this video for an in-depth, how to use the auto-photoshop-sd plugin! made by NIHIL Project

How to Videos:

Quick test:

1. In photoshop, start a new project.
2. After loading the plugin, don't select or change anything. Just click on the "Generate" button
3. If you see an image of a cat get loaded onto the canvas, then everything is set up correctly.

If you have an issue even after reading the following section. Please consider starting a new issue and/or join us on our discord for real-time feedback.

txt2Img:

1. use the rectangular marquee tool and select square (1x1 ratio)
   1. in the selection tool you can set the ratio to something like 512x512 or 512x768
   2. just make sure the ratio of selection is equal to the size of the image you are generating.
2. Write a prompt and click "Generate".
3. The result will be resized to fit the selected area. But don't worry, the image will be loaded into photoshop as a smart object. So you can resize it without losing quality.

img2img:

1. Select an image that is on its own layer.
   1. Optional: "Ctrl + click" the layer thumbnail. If you want the generated image to be place perfectly on the Initial image.
2. Change the mode to "img2img" in the plugin UI.
3. Click on "Set Init Image" button. If the image doesn't change to the selected layer. Click multiple times. (I'm fixing this problem)
4. Click on generate

inpaint:

1. Change the plugin mode to inpaint
2. Create a square selection on top of an image you want to inpaint:
   1. through the rectangular marquee tool
   2. or through "ctrl+click" the layer thumbnail
3. Create a new layer and paint white within the selected area. Note that anything white will be regenerated by Stable Diffusion.
4. Click "Init Inpaint Mask" button.
   1. Before clicking make sure you are still on the white layer
   2. after clicking the plugin will generate an appropriate black and white mask and set it as the mask to be used by Stable Diffusion.
   3. It will also create a snapshot of the canvas under the selected area, and will use this snapshot as the init image.
5. Click the "Generate" button.

outpaint:

1. change the plugin mode to inpaint. Remember, outpainting is just a special case of inpainting.
2. Create a "rectangular selction" that intersect with an image you want to extend.
3. Click on "Init Outpaint Mask" this will :
   1. create a snapshot of the canvas under your selection and use it as "init image" for Stable Diffusion
   2. create a black and white mask and will use it as the "init mask"
   3. it will update both the "init image" and the "init mask" in plugin UI

prompt shortcut:

you can substitute a whole sequance of words with one word.

Instead of writing the following as a prompt :

Unreal Engine, Octane Render, arcane card game ui, hearthstone art style, epic fantasy style art

you could write:

{game_like}

as long as you have defined the relationsip in the prompt library tab

{
"game_like": "Unreal Engine, Octane Render, arcane card game ui, hearthstone art style, epic fantasy style art"
}

Rule of thumbs:

• To get the best result for inpainting and outpainting you must select the "stable-diffusion inpainting model"
• An "init image" of img2img must not have transparency in it.
• Always check the "init image" and the "init mask" in plugin UI and make sure they match the layers on the canvas. To fix a mismatch, do:
  • Select the "group_mask" in the layers panel and click on "set init mask" button.
  • Select the "group_init_image" in the layers panel and click on "set init image" button.
• After selecting a model, you may need to wait for it to be loaded in Stable Diffusion before you should hit Generate.
• Check the progress bar if it's stuck at 0% or 1%: You could always cancel/interrupt the request if you think it's taking too long and regenerated again.
• Don't open multiple photoshop documents. For now, this will break the plugin. Only work on one project at a time.

FAQ and Known Issues

What Photoshop version do I need to run the plugin?

The minimum Photoshop version that the plugin supports is Photoshop v24

Path Doesn't Exist

If you get "path doesn't exist" error messeage when running start_server.bat you will need to add python to your system path.

Another option is to point to python useing fullpath as shown here: replace this line in start_server.bat:

python -m venv server_env

find the path for python on your machine and replace the upove line something like this:

C:\Users\abdul\AppData\Local\Programs\Python\Python310\python.exe -m venv server_env

Plugin Load Failed

There are a few issues that can result in this error, please follow the instructions for the corresponding error message in the UDT logs

No application are connected to the service

This error occurs when Photoshop is not started before the plugin is attempted to be loaded. Simply start photoshop then restart UXP and load the plugin

Load command failed in App with ID PS and Version X.X.X

This error occurs when the version of Photoshop is mistmatched with the expected version of the plugin. This may be solved by editing the manifest.json file on line 8 to match your version of Photoshop.

"host": [
    {
      "app": "PS",
      "minVersion": "24.0.0"
    }
  ],

However, if you later upgraded your Photoshop to v24 or higher. you may need to change minVersion back to "minVersion": "24.0.0" for the plugin to function correctly.

Exception in ASGI application / Expecting value: line 1 column 1

This error occurs due to mismatched expectations between the plugin and the Automatic1111 backend. It can be solved by both updating the version of the Automatic111 backend to the latest verion, and making sure "Save text information about generation parameters as chunks to png files" setting is enabled within the UI.

No Generations and Plugin Server doesn't send messages. (Remote setup)

This error occurs when the remote server does not have the api enabled. You can verify this by attempting to go to the URL you access the webui at and appending "/docs#" to the end of the url. If you have permissions, make relaunch the remote instance with the "--api" flag.

Issues with img2img, inpaint or outpaint:

img2img, inpaint and outpaint use photoshop "quick export as png" feature under the hood.

At random quick export as png will break, this is a known photoshop bug.

To test if the feature is broken and is the cause of your issue, do the following:

select a layer and right click on it, then select quick export as png. if you get prompted with a windows, then the quick export works fine. However if nothing happen then you will need to restart photoshop and try the export feature again, until it works.

if it work then you could procced to use the plugin.

until you get it to work the img2img, inpaint and outpaint will not function correctly.

No GPU Options:

we provide two options to use the auto-photoshp plugin without GPU.

Stable Horde

This is an awesome free crowdsourced distributed cluster of Stable Diffusion workers. If you like this service, consider joining the horde yourself! the horde is enabled completely by the generosity of volunteers so make sure you don't overwhelm the service and help join the cause if can. read more on their github page

Colab:

we link to this Colab directly inside plugin find it in the settings tab. you only need to run it. no need to change any of the settings. copy the gradio.live url the colab will generate and paste it into sd url field in the settings tab.