@Zerowinger
You might be able to find some trick with your prompts that removes or reduces the issue, but that seems unlikely. This seems to be a fundamental misunderstanding of the model (or it had a lot of images with this mistake in its training data).
You might be able to find some trick with your prompts that removes or reduces the issue, but that seems unlikely. This seems to be a fundamental misunderstanding of the model (or it had a lot of images with this mistake in its training data).
Can you do image-to-image with your current setup? If so, then doing a very basic edit of the image with any old image editor (even mspaint works fine) to just remove the hair and block the background colors in and then doing one or two passes with low-denoise image-to-image should fix it.
If you can’t image-to-image, then Photoshop is probably your best bet. I haven’t used the recent versions of Photoshop, but the tools in it should be able to handle removing things like that very quickly and easily. It’s doable in GIMP, but it’ll be a lot more work because its selection and fixing tools are not as advanced.
You could also try https://huggingface.co/spaces/Sanster/iopaint-lama which uses a model specifically trained on removing things from images, though you’ll likely want to do an image-to-image pass after using it.

