Helpful Resources

I’ll add more here as I remember them. Feel free to add more in the comments.

Models

Models are basically the brains of Stable Diffusion. They are the data SD uses to learn what your prompts mean.
The built-in models that come with Stable Diffusion are really bad for porn. Don’t use them. In fact don’t use them at all unless you’re training your own models, there are better SFW models.

Here are some of my personal favourites:

Anime

  • MeinaHentai is a great model to start with. Compared to other models it’s really easy to prompt
  • AOM3 also does really well, though it might be a little more difficult to guide

For all of those, I recommend installing https://github.com/DominikDoom/a1111-sd-webui-tagcomplete, as they heavily rely on danbooru tags.

  • Berry Mix (Pre-mixed version here) can also work pretty well, depending on what you want to do. AFAIK it uses rule34 tags instead of danbooru, so it probably won’t work all too well with prompts used for the above ones

Realistic

  • Uber Realistic Porn Merge is the only realistic model I know of that does hardcore stuff. It’s unfortunate problem is that it’s REALLY DAMN HARD TO USE

VAEs

VAEs are mostly used for finetuning colors, sharpness, what have you. Some models come with a VAE builtin, but for ones that don’t, it’s recommended to have one on hand.

  • “Anything VAE”, “Orangemix VAE”, and “NAI Leak VAE” are the same exact thing under different names. If you already have one on hand, don’t bother with the others. Most VAEs are renamed versions or modifications of this one.
  • Waifu Diffusion’s kl-f8-anime2 is also a pretty good one. It doesn’t require Waifu Diffusion.
  • The one that comes with Stable Diffusion is the only one that seems to work for realistic stuff.

LoRAs

LoRAs teach models about concepts (characters, clothing, environments, style, …) they might not know about. There are a LOT of them, so feel free to browse Civitai to find ones you might want.

LoRAs tend to be specific for families of models, or at the very least styles (using anime LoRAs on realistic models tend to be a bad idea), but there are a fair few that will work across the board.

Locon and LyCORIS are newer formats of LoRAs. Not sure on the technical differences between them, but they will not work out of the box and need an extension such as https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris to get working

Textual Inversions / Embeddings and Hypernetworks

These are mostly obsoleted by LoRAs. There are a few embeddings such as Deep Negative and EasyNegative that are still quite useful, but in most cases you’ll want to use LoRAs instead.

  • nottheengineer@lemmynsfw.com
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 years ago

    I tried running the web UI on a steam deck with both meinahentai and URPM but I keep getting segfaults after “applying optimization: Doggettx”

    Any idea what causes those? The deck should act like it has 10GB RAM and 4GB VRAM, so I’m not sure where those errors come from.

    • Triple Underscore@lemmynsfw.comOPM
      link
      fedilink
      English
      arrow-up
      5
      ·
      edit-2
      2 years ago

      ROCm is flaky in regular consumer GPUs at the best of times. I’m surprised you could even get that far on a steam deck.

      Try the command line arg --opt-sdp-attention. You might also want to try out --medvram or --lowvram (4GBs is considered low when it comes to AI). although I have a feeling it’s just because of the custom nature of the deck’s APU.

      Your best bet would be to search for builds of ROCm, PyTorch and Torchvision that are specifically made for the deck, if such things even exist.