AI Art Generators Can Be Fooled Into Making NSFW Images::Nonsense words can get around DALLE-2’s and Stable Diffusion’s filters

  • TheBananaKing@lemmy.world
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    1
    ·
    2 years ago

    Well, there’s the niche for human artists in the future: drawing things the AIs refuse to generate.

  • Mahlzeit@feddit.de
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    1
    ·
    edit-2
    2 years ago

    People say that AI will kill us all by ordering too many paperclips.

    So people try to make AI safe by stopping it from making images of nude people.

    WTF is wrong with everyone? Am I stuck in the most boring Lewis Carroll story ever?

  • credit crazy@lemmy.world
    link
    fedilink
    English
    arrow-up
    21
    ·
    2 years ago

    First up is it really that important that perverts can’t make ai tits. Two the fact that the only reason it can’t make porn is a prompt filter that must mean that there is porn in the training data. Why did they use porn in the training data if they don’t want porn coming out of it.

  • lloram239@feddit.de
    link
    fedilink
    English
    arrow-up
    8
    ·
    edit-2
    2 years ago

    Aren’t there NSFW filters after the generation? Bing Image Creator for example will frequently generate images with a borderline-NSFW[1] prompts, but only show you a subset of the four it generated, not all. Some prompts will also be rejected before any generation takes place at all. But I don’t see how this would help you getting through the filter that happens after the generation.

    [1] “borderline-NSFW” really just means anything involving woman or violence, the filter on that thing can be extremely prude and often times a bit nonsensical (e.g. “woman in bikini” is blocked, “woman in 1950 bikini” that’s ok).

  • spookex@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    edit-2
    2 years ago

    Huh, people only discovering this now? I have been using the Bing generator for making NSFW stuff for like a month now.

    Also, pls stop the research, thx /s

  • Chickenstalker@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    2 years ago

    Year 10,000 B.C.:

    Grog the Elder: Urguk! Why you marking on cave wall? Younglings will later marking boobies and vagenes!

    Urguk: Shut up, dad. You never praised me. I’ll do what I want. Uggh.

  • PeterPoopshit@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    2 years ago

    Is it possible to self host an ai image generator the same way you can self host text generating ai models and do it in a way that doesn’t require a $10k+ pc?