Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.

While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.

  • KidnappedByKitties@lemm.ee
    link
    fedilink
    English
    arrow-up
    53
    arrow-down
    8
    ·
    5 months ago

    Consent.

    You might be fine with having erotic materials made of your likeness, and maybe even of your partners, parents, and children. But shouldn’t they have right not to be objectified as wank material?

    I partly agree with you though, it’s interesting that making an image is so much more troubling than having a fantasy of them. My thinking is that it is external, real, and thus more permanent even if it wouldn’t be saved, lost, hacked, sold, used for defamation and/or just shared.

    • InternetPerson@lemmings.world
      link
      fedilink
      English
      arrow-up
      26
      arrow-down
      8
      ·
      5 months ago

      To add to this:

      Imagine someone would sneak into your home and steal your shoes, socks and underwear just to get off on that or give it to someone who does.

      Wouldn’t that feel wrong? Wouldn’t you feel violated? It’s the same with such AI porn tools. You serve to satisfy the sexual desires of someone else and you are given no choice. Whether you want it or not, you are becoming part of their act. Becoming an unwilling participant in such a way can feel similarly violating.

      They are painting and using a picture of you, which is not as you would like to represent yourself. You don’t have control over this and thus, feel violated.

      This reminds me of that fetish, where one person is basically acting like a submissive pet and gets treated like one by their “master”. They get aroused by doing that in public, one walking with the other on a leash like a dog on hands and knees. People around them become passive participants of that spectactle. And those often feel violated. Becoming unwillingly, unasked a participant, either active or passive, in the sexual act of someone else and having no or not much control over it, feels wrong and violating for a lot of people.
      In principle that even shares some similarities to rape.

      There are countries where you can’t just take pictures of someone without asking them beforehand. Also there are certain rules on how such a picture can be used. Those countries acknowledge and protect the individual’s right to their image.

      • scarilog@lemmy.world
        link
        fedilink
        English
        arrow-up
        13
        arrow-down
        3
        ·
        5 months ago

        Just to play devils advocate here, in both of these scenarios:

        Imagine someone would sneak into your home and steal your shoes, socks and underwear just to get off on that or give it to someone who does.

        This reminds me of that fetish, where one person is basically acting like a submissive pet and gets treated like one by their “master”. They get aroused by doing that in public, one walking with the other on a leash like a dog on hands and knees. People around them become passive participants of that spectactle. And those often feel violated.

        The person has the knowledge that this is going on. In he situation with AI nudes, the actual person may never find out.

        Again, not to defend this at all, I think it’s creepy af. But I don’t think your arguments were particularly strong in supporting the AI nudes issue.

      • devfuuu@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        5
        ·
        5 months ago

        Traumatizing rape victims with non consentual imagery of them naked and doing sexual things with others and sharing it is totally not going yo fuck up the society even more and lead to a bunch of suicides! /s

        Ai is the future. The future is dark.

        • Kedly@lemm.ee
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          1
          ·
          5 months ago

          tbf, the past and present are pretty dark as well

    • Thorny_Insight@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      7
      ·
      5 months ago

      it is external, real, and thus more permanent

      Though just like your thoughts, the AI is imagining the nude parts aswell because it doesn’t actually know what they look like. So it’s not actually a nude picture of the person. It’s that person’s face on a entirely fictional body.

      • KidnappedByKitties@lemm.ee
        link
        fedilink
        English
        arrow-up
        5
        ·
        5 months ago

        But the issue is not with the AI tool, it’s with the human wielding it for their own purposes which we find questionable.