Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.

While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.

  • Uriel238 [all pronouns]@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    62
    arrow-down
    13
    ·
    7 months ago

    It remains fascinating to me how these apps are being responded to in society. I’d assume part of the point of seeing someone naked is to know what their bits look like, while these just extrapolate with averages (and likely, averages of glamor models). So we still dont know what these people actually look like naked.

    And yet, people are still scorned and offended as if they were.

    Technology is breaking our society, albeit in place where our culture was vulnerable to being broken.

    • exanime@lemmy.today
      link
      fedilink
      English
      arrow-up
      63
      arrow-down
      8
      ·
      edit-2
      7 months ago

      And yet, people are still scorned and offended as if they were.

      I think you are missing the plot here… If a naked pic of yourself, your mother, your wife, your daughter is circulating around the campus, work or just online… Are you really going to be like “lol my nipples are lighter and they don’t know” ??

      You may not get that job, promotion, entry into program, etc. The harm done by naked pics in public would just as real weather the representation is accurate or not … And that’s not even starting to talk about the violation of privacy and overall creepiness of whatever people will do with that pic of your daughter out there

      • 🔍🦘🛎@lemmy.world
        link
        fedilink
        English
        arrow-up
        14
        arrow-down
        1
        ·
        7 months ago

        I believe their point is that an employer logically shouldn’t care if some third party fabricates an image resembling you. We still have an issue with latent puritanism, and this needs to be addressed as we face the reality of more and more convincing fakes of images, audio, and video.

        • exanime@lemmy.today
          link
          fedilink
          English
          arrow-up
          8
          arrow-down
          3
          ·
          7 months ago

          I agree… however, we live in the world we live in, where employers do discriminate as much as they can before getting in trouble with the law

          • 🔍🦘🛎@lemmy.world
            link
            fedilink
            English
            arrow-up
            5
            arrow-down
            1
            ·
            7 months ago

            I think the only thing we can do is to help out by calling this out. AI fakes are just advanced gossip, and people need to realize that.

      • Thorny_Insight@lemm.ee
        link
        fedilink
        English
        arrow-up
        21
        arrow-down
        8
        ·
        7 months ago

        This is a transitional period issue. In a couple of years you can just say AI made it even if it’s a real picture and everyone will believe you. Fake nudes are in no way a new thing anyway. I used to make dozens of these by request back in my edgy 4chan times 15 years ago.

        • Duamerthrax@lemmy.world
          link
          fedilink
          English
          arrow-up
          10
          arrow-down
          1
          ·
          edit-2
          7 months ago

          Dead internet.

          It also means in a few years, any terrible thing someone does will just be excused as a “deep fake” if you have the resources and any terrible thing someone wants to pin on you with be cooked up in seconds. People wont just blanket believe or disbelieve any possible deep fake. They’ll cherry pick what to believe based on their preexisting world view and how confident the story telling comes across.

          As far as your old edits go, if they’re anything like the ones I saw, they were terrible and not believable at all.

          • TangledHyphae@lemmy.world
            cake
            link
            fedilink
            English
            arrow-up
            3
            ·
            7 months ago

            I’m still on the google prompt bandwagon of typing this query:

            stuff i am searching for before:2023… or ideally, even before COVID19, if you want more valuable, less tainted results. It’s only going to get worse from here, 2024 is the year of saturation with garbage data on the web (yes I know it was already bad before, but now AI is pumping this shit out at an industrial scale.)

        • exanime@lemmy.today
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          1
          ·
          7 months ago

          This is a transitional period issue. In a couple of years you can just say AI made it even if it’s a real picture and everyone will believe you.

          Sure, but the question of whether they harm the victim is still real… if your prospective employer finds tons of pics of you with nazi flags, guns and drugs… they may just “play it safe” and pass on you… no matter how much you claim (or even the employer might think) they are fakes

      • ඞmir@lemmy.ml
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        12
        ·
        7 months ago

        On the other end, I welcome the widespread creation of these of EVERYONE, so that it becomes impossible for them to be believable. No one should be refused from a job/promotion because of the existence of a real one IMO and this will give plausible deniability.

        • exanime@lemmy.today
          link
          fedilink
          English
          arrow-up
          23
          arrow-down
          5
          ·
          7 months ago

          People are refused for jobs/promotions on the most arbitrary basis, often against existing laws but they are impossible to enforce.

          Even if it is normalized, there is always the escalation factor… sure, nobody won’t hire Anita because of her nudes out there, everyone has them and they are probably fake right?.. but Perdita? hmmm I don’t want my law firm associated in any way with her pics of tentacle porn, that’s just too much!

          Making sure we are all in the gutter is not really a good way to deal with this issue… specially since it will, once again, impact women 100x more than it will affect men

    • Echo Dot@feddit.uk
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      3
      ·
      7 months ago

      I suspect it’s more affecting for younger people who don’t really think about the fact that in reality, no one has seen them naked. Probably traumatizing for them and logic doesn’t really apply in this situation.

      • StitchIsABitch@lemmy.world
        link
        fedilink
        English
        arrow-up
        20
        arrow-down
        3
        ·
        7 months ago

        Does it really matter though? “Well you see, they didn’t actually see you naked, it was just a photorealistic approximation of what you would look like naked”.

        At that point I feel like the lines get very blurry, it’s still going to be embarrassing as hell, and them not being “real” nudes is not a big comfort when having to confront the fact that there are people masturbating to your “fake” nudes without your consent.

        I think in a few years this won’t really be a problem because by then these things will be so widespread that no one will care, but right now the people being specifically targeted by this must not be feeling great.

        • ???@lemmy.world
          link
          fedilink
          English
          arrow-up
          14
          ·
          7 months ago

          It depends where you are in the world. In the Middle East, even a deepfake of you naked could get you killed if your family is insane.

        • Echo Dot@feddit.uk
          link
          fedilink
          English
          arrow-up
          5
          ·
          7 months ago

          It depends very much on the individual apparently. I don’t have a huge data set but there are girls that I know that have had this has happened to them, and some of them have just laughed it off and really not seemed like they cared. But again they were in their mid twenties not 18 or 19.

    • Beebabe@lemmy.world
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      3
      ·
      7 months ago

      Something like this could be career ending for me. Because of the way people react. “Oh did you see Mrs. Bee on the internet?” Would have to change my name and move three towns over or something. That’s not even considering the emotional damage of having people download you. Knowledge that “you” are dehumanized in this way. It almost takes the concept of consent and throws it completely out the window. We all know people have lewd thoughts from time to time, but I think having a metric on that…it would be so twisted for the self-image of the victim. A marketplace for intrusive thoughts where anyone can be commodified. Not even celebrities, just average individuals trying to mind their own business.

      • captainlezbian@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        7 months ago

        Exactly. I’m not even shy, my boobs have been out plenty and I’ve sent nudes all that. Hell I met my wife with my tits out. But there’s a wild difference between pictures I made and released of my own will in certain contexts and situations vs pictures attempting to approximate my naked body generated without my knowledge or permission because someone had a whim.

      • foggenbooty@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        2
        ·
        7 months ago

        I think you might be overreacting, and if you’re not, then it says much more about the society we are currently living in than this particular problem.

        I’m not promoting AI fakes, just to be clear. That said, AI is just making fakes easier. If you were a teacher (for example) and you’re so concerned that a student of yours could create this image that would cause you to pick up and move your life, I’m sad to say they can already do this and they’ve been able to for the last 10 years.

        I’m not saying it’s good that a fake, or an unsubstantiated rumor of an affair, etc can have such big impacts on our life, but it is troubling that someone like yourself can fear for their livelihood over something so easy for anyone to produce. Are we so fragile? Should we not worry more about why our society is so prudish and ostracizing to basic human sexuality?

    • inb4_FoundTheVegan@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      4
      ·
      edit-2
      7 months ago

      Wtf are you even talking about? People should have the right to control if they are “approximated” as nude. You can wax poetic how it’s not nessecarily correct but that’s because you are ignoring the woman who did not consent to the process. Like, if I posted a nude then that’s on the internet forever. But now, any picture at all can be made nude and posted to the internet forever. You’re entirely removing consent from the equation you ass.

      • Drewelite@lemmynsfw.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        7 months ago

        Totally get your frustration, but people have been imagining, drawing, and photoshopping people naked since forever. To me the problem is if they try and pass it off as real. If someone can draw photorealistic pieces and drew someone naked, we wouldn’t have the same reaction, right?

        • inb4_FoundTheVegan@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          7 months ago

          It takes years of pratice to draw photorealism, and days if not weeks to draw a particular piece. Which is absolutely not the same to any jackass with an net connection and 5 minutes to create a equally/more realistic version.

          It’s really upsetting that this argument keeps getting brought up. Because while guys are being philosophical about how it’s therotically the same thing, women are experiencing real world harm and harassment from these services. Women get fired for having nudes, girls are being blackmailed and bullied with this shit.

          But since it’s theoretically always been possible somehow churning through any woman you find on Instagram isn’t an issue.

          Totally get your frustration

          Do you? Since you aren’t threatened by this, yet another way for women to be harassed is just a fun little thought experiment.

          • Drewelite@lemmynsfw.com
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            7 months ago

            Well that’s exactly the point from my perspective. It’s really shitty here in the stage of technology where people are falling victim to this. So I really understand people’s knee jerk reaction to throw on the brakes. But then we’ll stay here where women are being harassed and bullied with this kind of technology. The only paths forward, theoretically, are to remove it all together or to make it ubiquitous background noise. Removing it all together, in my opinion, is practically impossible.

            So my point is that a picture from an unverified source can never be taken as truth. But we’re in a weird place technologically, where unfortunately it is. I think we’re finally reaching a point where we can break free of that. If someone sends me a nude with my face on it like, “Is this you?!!”. I’ll send them one back with their face like, “Is tHiS YoU?!??!”.

            We’ll be in a place where we as a society cannot function taking everything we see on the internet as truth. Not only does this potentially solve the AI nude problem, It can solve the actual nude leaks / revenge porn, other forms of cyberbullying, and mass distribution of misinformation as a whole. The internet hasn’t been a reliable source of information since its inception. The problem is, up until now, its been just plausible enough that the gullible fall into believing it.

    • Grandwolf319@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      12
      ·
      7 months ago

      I think half the people who are offended don’t get this.

      The other half think that it’s enough to cause hate.

      Both arguments rely on enough people being stupid.