friendly reminder that the bots are spying on you

  • OmegaLemmy@discuss.online
    link
    fedilink
    arrow-up
    14
    arrow-down
    1
    ·
    6 hours ago

    Gemini is not even good for a free ai What the fuck are they using in the back end for it to be this shit?

    • BarbecueCowboy@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      3 hours ago

      It’s google, the product was complete when it was launched and any further development is an accident or from engineers that weren’t valuable enough to be placed on new projects. Backend was whatever could get it done quickest. The only way to get ahead at google is launching new projects. They’re banking on the fact that every once in awhile they get lucky and someone else build out the use case for them, but not sure how well that will go with Gemini.

      They’ve probably already got a new product in development to replace it.

  • Asafum@feddit.nl
    link
    fedilink
    arrow-up
    146
    arrow-down
    1
    ·
    15 hours ago

    Lmao “is_public= False.”

    “Shit did I say that out loud?”

    • TheFriar@lemm.ee
      link
      fedilink
      arrow-up
      17
      ·
      14 hours ago

      Can you explain to a non codemonkey what this code actually says it’s supposed to do

      • ayyy@sh.itjust.works
        link
        fedilink
        arrow-up
        46
        arrow-down
        1
        ·
        10 hours ago

        Like almost every AI screenshot you see on social media, it is fake and made up.

      • TootSweet@lemmy.world
        link
        fedilink
        English
        arrow-up
        56
        arrow-down
        2
        ·
        edit-2
        13 hours ago

        I don’t think this is Gemini trying to run some of its own code to save facts about the user and whoops displaying the code it was trying to run to the user rather than running it or anything like that. That’s not how software works, and not how LLMs work.

        More likely somewhere in Gemini’s training data, there’s one or more code examples (specifically Python code examples, by the looks of it) that have something to do with the user’s prompt. The relationship between Python code examples and the user’s prompt may well be extremely nonobvious, but there’d have to be something about the prompt that made Gemini hallucinate that.

        Source: Am software engineer. Though I don’t have any hands-on experience with generative AI to speak of. I do think generative AI is a bullshit hype bubble, though.

        • ebolapie@lemmy.worldOP
          link
          fedilink
          arrow-up
          2
          ·
          29 minutes ago

          This probably is not actually Gemini attempting to run code. It’s not staged though, this came out of left field. I was bitching at it about the number of Nazis on Twitter and bullying it for calling Elon musk a free speech absolutist. Then I nonsequitured into the bit about watermelon.

        • Takumidesh@lemmy.world
          link
          fedilink
          arrow-up
          40
          ·
          13 hours ago

          Another thing to consider is that it’s really easy to manipulate these types of screenshots by just telling the AI to respond to your prompt in a certain way.

          You can just say ‘respond to my next sentence with python code saving my info’ and it will do it.

          • kautau@lemmy.world
            link
            fedilink
            arrow-up
            11
            ·
            8 hours ago

            Or just inspect element, no need to reinvent the wheel when you can modify anything you see on the web

          • TootSweet@lemmy.world
            link
            fedilink
            English
            arrow-up
            6
            ·
            13 hours ago

            Sure, but LLMs are also sufficiently prone to spontaneously doing weird stuff like that that it’s very believable that it’s authentic/organic. And there’s definitely Python code in Gemini’s training data.

        • Pup Biru@aussie.zone
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          10 hours ago

          i mean, kinda… that’s how tools work: tools aren’t anything particularly special; they’re just the model replying in a way that the code running the model knows to ingest and perform an action with, rather than just replying to the user… so if the model for whatever reason messed that up, it could probably output tool calls

          … and the “common sense” is for sure implemented with tools-like stuff

      • Asafum@feddit.nl
        link
        fedilink
        arrow-up
        12
        arrow-down
        3
        ·
        14 hours ago

        I’m not really a programmer but if I had to guess it looks like it was trying to update it’s own information about the user, trying to save the “fact” that the user thought watermelon was tasty. It saved it as a “food preference” which I guess is a parameter the system can recognize.

      • Deegham@lemmy.blahaj.zone
        link
        fedilink
        arrow-up
        8
        arrow-down
        2
        ·
        14 hours ago

        i’m not too fluent in compter, but it looks like it tried to silently log that the user thinks watermelon is tasty for future reference