• iAvicenna@lemmy.world
    link
    fedilink
    arrow-up
    16
    arrow-down
    1
    ·
    edit-2
    3 months ago

    hmm guess which one also doesn’t suck the energy equivalent of a sizeable town

    • i_love_FFT@lemmy.ml
      link
      fedilink
      arrow-up
      6
      ·
      3 months ago

      I’d like all ai service to publish the energy used in training the model and performing inference.

      “Queries uses an average of X kWh of power. A model training run requires X MWh, and the development of this model over the years required X TWh of power.”

      Then we could judge companies by that metric. Off course, rich people would look for the most power-draining model for the sake of it.

      • FrenchThrowAway@jlai.lu
        link
        fedilink
        arrow-up
        6
        ·
        edit-2
        3 months ago

        That’s already something that Meta is doing for their Llama models:

        Source

        You can extrapolate openai models consumption from these I guess

        • Skullgrid@lemmy.world
          link
          fedilink
          arrow-up
          8
          ·
          3 months ago

          ok, but

          1. Is it still bad if they use renewables? in which case, it’s not horrendous, is it?

          2. what about the rest of their servers?

          3. Fuck facebook

          • iAvicenna@lemmy.world
            link
            fedilink
            arrow-up
            3
            ·
            edit-2
            3 months ago

            If we are abundant in renewable energy no but if we are still at a level where available renewable energy can be used to replace non-renewable, then AI tech needs to justify its use cases too.

            and servers yes, social media related data center energy consumption should be put under heavy scrutiny too. Especially considering some energy hungry social media platforms like facebook are lately causing more harm than good (on other fronts such as political propaganda and racism). I doubt any of these are gonna happen soon though since many governments are heavily invested in using social media and LLM chatbots for propaganda and surveillance.

          • FrenchThrowAway@jlai.lu
            link
            fedilink
            arrow-up
            1
            ·
            3 months ago
            1. Power consumption is still power consumption, so 2 290 000kgCo2 is a lot, even if it’s way lower than what it would have been with coal plants
            2. They only talk about power consumption and not server hardware footprint, cause power consumption is the easier to offset
            3. Yes
      • howrar@lemmy.ca
        link
        fedilink
        arrow-up
        4
        ·
        edit-2
        3 months ago

        development of this model over the years required X TWh of power

        This part is kind of hard to measure. When do you start counting? From the first work that informed the research direction eventually leading to this model? From the point where the concept of this final model first came about? Do you split the energy usage between multiple models that came from the same work?

    • ReCursing@lemmings.world
      link
      fedilink
      arrow-up
      2
      arrow-down
      6
      ·
      3 months ago

      That’s something of a red herring. The source of that energy matters more than how much is used (use renewables where possible) - your ire is directed at entirely the wrong place; and also how much is used in computers and datacentres doing other stuff? If I’m generating pictures I’m not playing games, which is using the same card and probably more constantly.

      I gotta congratulate you though, that’s an argument that to my knowledge was NOT levelled against photography when that was invented. I mean like all the other arguments it’s bollocks but at least it’s new! <pretty much every other argument against ai art was levelled at photography and many of therm at pre-mixed paints before that!>