• paddirn@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    36
    ·
    edit-2
    9 months ago

    That’s how it feels with alot of self-hosted AI stuff now. Even the youtube videos out there that start off with, “Hey guys, I’m gonna show you this super simple, easy way you can run your own self-hosted LLM. First pull up terminal…” and proceeds to spend a half-hour going over some kind of basic coding and cloning repos that’s still way above my head. Is it Git? Is it python? Is it both, what the fuck is going on? I just wanted an uncensored AI model that will generate My Little Pony furry porn, not a master-class in writing a bunch of seemingly random nonsensical commands.

    • drcobaltjedi@programming.dev
      link
      fedilink
      arrow-up
      27
      arrow-down
      2
      ·
      9 months ago

      Step 1) Download the LLM with git

      Well, fuck we should have known that this requires a masters in computering. Dude these comands are easy, literally copy and paste. The instructions are literally handholding you to run it and thats still to complicated. Also who makes furry porn with a Large Language Model?

      • Specal@lemmy.world
        link
        fedilink
        arrow-up
        4
        arrow-down
        1
        ·
        9 months ago

        You made me chuckle. But let’s all agree that learning to use git is a ball ache and isn’t very intuitive. Throw repositories into the mix and lay people just aren’t gonna get it. I think using git should be taught in highschool IT classes though, most people will never use it, but it will massively help those who do need to learn it.

        • drcobaltjedi@programming.dev
          link
          fedilink
          arrow-up
          3
          ·
          9 months ago

          Frequently repos say “git clone [repo url]” which i think is enough for most people to copy and paste. I’m a programmer and usually I just click things in my IDE to do git work for me so I’ll agree its not an easy thing to use.

    • andrai@feddit.de
      link
      fedilink
      arrow-up
      14
      arrow-down
      2
      ·
      9 months ago

      Just install stable diffusion via command line and download the models and Loras from civitai. It’s really that simple.

    • KeenFlame@feddit.nu
      link
      fedilink
      arrow-up
      1
      arrow-down
      2
      ·
      9 months ago

      I gotchu

      LM studio

      Thank me later. If you wanted the drawing shit then like that other guy said install Automatic1111

      • paddirn@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        9 months ago

        Yeah, I’ve been messing around with LM Studio for a few weeks/months now and compared to the alternatives, that’s about the easiest thing out there. Setup through Command Line seems to be the norm outside of that. I was just messing around with trying to install the ChromaDB plugin for LM Studio and ran into that issue of the command line again. Like I don’t know if they’re talking about just the generic Windows Command Line program, if Git needs to be installed, is it in a python environment or does python need installed, and the guides I’ve tried going through seem to just skip over these basic steps and just assume you already know exactly what they’re talking about, that seems like a regular thing, just not enough preliminary explanation.

        Like, I’ve had some experience with coding over the years in various languages, but I’m used to a certain amount of hand-holding for basic guides, something like, “You’ll need this installed from here, go ahead and load up this thing, blah blah blah.” In most of the tutorials I’ve been seeing for anything related to LLMs or AI image generators or whatever, there’s just rarely any acknowledgement of complete newbies to the process, it’s just assumed you know everything they’re talking about already. I realize it’s alot of copy/pasting and it’s pretty straight-forward, but it feels like many guides are just glossing over really basic need-to-know info.

        • KeenFlame@feddit.nu
          link
          fedilink
          arrow-up
          1
          arrow-down
          1
          ·
          9 months ago

          That’s cause it changes all the time, so it’s very hard to maintain these things. Literally every day a new paradigm shift comes out kinda