Not upgrading just taking notes.

I got a rasberry pi 5 running most of my services now, and it’s doing fine. Usually for my movies and stuff I go to streaming sites, legal ofc *cough *cough, but down the line I intend to build a media server too.

The stuff I got laying arround wont do much with upgrades. So if I indeed wanted to upgrade my setup and run a media server + some AI stuff, I think I would be better off just buying a nvidia jetson SBC than building a tower from scratch.

What do u guys think?

  • halfwaythere@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    5 months ago

    Yeah. This was obviously wishful thinking. It was also my knee jerk reaction to jumping on to AI with minimal research. I figured that it would be better suited for the whisper tts/stt but it just didn’t run well. Then I attempted to throw HAOS various other versions of nix and that’s when I threw in the towel cause the bootloader seems to do a sig check on boot. If it’s not the Nvidia image it just hangs. Oh well. I now have an old comp running good enough to experiment with the likes of llama mixtral on just a 2070 with on average 2-3 sec delay. More if I ask too big of a question.

    • ransomwarelettuce@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      5 months ago

      Yeah I am realizing now that unless that someone stands up to NVIDIA with a somewhat competing product I am better off just building my own stuff.

      Honesty that speed is more than enough, I just use AI for coding, I dont mind reading docs while wainting a couple seconds.