In the next ~6 months I’m going to entirely overhaul my setup. Today I have a NUC6i3 running Home Assistant OS, and a NUC8i7 running OpenMediaVault with all the usual suspects via Docker.

I want to upgrade hardware significantly, partially because I’d like to bring in some local LLM. Nothing crazy, 1-8B models hitting 50tps would make me happy. But even that is going to mean a beefy machine compared to today, which will be nice for everything else too of course.

I’m still all over the place on hardware, part of what I’m trying to decide is whether to go with a single machine for everything or keep them separate.

Idea 1 is a beefy machine and Proxmox with HA in a VM, OMV or TrueNAS in another, and maybe a 3rd straight Debian to separate all the Docker stuff. But I don’t know if I want to add the complexity.

Idea 2 would be beefy machine for straight OMV/TrueNAS and run most stuff there, and then just move HA over to the existing i7 for more breathing room (mostly for Frigate, which could also separate to other machine I guess).

I hear a lot of great things about Proxmox, but I’m not sold that it’s worth the new complexity for me. And keeping HA (which is “critical” compared to everything else) separated feels like a smart choice. But keeping it on aging hardware diminishes that anyway, so I don’t know.

Just wanting to hear various opinions I guess.

  • hperrin@lemmy.ca
    link
    fedilink
    English
    arrow-up
    0
    ·
    3 days ago

    It’s great if you need what it offers. Otherwise, it’s simpler to set up something like Ubuntu Server.

    I use Proxmox to run my email service, https://port87.com/, because I can have high-availability services that can move around the different Proxmox hosts. It’s great for production stuff.

    I also use it to run my seedbox, because graphics in the browser through Proxmox is really easy.

    For everything else (my Jellyfin, Nextcloud, etc), I have a server that runs Ubuntu Server and use a docker compose stack for each service.

    • JAWNEHBOY@reddthat.com
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 days ago

      I had never heard of Port87 before, how do you like it? And I assume you pay no monthly fee by hosting your own domain?

        • SayCyberOnceMore@feddit.uk
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 day ago

          Interesting.

          I have an old free email provider that’s just passed the email service to another provider

          I’m looking to move because I used to be able to use <anything-at-all>@my-email.domain and I’m not sure I’ll be able to do that anymore

          I basically do what you’re doing - using email prefixes for the site I’m registering with… I even caught a company out once when I suddenly started getting spam from that email address. They’d sold my details…