Good news selfhosted crowd! I pitched the idea of setting up a server, and she is down with the idea!
I want to run Linux and host things like Jellyfin, Audiobookshelf, Navidrome, maybe Plex (I currently host it off my Mac desktop but would move it to a dedicated server).
I know you can host Plex et al on something like a Raspberry Pi, but I want a bit more power. I want something that can push at least 2-3 4K streams.
I’m considering targeting 12th gen i5 with 16GB DDR4. Maybe 32GB if I can swing it. Is that overkill? I know you want 8th gen Intel for hardware transcoding of either x265/HEVC or AV1 (probably the former as the latter is newer).
There are other projects I’d like to run. I’d like to be able to host my own LLM/AI but I’m not trying to go performance overkill here. This would be my first server.
I am somewhat comfortable using the command line, and I would be remoting into the server via my Macs (I have a desktop and a MacBook). However, Linux can run Windows games via Proton and that’s something I’m interested in for some older titles that aren’t on Xbox (like Deus Ex, which came out in 2000 and should run on integrated graphics). I’m not inexperienced with Linux and have been using it off and on (mostly off unfortunately) for over 30 years. My go-to would be Ubuntu, but I’ve heard great things about KDE lately and I know the Internet is in love with Mint these days. Would the distro really matter all that much as long as I have the required services?
For distro I’d recommend God’s Chosen Stock Debian. You want prioritize smooth upgrade paths from one major version to another since the server should last a long ass time, and Debian is that. Debian has the eyes on it to make it chill and if there are things to do they’re caught and noted (and more often something is set up to just do it for you).
So no, distro doesn’t matter as long as you can get your software going. But you’re not going to beat the insane stability of Debian. Any OS based on it is just an echo, which may even involve custom kernels which add more work for the specific distro maintainers and may slow critical security updates.
I run no GUI but you can def have one. I just SSH in. I do everything in containers (Docker 1st and I’m moving to Podman - but Podman is too heavy a lift to start, Docker compose files are always right there, use em) and LXC containers run by Incus (it has a web gui as well!).
I’ve been looking at “games on whales” https://games-on-whales.github.io/ to stream games from a beefy server to weaker computers and tablets. Might be a good route for your games without having to directly game on the server.
I have a 4 core 7th gen Intel CPU and it seems fine with doing x265 transcoding on multiple streams, but I’ve never tried finding out how many 4K ones it can do at once. I have 32 GB of RAM (I bought cheapo laptop RAM before the true AI shitshow, praise be, stuck them in with a DIMM board cooked up by China). I had 16 before that, and it was fine. But I just kept adding services.
An LLM will eat your RAM, you’d want 32 GB to be able to run a 16 GB one. But a GPU will be much, much faster. LLMs are just matrix math - that’s why they’ll never be able to think for real - and GPUs are sicko good at that kinda math (cause screens are a matrix!). I don’t fuck with LLMs though, no ethics in that whole shitshow.
Good luck!
I second debian!
I initially had some trouble getting streamed games to use the integrated gpu while the server was headless. I’ve heard you can use a dummy plug into one of the hdmi ports, but I found that using “xrdp” as the remote desktop client works as well. I hope sharing this might save you the hassle evetually.