This seems cool. I like to run my steam set up in a flatpak (in part because I don’t really like 32 bit binaries cluttering up my main paths) so I’ll wait h til they release it there. Or perhaps I’ll get involved and see if I can’t package this up myself.
Bookmarked and will come back to this. One thing that may be if interest to add is for AMD cards with 20gb of ram. I’d suppose that it would be Qwen 2.5 34B with maybe less strict quant or something.
Also, it may be interesting to look at the AllenAI molmo related models. I’m kind of planning to do this myself but haven’t had time as yet.