Vibryx

Adding external GPU to my AI box

Ok, this is pretty deep in the weeds of geekville, so if you don't know a q8 quant is, you probably want to skip this one. My current local AI server is an AMD Strix Halo 395+…