You are viewing a single comment's thread:
Wow! That's a beast of an AI server, and a huge capital outlay at current prices.
My AI Home server is called "Poe" and only has one 32 Gb AMD r9700 AI Pro GPU. That's enough for my AI use.
It has 128Gb of DDR4 RAM on an Intel X99 motherboard that was left over from an old Hive server.
Apart from the GPU, most of the rest of it is 8 years old but it works well.
I'm glad I bought a lot of RAM years ago. My 6 year old 64Gb M1 Max Macbook Pro is great for AI with excellent memory bandwidth. It would cost me 2.5x as much as I paid to replace it with an equivalent.