Overview & Specs
This unit is a portable mobile inference server with an adjustable 16GB of GDDR6 which can be allocated in different proportions between the GPU and CPU in the Bios settings.
The unit is ASRock with an AMDGPU - the equivalent of an AMD RX6700XT. The GPU and CPU have been successfully separated within the APU for compute/AI so the system sees a CPU and an AMD RX6700XT (GFX 1030) in ROCm.
The unit is liquid cooled and runs very fast as it has a powerful 16GB of GDDR6 feeding the CPU and GPU along with gen 4 nvme for storage.
This inference server is capable of running/serving models in ollama and performing just about all the functions and a few more of machines much larger than it's size. It definitely holds its own and then much more. This is one impressive machine. Please message with any questions and we will be glad to answer.
Similar listings
Shipping & Returns
Portable Mobile Inference Server GDDR6
Overview & Specs
This unit is a portable mobile inference server with an adjustable 16GB of GDDR6 which can be allocated in different proportions between the GPU and CPU in the Bios settings.
The unit is ASRock with an AMDGPU - the equivalent of an AMD RX6700XT. The GPU and CPU have been successfully separated within the APU for compute/AI so the system sees a CPU and an AMD RX6700XT (GFX 1030) in ROCm.
The unit is liquid cooled and runs very fast as it has a powerful 16GB of GDDR6 feeding the CPU and GPU along with gen 4 nvme for storage.
This inference server is capable of running/serving models in ollama and performing just about all the functions and a few more of machines much larger than it's size. It definitely holds its own and then much more. This is one impressive machine. Please message with any questions and we will be glad to answer.