A flagship platform for local training, fine-tuning, and inference of large language models (LLMs). A dual-processor server architecture with PCIe 5.0 minimizes bottlenecks and latency when working with PyTorch, DeepSpeed, vLLM, and TensorRT.
| Hardware | |
|---|---|
| GPU |
|
| CPU |
|
| Motherboard |
|
| RAM |
|
| Cooling |
|
| SSD |
|
| HDD |
|
| Power supply |
|
| Cases |
|
| Fans |
|
| Software | |
| OS |
|