戴尔PowerEdge R760人工智能服务器|英特尔至强白金 8592+ 64 核 | NVIDIA H100 80GB PCIe | 128GB DDR5
  • 产品分类:服务器
  • 零件编号:Dell PowerEdge R760 AI Server
  • 库存情况:In Stock
  • 状况:全新
  • 产品特色:准备发货
  • 最小订单:1单位
  • 原价:$67,899.00
  • 您的价格: $52,089.00 您节省了 $15,810.00
  • 立即咨询 发送邮件

安心无忧。接受退货。

运送:国际运输的商品可能会受到海关处理和额外费用的影响。 查看详情

配送:如果国际配送需要海关处理,请允许额外的时间。 查看详情

退货:14天内退货。卖家承担退货运费。 查看详情

免费送货。我们接受30天账期的采购订单。无需影响您的信用即可在几秒钟内获得决策。

如果您需要大量Dell PowerEdge R760 AI Server产品,请通过我们的免费电话Whatsapp: (+86) 178-3212-0331联系我们,或在在线聊天中请求报价,我们的销售经理会很快与您联系。

Dell PowerEdge R760 AI Server | Intel Xeon Platinum 8592+ 64-Core | NVIDIA H100 80GB PCIe | 128GB DDR5

Keywords

Dell PowerEdge R760, NVIDIA H100 PCIe, Intel Xeon Platinum 8592+, AI Inference Server, NVMe RAID Storage, High Performance Computing, Enterprise AI Hardware, Buy Dell R760

Description

Accelerate your artificial intelligence and machine learning initiatives with the Dell PowerEdge R760, a high-performance 2U rack server optimized for the most demanding workloads. This configuration is anchored by the 5th Generation Intel Xeon Platinum 8592+ processor. With a staggering 64 cores and 128 threads per socket, this CPU provides the immense serial processing power required to feed data pipelines efficiently. It serves as the perfect host for the star of this build: the NVIDIA H100 PCIe 80GB GPU. Unlike the SXM version, the PCIe form factor offers flexibility and ease of integration while still delivering ground-breaking performance for AI inference and fine-tuning tasks.

Memory bandwidth is critical in keeping the H100 GPU fed with data, and this system utilizes 128GB of next-generation DDR5 memory (4x 32GB). This setup ensures low latency and high throughput, essential for High Performance Computing applications. The storage subsystem is equally robust, featuring two 1.92TB NVMe SSDs configured in RAID 1. This NVMe RAID Storage architecture provides a perfect blend of performance and redundancy, offering nearly 2TB of usable, protected space for your operating system, models, and datasets, ensuring that a single drive failure does not interrupt your critical AI workflows.

Connectivity is handled by a dual-port 10Gb/s LAN interface, providing sufficient bandwidth for data ingestion and management traffic. The R760 chassis is specifically designed with "Smart Flow" cooling technology to manage the thermal output of high-wattage components like the H100 and the 350W+ Platinum processor, ensuring sustained performance without throttling. This Enterprise AI Hardware is built to run 24/7 in data center environments, supported by Dell’s legendary reliability and management tools.

Whether you are deploying Large Language Models (LLMs) for inference, running complex simulations, or managing heavy virtualization stacks, this server offers a scalable foundation. When you Buy Dell R760 configured with the H100, you are securing a future-proof asset capable of handling the rapid advancements in generative AI technology.

Key Features

  • Top-Tier Acceleration: 1x NVIDIA H100 80GB PCIe GPU for dominant AI inference and acceleration.
  • Extreme CPU Core Count: Intel Xeon Platinum 8592+ (64 Cores / 128 Threads, 5th Gen) for massive parallel processing.
  • DDR5 Memory Architecture: 128GB (4x 32GB) DDR5 RAM ensures rapid data access for the CPU and GPU.
  • Resilient Storage: 2x 1.92TB NVMe SSDs in RAID 1 offer speed and data mirroring protection.
  • High-Speed Networking: 2x 10Gb/s LAN ports for fast network integration.
  • Optimized Cooling: Designed with high-performance fans to support high-TDP PCIe GPUs.
  • Expansion Ready: 2U form factor with available PCIe slots for future upgrades.

Configuration

Component Specification
Model Dell PowerEdge R760
GPU Accelerator 1x NVIDIA H100 80GB PCIe Gen5
Processor (CPU) 1x Intel Xeon Platinum 8592+ (64 Cores, 1.9GHz Base, 350W, 5th Gen)
Memory (RAM) 128GB Total (4x 32GB DDR5 ECC RDIMM)
Storage 2x 1.92TB Enterprise NVMe SSD (Configured in RAID 1)
Networking Dual Port 10GbE Network Adapter (Base-T or SFP+)
Form Factor 2U Rackmount

Compatibility

The Dell PowerEdge R760 is a 16th Generation server built on the Intel chipset, supporting 4th and 5th Gen Intel Xeon Scalable processors. It is fully certified for NVIDIA AI Enterprise, ensuring seamless driver and software support for the H100 GPU. Compatible operating systems include Ubuntu Server 22.04 LTS, Red Hat Enterprise Linux 9, and Windows Server 2022. The system supports PCIe Gen5, allowing the H100 to operate at full bandwidth. Note: This chassis is not compatible with AMD EPYC processors (requires model R7625).

Usage Scenarios

This configuration is an ideal AI Inference Node. The NVIDIA H100 PCIe card is powerful enough to serve requests for massive models like Llama 3 or Mixtral in real-time. The 64-core Intel CPU handles the pre-processing of user requests and API management, while the NVMe storage ensures model weights are loaded into VRAM instantly.

It is also well-suited for Scientific Simulation and Research. Applications in physics, chemistry, and genomics that utilize CUDA acceleration will benefit from the double-precision performance of the H100, while the 128GB of system RAM keeps the simulation environment stable.

For Virtual Desktop Infrastructure (VDI) with high-end graphics requirements, this server can support multiple "Power User" profiles. By using NVIDIA vGPU software, the H100 resource can be sliced and shared among data scientists or engineers who need GPU acceleration for their virtual workstations.

Frequently Asked Questions

Q: Can I use an AMD EPYC processor in the R760?
A: No, the "R760" model number specifically designates an Intel-based system. If you require the AMD EPYC 9004 processor mentioned in your options, you would need the **Dell PowerEdge R7625** chassis. The rest of the components (H100, RAM, NVMe) remain compatible with both chassis types.

Q: What is the difference between H100 PCIe and H100 SXM?
A: The PCIe version installed in this server uses a standard expansion slot, making it easier to install, cool, and deploy in standard servers. The SXM version requires a specialized motherboard (like in the Dell XE9680) and offers higher NVLink bandwidth between multiple GPUs, but the PCIe version is sufficient for single-GPU or dual-GPU inference workloads.

Q: Is 128GB of RAM enough for the H100?
A: For many inference tasks, yes. However, if you are doing heavy training or handling extremely large datasets that must reside in system memory before moving to the GPU, you might consider upgrading to 256GB or 512GB. The R760 supports significantly more RAM if needed.

Q: Does this server require special power cables?
A: Yes, with a 350W CPU and a 350W-400W GPU, this server will likely require high-wattage power supplies (1100W or 1400W) and C19/C20 heavy-duty power cables rather than standard C13/C14 cables. Please verify your rack's power distribution unit (PDU) capability.

与此商品相关的产品
H3C UniServer R4900 G5 2U 机架服务器 Xeon Silver 4310 64GB DDR4 8TB SATA 存储,带 LSI 9311-8i HBA,适用于企业数据中心和商业计算 推荐
Lenovo WA5480G3/ 2*散热风扇/ 2端口10G模块/ 4*2700W主机*1 /5418y CPU*2 / Rro 6000- 96GB *1 推荐
戴尔 PowerEdge R740XD2 2U 高密度存储服务器 |双至强银牌 4210,128GB DDR4,24×24TB 企业级硬盘,PERC H355 RAID,双 750W 冗余 PSU 适用于 NAS 和海量冷存储 推荐
Lenovo WR5480G3/ 2*冷却风扇/ 2端口10G模块/ 4*2700W主机*1 /5418y CPU*2 / Rro 6000- 96GB *1 推荐
联想 ThinkSystem HR650X 服务器 2x Xeon Silver 4214 64GB RAM 960G SSD 2x2.4T SAS EP400 双电源 推荐
Lenovo ThinkSystem SR680a V3 AI 服务器 8U 机架,配备 8 个 NVIDIA H200 141GB SXM5 GPU,适用于美国托管裸机部署 推荐
ThinkSystem SR665V3 2U 机架服务器 24 盘位 2.5 英寸企业服务器 推荐
Lenovo ThinkSystem SR650 V3 2U 机架服务器 - 双 Xeon Gold 6430、64GB DDR5、3.84TB SAS SSD、XCC2 和 1800W 冗余电源关键字 推荐