The latest AMD EPYC processors and performance in US servers

You see major changes in US server performance with the latest AMD EPYC processors. The 9005 and 9004 series use the new Zen 5 core architecture, delivering up to 17% better instructions per clock for enterprise and cloud workloads. These processors boost AI and high-performance computing by up to 37% over the last generation. You can achieve strong computing performance while using far less power and fewer servers. The 9004 series improves performance-per-system-watt by 2.7 times, which helps you lower energy costs and speed up business operations.
Key Takeaways
AMD EPYC processors deliver up to 17% better performance and 37% boost in AI tasks compared to previous generations.
High core counts and threads in AMD EPYC processors allow for efficient handling of parallel workloads, making them ideal for AI and data analytics.
Using AMD EPYC processors can significantly reduce energy costs, with up to 2.7 times better performance-per-watt, leading to lower operational expenses.
The latest EPYC models outperform Intel Xeon processors in benchmarks, providing better value for demanding workloads like cloud computing and virtualization.
Choosing the right AMD EPYC model based on workload requirements ensures optimal performance and scalability for future growth.
AMD EPYC processors: performance in US servers
Key metrics and benchmarks
When you evaluate server processors, you look at several important metrics. These include single-core performance, multi-core performance, and power efficiency. Each metric helps you understand how a processor will handle different workloads in your data center.
Metric | Description |
|---|---|
Single-core performance | Measures the speed of a single CPU core. This is important for tasks that do not use many threads. |
Multi-core performance | Shows the total processing power across all cores and threads. This matters for parallel workloads. |
Power efficiency | Assesses how much work you get for each watt of power. This is crucial for controlling energy costs. |
You can see how AMD EPYC processors perform by looking at real benchmark results. For example, the AMD EPYC 9754 processor in a dual-processor setup scored 229,471 on the Chaos V-Ray benchmark, which is the best overall score. The same processor also achieved 212,566 on the best 2 CPU Windows score. If you use a single processor, you still get a strong result of 125,970. For financial technology applications, the AMD EPYC 9374F reached a latency of just 2.0 ms and a throughput of 1,500,000 messages per second, which is excellent for high-speed trading.
Processor Model | Benchmark Type | Score | Notes |
|---|---|---|---|
AMD EPYC 9754 (2P) | Chaos V-Ray | 229,471 | Best overall score |
AMD EPYC 9754 (2P) | Chaos V-Ray | 212,566 | Best 2 CPU Windows score |
AMD EPYC 9754 (1P) | Chaos V-Ray | 125,970 | Best 1 CPU Windows score |
AMD EPYC 9374F (1P) | STAC N1 – UDP | 2.0 ms | Best 99P LAT1 latency for UDP 1 CPU |
AMD EPYC 9374F (1P) | STAC N1 – UDP | 1,500,000 | Best max msg/sec throughput for UDP 1 CPU |
AMD EPYC 9754 (2P) | VMmark 3.1.1 | 34.22 | Performance Only score |
AMD EPYC 9754 (2P) | VMmark 4.0 | 6.66 | Score for vSAN storage |
You also benefit from improvements over previous generations. The latest AMD EPYC processors deliver 50% higher throughput, 30% lower latency, and 20% better power efficiency. These gains help you run more applications, respond faster, and save on energy bills.
Metric | AMD EPYC (Latest) | Previous Generations | Improvement (%) |
|---|---|---|---|
Throughput | High | Moderate | 50% |
Latency | Low | High | 30% |
Power Consumption | Efficient | Less Efficient | 20% |
Tip: When you choose AMD EPYC processors, you can consolidate your infrastructure. This means you use fewer servers, which reduces space, rack, and administration costs. You also save on software licensing and energy, making your data center more sustainable.
Comparison with competitors
You want to know how AMD EPYC processors stack up against other server CPUs. In most US server benchmarks, AMD EPYC models outperform Intel Xeon processors, especially in multi-threaded and parallel workloads. This makes them a top choice for analytics, AI, and cloud computing.
Processor Model | Performance Benchmark (Approximate PassMark CPU Score) |
|---|---|
2 x AMD EPYC 9554 Genoa | 146,267 |
2 x AMD EPYC 9754 Bergamo | 130,188 |
2 x Intel Xeon Gold 6230 | 44,058 |
2 x Intel Xeon E5 2695v4 | 34,552 |
You see that AMD EPYC processors have much higher scores than their Intel Xeon counterparts. This advantage comes from higher core counts and better performance per watt. As a result, you can lower your total cost of ownership. You also gain more flexibility for demanding workloads like AI, virtualization, and large-scale analytics.
If you run a data center in the US, you will notice that AMD EPYC processors help you reduce operational costs. You can consolidate your servers, cut down on space and administration, and save up to 83% on power. You also benefit from lower software licensing costs and improved productivity.
AMD EPYC processors: core features
High core counts and threads
You gain a clear advantage when you choose processors with more cores and threads. AMD EPYC processors offer some of the highest core and thread counts available in the server market. This means you can run more tasks at the same time and handle larger workloads without slowing down. You see faster results in data analytics, virtualization, and cloud computing.
Processor Type | Typical Core Range | CPU Threads |
|---|---|---|
AMD EPYC | 32 to 96+ | 64 to 192+ |
Intel Xeon | 16 to 60+ | 32 to 120+ |
You notice that AMD EPYC processors deliver more cores and threads than Intel Xeon models. This helps you boost performance in US data centers. You can scale your applications and support more users with fewer servers.
Tip: If you run workloads that need high parallel processing, such as AI or scientific computing, you benefit from higher core counts. You can finish jobs faster and improve efficiency.
Memory and PCIe advancements
You need fast memory and strong connectivity to keep your servers running smoothly. AMD EPYC processors support advanced memory and PCIe features that help you move data quickly and connect more devices.
Feature | Details |
|---|---|
Memory Support | 12 DDR5 channels, speeds up to DDR5-6000 |
PCIe Support | Up to 128 PCIe Gen5 lanes |
Feature | Details |
|---|---|
Memory Support | DDR5-5200, up to 12 TB per socket |
PCIe Support | Up to 160 PCIe lanes per socket |
You can use up to 12 DDR5 memory channels and reach speeds up to DDR5-6000. This gives you more bandwidth for demanding workloads. You also get up to 160 PCIe lanes per socket, which lets you connect more storage drives, GPUs, and network cards. You see faster data transfers and lower bottlenecks in your server environment.
Note: High memory bandwidth and PCIe lane counts help you run large databases, AI models, and high-speed networking. You can support more users and applications without delays.
Energy efficiency and Zen architecture
You want your servers to use less power and deliver more performance. AMD EPYC processors use the Zen architecture, which improves energy efficiency and reduces operating costs.
The 4th Gen AMD EPYC processors show major gains in power efficiency compared to older models and other brands.
You achieve up to 2.7x greater performance-per-watt in tasks like integer calculations, floating point operations, and natural language processing.
The EPYC 9654 processor leads energy efficiency benchmarks, including SPECpower_ssj®2008 and SPECrate®2017_fp_energy_base.
You lower your energy bills and reduce your carbon footprint when you deploy AMD EPYC processors in your US data center. You can run more workloads with less power and keep your infrastructure sustainable.
Callout: If you want to build a green data center, you should consider processors with high performance-per-watt. This helps you meet energy goals and save money.
EPYC lineup overview
9005 and 9004 series highlights
You see major improvements in the latest AMD EPYC processors. The 9005 and 9004 series bring higher core counts, advanced memory support, and strong I/O capabilities. These processors use AMD’s Zen architecture, which boosts efficiency and performance. You can scale your server workloads with chiplet design, making it easier to handle demanding tasks like AI and cloud computing.
Feature | Description |
|---|---|
Core Count | Up to 96 cores, suitable for demanding workloads |
Memory Support | 12 DDR5-4800 channels, up to 6TB |
I/O Capabilities | Up to 128 PCIe 5.0 lanes, enhancing data access |
Cache | Up to 1152MB L3 cache with 3D V-Cache |
Architecture | Built on AMD’s Zen framework for efficiency |
Chiplet Design | Enhances scalability and performance |
Target Workloads | AI, cloud computing, virtualization |
You notice that the 9005 and 9004 series offer much higher core and thread counts compared to previous models. This helps you run more applications at once and supports larger workloads.
Processor Model | Cores | Threads |
|---|---|---|
AMD EPYC 9005 | 192 | 384 |
AMD EPYC 9004 | 128 | 256 |
AMD EPYC 7003 | 64 | 128 |
If you need servers for hyperscale environments or massive data analytics, you benefit from these high core counts and memory channels.
Model selection for US workloads
You want to choose the right processor for your server needs. You should look at several criteria to make the best decision.
Criteria | Description |
|---|---|
Performance Benchmarks | Evaluate the performance of processors using industry-standard benchmarks. |
Core Count | Consider the number of cores required for specific workloads. |
Thermal Design Power (TDP) | Assess the power consumption and heat generation of the processor. |
Total Cost of Ownership (TCO) | Analyze the overall cost implications of using a specific processor over its lifespan. |
Workload Requirements | Understand the specific needs of the workloads to be run on the server. |
Future Growth Projections | Consider potential future demands and scalability of the server workloads. |
You see different AMD EPYC models used in US data centers. Each model fits a specific use case.
Model | Cores | Threads | Typical Use Cases |
|---|---|---|---|
EPYC 7702 | 64 | 128 | High-density virtualization, large-scale SaaS platforms |
EPYC 7713 | 64 | 128 | High-density virtualization, large-scale SaaS platforms |
EPYC 7742 | 64 | 128 | High-density virtualization, large-scale SaaS platforms |
EPYC 9754 | 128 | 256 | Hyperscale cloud environments, massive data analytics |
EPYC 9374F | 32 | 64 | Workloads requiring high single-threaded performance |
Tip: If you run AI, virtualization, or analytics, select a processor with higher core counts and memory channels. For SaaS or high-density virtualization, models with 64 cores work well. For massive analytics or cloud, choose models with 128 or more cores.
EPYC in US data centers
Real-world benchmarks
You want to see how these processors perform in actual US data centers. Benchmark data from American providers shows clear advantages. For example, the SPECrate2017_int_base score highlights the difference in processing power:
Processor Type | SPECrate2017_int_base Score |
|---|---|
AMD EPYC 9654 (96 cores) | 1790 |
Intel Xeon Platinum 8490H (60 cores) | 991 |
You get almost double the performance with the AMD EPYC 9654 compared to a top-tier Intel Xeon. When running the TPCx-AI SF30 benchmark, you see 1.65 times the performance per server compared to two high-end 64-core Xeon CPUs. This means you can handle more tasks with fewer servers.
You also save money. Over three years, the total cost of ownership drops by over $2.5 million, which is 62% lower than other options. Your annual operating costs can fall by $1.2 million, or 93%. These savings come from higher performance and lower power use. The architecture of these processors lets you do more work at lower clock speeds, which maximizes performance per watt.
You get higher compute power with less energy use.
You reduce cooling needs, which helps your data center stay efficient.
You can deploy more virtual machines per rack unit.
Case studies: cloud and enterprise
You can see the impact of these processors in real deployments. Kakao Enterprise switched to AMD EPYC CPUs and saw big improvements:
Feature | Details |
|---|---|
Company | Kakao Enterprise |
Deployment | AMD EPYC CPUs |
Benefits | 50% lower TCO, 40% fewer servers, 30% more performance, 50% less power |
Future Plans | Moving to 96-core 4th Gen CPUs for high-density servers |
Rackspace Technology also uses these processors in Dell PowerEdge R-series servers. You get more CPU cores and better performance without needing more space. This helps you grow your business while keeping your data center footprint the same.
You benefit from advanced process technology, high core density, and strong memory bandwidth. These features support cloud, hosting, and enterprise workloads. You can run more virtual machines, support AI and analytics, and keep your hardware running longer. You also help your company meet sustainability goals by lowering emissions per unit of compute.
Best use cases for EPYC in US servers
AI and machine learning
You can accelerate AI and machine learning workloads with AMD EPYC processors. These processors feature high core counts, which help you run parallel tasks quickly. You benefit from extensive memory support and high bandwidth, which are important for generative AI and deep learning. PCIe 4.0 and 5.0 support enables rapid data transfers, making model training and inference faster. Servers equipped with these processors handle AI pipelines efficiently and deliver strong performance for tasks like image recognition and natural language processing.
Tip: If you need to train large AI models or run inference tasks, choose servers with high memory bandwidth and PCIe lanes.
High core counts for parallel processing
Extensive memory support for data-intensive workloads
Rapid data transfers for efficient AI model training
Data analytics
You can boost your data analytics operations with AMD EPYC processors. These processors are engineered for environments that require high core density and performance. You see significant improvements in big data analytics, high-performance computing, and large-scale virtualization. They excel in managing large database environments and cloud workloads.
Feature | AMD EPYC | Intel Xeon |
|---|---|---|
Core Count | High | Moderate |
Performance for Large | Significant improvement | Limited |
Workloads |
You gain faster results when processing large datasets. These processors optimize AI training, inference, and database operations, which are critical for analytics.
Note: For big data analytics, select processors with high core density and strong memory bandwidth.
High I/O and virtualization
You can improve virtualization and high I/O tasks with AMD EPYC processors. These processors are specifically tailored for modern workloads in data centers. High memory bandwidth supports efficient data handling for virtualization. Optimized I/O performance makes them suitable for demanding server environments.
Feature | Description |
|---|---|
Core Density | High core density allows for better scaling in cloud and virtualization environments. |
NVMe Drive Support | Supports a large number of NVMe drives, enhancing storage capabilities. |
High-Speed NICs | Integration of high-speed network interface cards for improved networking performance. |
GPU Support | Compatibility with GPUs for AI and high-throughput tasks. |
You can scale your cloud applications and run more virtual machines per server. You also benefit from improved storage and networking, which helps you support enterprise workloads.
Callout: If you manage virtualization or high I/O environments, look for processors with high core density and NVMe drive support.
Choosing the right EPYC model
Workload-based recommendations
You need to match your server processor to your workload. Different tasks require different strengths. For example, machine learning and recommendation systems benefit from CPUs that handle branching logic and structured data. Natural language processing works best with high core counts, especially for real-time applications. Generative AI and collaborative prompt-based pre-processing often use CPUs for small and medium models, supporting both batch and real-time inference.
Workload Type | Recommendation |
|---|---|
Classical Machine Learning | CPUs are efficient for handling scalar operations and branching logic, making them suitable for structured datasets. |
Recommendation Systems | CPUs provide flexibility and low latency memory access, ideal for processing diverse datasets. |
Natural Language Processing | High core count CPUs can handle multiple instances, offering good price-performance for real-time applications. |
Generative AI Including Language Models | Small and medium language models run efficiently on CPUs, supporting real-time inference and batch processing. |
Collaborative Prompt Based Pre-Processing | Small models for pre-processing are well-suited for CPUs, often used alongside GPUs for larger workloads. |
Tip: You should select a processor based on the specific needs of your workload. High core counts and memory bandwidth help you run demanding applications smoothly.
Scalability and future-proofing
You want your server infrastructure to grow with your business. AMD EPYC processors are designed for demanding workloads like AI training, big data analytics, and high-performance computing. You can scale from small virtual environments to large clusters. These processors offer high core counts and extensive memory resources. PCIe 5.0 support lets you connect faster storage and networking devices. AMD’s Zen roadmap ensures that your servers stay current with new technology. You can upgrade and expand without replacing your entire infrastructure.
Note: You gain flexibility and long-term value when you choose processors that support future upgrades. This helps you meet new challenges and keep your data center efficient.
You gain strong performance, efficiency, and versatility with AMD EPYC processors in US servers. These CPUs optimize memory use, lower total cost of ownership, and support both traditional and AI workloads. You can modernize your infrastructure, reduce server count, and adapt to future demands.
Leadership in performance and energy efficiency
High memory capacity and security features
Seamless handling of evolving workloads
To select the right EPYC model, follow these steps:
Audit your environment and resources
Identify memory-sensitive workloads
Right-size your memory provisioning for cost and performance
You should also plan for future expansion and choose scalable architecture.
FAQ
What workloads benefit most from AMD EPYC processors?
You see the best results in AI, data analytics, virtualization, and cloud computing. These processors handle parallel tasks well and support high memory bandwidth.
Tip: Choose EPYC for workloads that need many cores and fast data movement.
How do AMD EPYC processors help reduce energy costs?
You use less power because EPYC processors deliver high performance-per-watt. This efficiency lowers your electricity bills and cooling needs.
Feature | Benefit |
|---|---|
Power Savings | Lower energy cost |
Less Heat | Reduced cooling |
Are AMD EPYC processors secure for enterprise use?
You get advanced security features like AMD Infinity Guard. These features protect your data and help you meet compliance standards.
Memory encryption
Secure boot
Hardware root of trust
Can you upgrade your servers easily with EPYC?
You can scale your infrastructure by adding more cores or memory. EPYC supports future upgrades with PCIe 5.0 and DDR5.
Note: Plan for growth by choosing a model that matches your long-term needs.
