How DPUs are Changing Data Centers

Data processing units are gaining favor as they are used to accelerate AI and ML workloads by offloading tasks such as neural network inference and training from CPUs and GPUs.

Bob Wallace, Contributor

August 1, 2024

1 Min Read
Data processing unit image illustration
Image: Alamy

Change is a constant in the technology industry. The newest entity in town that is revamping data centers is the data processing unit (DPU).

Why? The DPU is at the core of a rearchitect of processing power where servers have expanded well beyond a central processing unit (CPU) to a series of specialty processors, each offloading a specific set of tasks so the CPU can fly.

By offloading lifeblood data handling functions from central processor units (CPU), DPUs are driving a data center makeover that can cut the amount of electricity used for cooling by 30%, reducing the number of expensive servers needed while boosting performance.

Unraveling the Magic of DPUs

DPUs are devices that give data center operators the ability to revamp operations and realize large resulting benefits in reduced energy costs and server consolidation while boosting server performance. The DPUs help data center servers handle and enhance new and emerging workloads.

Today, with far more distributed workloads and applications are more distributed, they are composed of unstructured data such as text, images, and large files. They also use microservices that increase east-west workload traffic across the data center, edge, and cloud and require near real-time performance.

Related:Understanding the Role of Network Taps in Data Center Observability

All this requires more data handling by infrastructure services without the expense of taking computing resources away from their crucial goal of supporting daily business applications.

Continue reading this article in Network Computing.

Read more about:

Network Computing

About the Author

Bob Wallace

Contributor, Network Computing

A veteran business and technology journalist, Bob Wallace has covered networking, telecom, and video strategies for global media outlets such as IDG and UBM. He has specialized in identifying and analyzing trends in enterprise and service provider use of enabling technologies. Most recently, Bob has focused on developments at the intersection of technology and sports. A native of Massachusetts, he lives in Ashland. 

Subscribe to the Data Center Knowledge Newsletter
Get analysis and expert insight on the latest in data center business and technology delivered to your inbox daily.

You May Also Like