Dell Technologies and Red Hat team up to

bring generative AI to PowerEdge servers

 

 

 

The two companies say the collaboration will help customers ramp up deployment of generative AI models across hybrid cloud environments

Dell Technologies and Red Hat are teaming up to bring the Red Hat Enterprise Linux AI (RHEL AI) to Dell’s PowerEdge servers, aiming to make it easier to develop, test and deploy generative AI models.

The idea is to help organizations to implement successful AI and machine learning strategies to scale their IT systems and power enterprise applications across their businesses.

The vice president and general manager of Red Hat’s Generative AI Foundation Model Platforms, Joe Fernandes, stated that “AI by nature requires extensive resources spanning enabled servers, compute power, and GPUs.”

It is crucial that businesses build on a platform that can grow with them and give them the flexibility to experiment and create AI-driven innovations as they assess and apply GenAI use cases.

“By collaborating with Dell Technologies to validate and empower RHEL AI on Dell PowerEdge servers, we are enabling customers with greater confidence and flexibility to harness the power of GenAI workloads across hybrid cloud environments and propel their business into the future.”

The duo said they’re providing a more consistent AI experience on optimized, AI-enabled hardware solutions, all delivered on RHEL AI on Dell PowerEdge. This involves continuously testing and validating hardware solutions, including Nvidia accelerated computing, with RHEL AI.

“In today’s fast-paced market, it is critical for organizations to be equipped with validated and trusted AI-enabled solutions to kick-start their GenAI use cases,” said Bob Pette, Nvidia‘s vice president, enterprise platforms.

“Red Hat and Dell will extend GenAI capabilities for customers with an optimized experience for Nvidia accelerated computing, including Nvidia H100 Tensor Core GPUs, with Dell PowerEdge servers and RHEL AI.”

RHEL AI brings together open source-licensed Granite large language models (LLMs) from IBM Research, InstructLab model alignment tools based on the Large-scale Alignment for chatBots (LAB) methodology, and a “community-driven approach” to model development through the InstructLab project.

The solution, which will be available in the third quarter of this year, is packaged as a bootable RHEL image for individual server deployments across the hybrid cloud.

Red Hat’s hybrid cloud machine learning operations (MLOps) platform, OpenShift AI, comes with it for using InstructLab and running models in distributed cluster scenarios.

According to Arun Narayanan, senior vice president of Dell Technologies, “validating RHEL AI for AI workloads on Dell PowerEdge servers provides customers with greater confidence that the servers, GPUs, and foundational platforms are tested and validated on an ongoing basis.”

“This simplifies the GenAI user experience and accelerates the process to build and deploy critical AI workloads on a trusted software stack.”