Intel AMX accelerated patterns increase AI performance while reducing cost

We are very excited to share that Red Hat has partnered with Intel to deliver not one, but two Red Hat Validated Patterns using Intel® Advanced Matrix Extensions (Intel® AMX) an integrated accelerator on 4^th and 5^th Generation Intel® Xeon® Scalable processors that increases performance for deep-learning inference and training.

The goal of Red Hat Validated Patterns is not only to facilitate testing and deployment of complex patterns, but to demonstrate business value by incorporating real-world workloads and use cases. Our extensive partner ecosystem allows us to provide our consumers with a catalog of real deployment architectures that help to accelerate a proof of concept to production, affording decision makers with an informed strategic blueprint that helps to overcome technological challenges.

Artificial Intelligence (AI) is a common component in several Validated Patterns. The ability to accelerate image recognition, anomaly detection, and AI inference pipelines drives faster innovation in this revolutionary technology shift. With a focus on enhancing AI workloads, Intel integrated their AMX technology with two Validated Patterns—Medical Diagnosis and MultiCloud GitOps. By using the Red Hat Node Feature Discovery (NFD) operator,the engineers targeted and properly scheduled the pattern deployment onto the Intel cluster nodes. With the Medical Diagnosis pattern, Intel was able to demonstrate significantly faster inference of x-ray images at the edge. For the MultiCloud GitOps pattern, the use of Intel® AMX accelerators can provide up to 10x acceleration for inference speeds over previous generation Intel Xeon Scalable Processors.

Together with other Intel technologies, such as Intel® AI Tools and the OpenVINO™ Toolkit Operator, organizations are poised to advance the benefits of their investment in AI and machine learning (ML). A cornerstone partner for Red Hat OpenShift AI, Intel proves to be an invaluable contributor in this space in addition to other critical business initiatives.

Built-in accelerators are a revolutionary chip technology feature in Intel 4^th and 5^th Generation Xeon Scalable Processors with significant promise in addressing real-world workloads, such as network and storage encryption and compression, trusted domains and application security extensions, enhanced processing capacity for data-intensive workloads, and more. Read more about the Intel AMX integration with Validated Patterns in Intel’s recently released reference architecture, and get the documentation for Intel AMX Accelerated MultiCloud GitOps, and Intel AMX Accelerated Medical Diagnosis. This is just the beginning. Intel is currently integrating additional built-in accelerators for Intel® Xeon® processors with Red Hat Validated Patterns. Keep an eye out for new reference architectures featuring other business critical workloads and find additional information and review our catalog of Red Hat Validated Patterns at https://validatedpatterns.io