Red Hat announced plans to acquire Neural Magic, a company that specializes in generative AI performance engineering, model optimization algorithms, and high-performance GPU and CPU inference serving.
Neural Magic was spun out of MIT in 2018, and it offers software and algorithms that accelerate generative AI inference workloads. Its expertise in large language models along with Red Hat’s ability to support these models across the hybrid cloud aligns with Red Hat’s stated goal of making gen AI more accessible to more organizations.
Red Hat intends to democratize the power of AI through open-source-licensed models that can run anywhere. This will enhance organizations’ abilities to customize large language models, use inference performance engineering for infrastructure efficiency, and partner in the open-source ecosystem to enable broader choices for hardware and chip architecture.
