Generative AI on Kubernetes: Operationalizing large language models -- Virtualization Review

Generative AI on Kubernetes: Operationalizing large language models

Taking generative AI models into production requires reliable infrastructure for serving, scaling, and managing workloads. This O’Reilly resource explores how Kubernetes can support the deployment and operation of large language models and other generative AI systems. Learn about the fundamentals of model inference, production deployment patterns, and tools from the cloud-native AI ecosystem. With technical explanations and practical examples, the guide helps engineers and platform teams understand the operational considerations involved in delivering AI inference at scale.

Download now!

Email Address:

First Name

Last Name

Job Title

Company

Country

Address

Department

City

State/Province

Postal Code

Foreign Province

Phone #

What is your job role?

What is your company's primary business?

How many employees are in your organization?

By downloading this resource, you agree that Red Hat and its partners may contact you by email about Red Hat products, services and offerings and other offers that may be of interest to you. Before deciding, please review Red Hat's privacy policy.YesNo

I agree to receive email communications from 1105 Media, Inc. containing news, updates and promotions regarding offers from select vendors. I understand that I can withdraw consent at any time.

Your e-mail address is used to communicate with you about your registration, related products and services, and offers from select vendors. Refer to our Privacy Policy for additional information.

Tracking enterprise infrastructure's evolution in the AI era

Generative AI on Kubernetes: Operationalizing large language models