{"product_id":"generative-ai-on-kubernetes-operationalizing-large-language-models-9781098171926","title":"Generative AI on Kubernetes: Operationalizing Large Language Models","description":"\u003cp\u003eGenerative AI is revolutionizing industries, and Kubernetes has fast become the backbone for deploying and managing these resource-intensive workloads. This book serves as a practical, hands-on guide for MLOps engineers, software developers, Kubernetes administrators, and AI professionals ready to combine AI innovation with the power of cloud native infrastructure. Authors Roland Hu  and Daniele Zonca provide a clear road map for training, fine-tuning, deploying, and scaling GenAI models on Kubernetes, addressing challenges like resource optimization, automation, and security along the way.\u003c\/p\u003e \u003cp\u003eWith actionable insights with real-world examples, readers will learn to tackle the opportunities and complexities of managing GenAI applications in production environments. Whether you're experimenting with large-scale language models or facing the nuances of AI deployment at scale, you'll uncover expertise you need to operationalize this exciting technology effectively.\u003c\/p\u003e \u003cul\u003e\n\u003cli\u003eLearn how to deploy LLMs more efficiently with optimized inference runtimes\u003c\/li\u003e \u003cli\u003eGet hands-on with GPU scheduling, including hardware detection and multinode scaling\u003c\/li\u003e \u003cli\u003eMonitor and understand LLM-specific metrics like Time to First Token and token throughput\u003c\/li\u003e \u003cli\u003eKnow when to fine-tune a model or when retrieval augmentation is the better choice\u003c\/li\u003e \u003cli\u003eDiscover how to evaluate models with standardized benchmarks before committing GPU resources\u003c\/li\u003e \u003cli\u003eLearn to run agentic applications with secure tool integration, identity management, and persistent state\u003c\/li\u003e\n\u003c\/ul\u003e\u003cbr\u003e\u003cbr\u003e\u003cbr\u003e\u003cb\u003eAbout the Author\u003c\/b\u003e\u003cbr\u003e\u003cb\u003e\u003ci\u003eHuß, Roland:\u003c\/i\u003e\u003c\/b\u003e - Dr. Roland Huss is a seasoned software engineer with over 25 years of experience in the field. Currently working at Red Hat, he is the architect of OpenShift Serverless and a former member of the Knative TOC. Roland is a passionate Java and Golang coder and a sought-after speaker at tech conferences. An advocate of open source, he is an active contributor and enjoys growing chili peppers in his free time.\u003cb\u003e\u003ci\u003eZonca, Daniele:\u003c\/i\u003e\u003c\/b\u003e - Daniele Zonca is a Senior Principal Software Engineer and Architect for model serving of Red Hat OpenShift AI, Red Hat's flagship AI product combining multiple stacks.","brand":"O'Reilly Media","offers":[{"title":"Default Title","offer_id":52160358285586,"sku":"9781098171926","price":43.99,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0831\/4771\/8930\/files\/img_425bdb56-afc8-4883-938e-ebd1cce81d19.jpg?v=1775055201","url":"https:\/\/surprise-castle.myshopify.com\/products\/generative-ai-on-kubernetes-operationalizing-large-language-models-9781098171926","provider":"Surprise Castle","version":"1.0","type":"link"}