In the current AI market, the demand for scalable and secure deployments is increasing. Public cloud providers (AWS, Google, and Microsoft) are competing to provide GenAI infrastructure, driving the need for multi-cloud and hybrid cloud deployments. However, distributed deployments come with challenges, including: Complexity in managing multi-cloud environments. Lack of unified visibility across clouds. Inconsistent security and policy enforcement. F5 Distributed Cloud provides a solution by offering a seamless, secure, and portable environment for GenAI workloads across clouds. This lab will guide you through setting up and securing GenAI applications with F5 Distributed Cloud on AWS EKS and GCP GKE.

Explore the hidden dangers of prompt injection in Large Language Models (LLMs). This lab reveals how attackers manipulate LLMs to disclose private information and behave in ways that they were not intended to. Discover the intricacies of direct and indirect prompt injection and learn to implement effective guardrails.

NVIDIA NIM revolutionizes AI deployment by encapsulating large language models in a scalable, containerized microservice. Seamlessly integrate with Kubernetes for optimized GPU performance, dynamic scaling, and robust CI/CD pipelines. Simplify complex model serving, focusing on innovation and intelligent feature development, ideal for enterprise-grade AI solutions.

In this lab a customer will deploy the Daily Ops Summary Agent on the HPE Private Cloud AI instance in the ATC. The Daily Ops Summary Agent is built on top of the NVIDIA NeMo Agent Toolkit and leverages Open AI OSS NIMs under the hood. Leveraging representative data from IT Ops Service Management Platform, the Daily Ops Summary Agent brings the most relevant information from both Incident and Change management into an intelligent report for operation specialists.

This lab provides the learner with a hands-on, guided experience of deploying the NVIDIA NIM for LLM microservice in Docker.

This lab will help users strengthen their prompt engineering skills using the prompt blueprint framework, which is a structured approach for writing effective prompts. Participants will refine prompts step by step and experiment with blueprint elements to achieve better model outputs.

Primary care and pediatric providers can spend significant time manually cross-referencing multiple sources to construct accelerated catch-up protocols for unvaccinated or under-vaccinated patients. The Pediatric Vaccine Assistant streamlines this workflow, reducing administrative burden and supporting evidence-based care.

This environment provides a highly performant environment to test the deployment and tuning of different NVIDIA NIMs and Blueprints.