The AI revolution is here and it's hungry for power, space and cooling that most data centers simply weren't built to provide. This isn't about future proofing. It's about survival in a landscape where power demands are skyrocketing beyond what most facilities were ever designed to handle.

As AI moves from predictive analytics to real-time autonomous decision-making, enterprises face a critical challenge: scaling AI securely and efficiently. This episode of the AI Proving Ground Podcast explores key takeaways from NVIDIA GTC, the evolving Cisco-NVIDIA partnership and the foundational role AI infrastructure plays in unlocking enterprise-scale AI. Featuring WWT VP of Networking and AI Solutions Neil Anderson, NVIDIA SVP of Networking Kevin Deierling and Cisco SVP of Networking Kevin Wollenweber, the episode covers insights into networking, security, and compute innovations, and how Cisco, NVIDIA and WWT are shaping the future of AI-powered businesses.

WWT's Matt Halcomb unboxes the highly anticipated Dell PowerEdge XE9680 system, also known as the Dell HGX. See how this system, part of the Dell Validated Designs for GenAI with NVIDIA, fits into WWT's AI Proving Ground lab environment.

Welcome to part 2 about our RAG lab infrastructure built in collaboration with NetApp, NVIDIA, and WWT. NVIDIA NIM microservices is a suite of user-friendly microservices that facilitate the deployment of generative AI models, such as large language models (LLMs), embeddings, re-rankings, and others, across various platforms. NVIDIA NIM microservices simplify the process for IT and DevOps teams to manage LLMs in their environments, providing standard APIs for developers to create AI-driven applications like copilots, chatbots, and assistants. It leverages NVIDIA's GPU technology for fast, scalable deployment, ensuring efficient inference and high performance.

Take a tour of the NVIDIA DGX B200. Technical Solutions Architect, Chris Braun, explains the new features of the NVIDIA Blackwell chipset. We will showcase how we are leveraging the NVIDIA DGX B200 to build learning paths, articles, proof of concepts, and discuss the use cases for educating our clients and internal staff.

In this technology demonstration, we will showcase the deployment of an AI workload using Cisco Intersight automation on a single UCS X-Series blade, leveraging a neighboring X440p (X-Fabric) with an NVIDIA A40 GPU. This demo will highlight the powerful capabilities of both Cisco Intersight and the Cisco AI Toolkit, which includes tools for AI model deployment, system monitoring, and resource management. By utilizing Miniconda for environment management, CUDA for GPU acceleration, and various large language models like Vicuna and Meta OPT, we will feed data into a retrieval-augmented generation (RAG) model.

Matt Halcomb, Principal Solutions Architect, gives a behind the scene look into the Liqid environment in the AI Proving Ground.

Phillip Hendrickson, a leader in high-performance computing and artificial intelligence, is leveraging his PhD in computational neuroscience to reshape how we approach data analytics and generative AI workloads. In his latest insights, Hendrickson emphasizes the pivotal role of infrastructure in optimizing performance, advocating for a principle-based method to accurately size computing resources based on performance metrics and the complexities of neural networks. Central to his vision is the AI Proving Ground initiative, which includes a cutting-edge sizing tool designed to recommend the most suitable accelerators for various AI tasks. Hendrickson's work is further illustrated through compelling case studies that showcase how different AI models meet specific operational demands, paving the way for enhanced efficiency and innovation in the field. As AI continues to evolve, his strategies offer a crucial roadmap for organizations seeking to harness its full potential.

The world has been changed by AI and every business is trying to figure out how to leverage it. HPE Private Cloud solutions bring together optimized infrastructure and software in a unique cloud experience delivered through HPE GreenLake.

Welcome to part 1 of the videos series about the RAG Lab Infrastructure built in collaboration with NetApp, NVIDIA, and World Wide Technology. This video series will take you behind the scenes of this state-of-the-art lab environment inside the AI Proving Ground from WWT, powered by the Advanced Technology Center.

WWT's Matt Halcomb walks us through the installation of the Cisco FlashStack AI environment in the AI Proving Ground. After the infrastructure is installed, Matt shows us the software component integration. We're excited to continue to build new environments with our partners.

This new integrated solution in the AI Proving Ground brings together the latest releases of technology from Intel, Red Hat and Dell Technologies. The environment combines Dell Technologies 16G PowerEdge servers with Intel 5th Gen Xeon Scalable Platinum Processors as the hardware platform. The high-performance compute nodes are clustered together by Red Hat's newly released OpenShift AI MLOps platform and will support multiple solutions from Intel's AI-Reference Kit that help enable the acceleration of an enterprise's AI digital transformation goals.