Cisco Secure AI Factory with NVIDIA is a scalable, high-performance, and secure AI infrastructure from Cisco, NVIDIA, and our strategic partners to help accelerate the adoption of AI for enterprises.

In this technology demonstration, we will showcase the deployment of an AI workload using Cisco Intersight automation on a single UCS X-Series blade, leveraging a neighboring X440p (X-Fabric) with an NVIDIA A40 GPU. This demo will highlight the powerful capabilities of both Cisco Intersight and the Cisco AI Toolkit, which includes tools for AI model deployment, system monitoring, and resource management. By utilizing Miniconda for environment management, CUDA for GPU acceleration, and various large language models like Vicuna and Meta OPT, we will feed data into a retrieval-augmented generation (RAG) model.

A cloud managed, high performance, easy to deploy and operate, consolidated network - integrated with your Al stack.

Learn how you can control your UCS servers, converged infrastructure, and hyperconverged infrastructure using Cisco Intersight.

Designed to be managed exclusively from the cloud.

Secure your network. Observe your apps. Streamline your business. Breathe a little easier. Introducing Cisco Full Stack Observability (FSO).