Are you interested in catching up on all the news and updates related to VMware Private AI Foundation with NVIDIA, then catching up on the recording of the top Private AI Sessions listed below is a great place to start:
What’s New in Private AI Foundation with NVIDIA [VCFB1789LV]
Speakers: Yu Wang, Erik Bohnhorst, Jake Augustine
In this session, we provide a deep dive on the VMware Private AI Foundation with NVIDIA solution and the latest capabilities we are delivering to help enterprises accelerate their generative AI journey. It is a great place to start to get up to speed on the new updates and features of VMware Private AI Foundation with NVIDIA that got introduced at VM Explore Las Vegas.
Video link: What’s New in Private AI Foundation with NVIDIA [VCFB1789LV]
Deep Dive: Running VMware Private AI Foundation with NVIDIA on VMware Cloud Foundation [VCFT1614LV]
Speakers: Justin Murray, Alex Fanous
Learn how you can extend your VI Admin skillset to include awareness of the new AI capabilities at your disposal, to offer to your lines of business, safely and securely in the rapidly evolving world of Artificial Intelligence. 1. Run AI/ML workloads and use integrated NVIDIA technology 2. Automate provisioning of AI-Ready infrastructure, using Kubernetes with the IaaS control plane of VMware Cloud Foundation (VCF), and deployment of Generative AI Large Language Models (LLMs) 3. Streamline development and operations of AI applications 4. Use Data Services Manager for AI workloads
Video Link: Deep Dive: Running VMware Private AI Foundation with NVIDIA on VMware Cloud Foundation [VCFT1614LV]
Unlocking Your Data with VMware by Broadcom and NVIDIA — RAG Deep Dive [INVB2039LV]
Speakers: Shawn Kelly, Frank Denneman
Organizations today have acquired massive data sets, but getting the right information at the right moment can be challenging. Enter retrieval augmented generation (RAG), an approach that combines the intelligence of a large language model with current, relevant and accurate data from trusted sources. Join us for a 300-level look into a RAG pipeline architected using VMware Private AI Foundation with NVIDIA. We review the end-to-end workflow and how it maps to virtual infrastructure. Then we dive deeper into the components, including the LLM, NVIDIA Inference Microservices and Vector DB. We also review best practices, including sizing considerations and when to leverage fractional, full or multiple GPUs.
Video Link: Unlocking Your Data with VMware by Broadcom and NVIDIA — RAG Deep Dive [INVB2039LV]
Private AI and Advanced Services on VCF: What’s Next? [INVB1960LV]
Speakers: Chris Wolf, Dilpreet Bindra
Dive into what the future holds for VMware Cloud Foundation. Attendees can learn how the VMware Cloud Foundation platform will leverage AI to streamline challenges, such as product support and troubleshooting, and how VMware Cloud Foundation will enable your AI applications and models to be operated more securely and efficiently. Innovative platform features are also shared to showcase how VMware Cloud Foundation will allow you to run a variety of PaaS and data services. Also see first-ever demos of new and emerging capabilities, and how we work collaboratively with our ecosystem partners and customers to bring compelling new solutions to market.
Video Link: Private AI and Advanced Services on VCF: What’s Next? [INVB1960LV]
Build Service Deliverables with VMware Private AI Foundation with NVIDIA [CODEB1882LV]
Speakers: Frank Denneman, Johan van Amersfoort
Join Johan van Amersfoort, chief evangelist at ITQ, and Frank Denneman, chief technologist AI at VMware Cloud Foundation division, Broadcom, to delve into ITQ’s innovative approach to overcoming challenges in standardized engagement delivery. With over 20 years of enterprise IT experience and more than 5,000 engagements across 1,000+ customers, maintaining consistency amidst team growth and accessing pertinent technical information, pose significant hurdles. Discover how ITQ leveraged the VMware Private AI Foundation with NVIDIA platform for a service-oriented RAG application, streamlining knowledge aggregation, decision-making, sales offer creation and helpdesk support. Explore the intricacies of the private AI platform design, VMware Cloud Foundation, hardware considerations and NVIDIA NIM deployment, complete with demonstrations of the virtual ITQ assistant.
Video Link: Build Service Deliverables with VMware Private AI Foundation with NVIDIA [CODEB1882LV]
Private AI on a Budget: How the US Senate Federal Credit Union Made It [INVB1907LV]
Speakers: Mark Fournier, Shwn Kelly, Michele Collauto
Organizations are eager to leverage AI to propel their business, but one of the main concerns is keeping everything private. Small companies need to protect customer data and don’t want to give up any information or intellectual property to the big players they compete against. Building your own AI solution from scratch is possible, but it also brings risk—do you have a multi-million dollar budget to gamble with? This is the chronicle of the US Senate Federal Credit Union’s (USSFCU) successful, small and effective implementation of VMware Private AI with NVIDIA, using limited resources and a small budget on Dell PowerEdge. Join us in this session to hear about our challenges and the winning strategies that brought USSFCU to deploy an AI solution on VMware vCloud Foundation that can be scaled up as you need, tailoring it to your organization.
Video Link: Private AI on a Budget: How the US Senate Federal Credit Union Made It [INVB1907LV]
1 Answer to Your Generative AI Questions — VMware Private AI [VCFB1657LV]
Speakers: Himanshu Signh, Shobhit Bhutani, Judy Lee
After several decades of niche growth and development, generative AI and AI/ML adoption have achieved mainstream status. While generative AI is a transformative technology, enterprises face daunting challenges in its deployment. This is why VMware announced VMware Private AI. Join this session to learn how VMware Private AI’s architectural approach and massive ecosystem enables the flexibility to run a range of AI solutions for your environment: NVIDIA, IBM, Intel or open source.
Video Link: 1 Answer to Your Generative AI Questions — VMware Private AI [VCFB1657LV]
Building GenAI Apps on VMware Cloud Foundation [VCFB1559LV]
Speakers: Tasha Drew
The integration of AI-driven capabilities, such as retrieval augmented generation, offers organizations a way to leverage their data to create competitive advantage across a variety of use cases. Building AI-powered chat applications introduces complexities related to model management, data privacy and infrastructure enablement. VMware Private AI Foundation on VMware Cloud Foundation streamlines the development and deployment of generative AI applications. Attend this talk to learn about how enterprises are using and deploying generative AI today, and the features and capabilities of Private AI Foundation with Nvidia in helping customers deliver these workloads in a secure and private way.
Video Link: Building GenAI Apps on VMware Cloud Foundation [VCFB1559LV]
Empowering Developers With Open Source GenAI Models [INVB1637LV]
Speakers: Ramesh Radhakrishnan, Tasha Drew
We will cover how our team in VMware Cloud Foundation has stood up the GenAI stack to serve open source models, enabling developers to harness the power of AI. We will dive into the challenges faced in hosting these advanced models and the innovative solutions. Key highlights include: Open Source Approach: Our commitment to open source has been a driving force behind our efforts. We will discuss the benefits of this approach. Scalable Infrastructure: We will share insights into our architecture, including distributed computing, load balancing and efficient resource management leveraging VMware Cloud Foundation as a foundational layer. Developer Experience: We will highlight our user-friendly APIs and developer resources, empowering teams to leverage GenAI models effectively. Model Serving: We will showcase our streamlined processes and tools, ensuring a seamless experience for our users.
Video Link: Empowering Developers With Open Source GenAI Models [INVB1637LV]
AI Without GPUs: Using Your Existing CPU Resources to Run AI Workloads [INVB2189LV]
Speakers: Earl Ruby, Keith Bradley
Graphics processing units (GPUs) are expensive, hard to acquire and extremely powerful, but there are many AI/ML applications that can run just fine without GPUs. This session covers how to use your existing central processing unit (CPU) resources to run AI workloads, what you can do, what you shouldn’t do and what types of problems you can solve without using any GPUs at all.
Video Link: AI Without GPUs: Using Your Existing CPU Resources to Run AI Workloads [INVB2189LV]