NVIDIA NeMo
A comprehensive software suite to build, monitor, and optimize AI agents across their lifecycle at enterprise scale.
Overview
What Is NVIDIA NeMo?
NVIDIA NeMoβ’ is a modular, interoperable, enterprise-ready software suite for managing the AI agent lifecycle.
NeMo provides microservices and toolkits for data curation, model customization and evaluation, guardrailing, and observabilityβhelping enterprises build, monitor, and optimize agentic AI systems at scale on any GPU-accelerated infrastructure quickly, easily, and cost-effectively. It integrates with existing AI platforms and supports cloud, on-premises, and hybrid deployment, enabling enterprises to rapidly manage and effortlessly create data flywheels that continuously optimize AI agents at scale.
Benefits
Explore the Benefits of NVIDIA NeMo for Agentic AI
Modular AI Agent Lifecycle Management
Manage the AI agent lifecycleβfrom data curation, customization, and evaluation to guardrailing, observability, and optimizationβwith an enterprise-ready, interoperable software suite.
Seamless Deployment and Scaling
Easily build data flywheels that use enterprise data to improve AI agents, powering the entire flywheel with a simple Helm chart deployment or API calls for various parts of the workflow.
Increased ROI
Quickly train, customize, and deploy large language models (LLMs), vision-language models (VLMs), video AI, and speech AI at scale, reducing time to solution and increasing ROI.
Accelerated Performance
Maximize AI agent performance and throughput with GPU-accelerated optimization, multi-node scaling, and tuning for cost-efficient training, deployment, and continuous improvement.
Safer Agentic AI
Build safer agentic AI systems by vetting models, guardrailing prompts, and continuously scanning for vulnerabilities.
Production Ready
Deploy into production with a secure, optimized, full-stack solution that offers support, security, and API stability as part of NVIDIA AI Enterprise.
Build, monitor, and optimize AI agents anywhereβfrom the cloud and data center to the edge.
Features
Tools for Managing the AI Agent Lifecycle
The NVIDIA NeMo software suite for managing the AI agent lifecycle includes NeMo Curator, NeMo Customizer, and NeMo Evaluator for building; NeMo Retriever, NeMo Guardrails, and NVIDIA NIMβ’ for deployment; and NeMo Agent Toolkit for optimization.
Use Cases
How NeMo Is Being Used
See how NVIDIA NeMo supports industry use cases and jump-starts your AI development.
-
AI Agents
-
AI Assistant
-
Information Retrieval
-
Content Generation
-
Humanoid Robot
AI Agents
AI agents are transforming customer service across sectors, helping companies enhance customer conversations, achieve high resolution rates, and improve human representative productivity. AI agents can handle predictive tasks, reason and problem-solve, be trained to understand industry-specific terms, and pull relevant information from an organizationβs knowledge bases, wherever that data resides.
AI Assistant
Businesses are deploying AI assistants to efficiently address the queries of millions of customers and employees around the clock. Powered by customized NVIDIA NIM microservices for LLMs, RAG, and speech and translation AI, these AI teammates deliver immediate and accurate spoken responses, even in the presence of background noise, poor sound quality, and diverse dialects and accents.
Information Retrieval
Trillions of PDF files are generated every year, each file likely consisting of multiple pages filled with various content types, including text, images, charts, and tables. This goldmine of data can only be used as quickly as humans can read and understand it. But with generative AI and RAG, this untapped data can be used to uncover business insights that can help employees work more efficiently and result in lower costs.
Content Generation
Generative AI makes it possible to generate highly relevant, bespoke, and accurate content grounded in the domain expertise and proprietary IP of your enterprise.
Humanoid Robot
Humanoid robots are built to adapt quickly to existing human-centric urban and industrial work spaces, tackling tedious, repetitive, or physically demanding tasks. Their versatility has them in such varied locations as factory floors to healthcare facilities, where these robots are assisting humans and helping alleviate labor shortages with automation.
Apptronik
Starting Options
Ways to Get Started With NVIDIA NeMo
Use the right tools and technologies to take AI agents from development to production.
Customer Stories
How Industry Leaders Are Driving Innovation With NeMo
Adopters
Leading Adopters Across All Industries
-
Customers
-
Partners
Resources
The Latest in NVIDIA NeMo Resources
-
Blogs
-
Sessions
-
Training
-
Videos
Next Steps
Ready to Get Started?
Use the right tools and technologies to take your agentic AI applications from development to production.
For Developers
Explore everything you need to start developing with NVIDIA NeMo, including the latest documentation, tutorials, technical blogs, and more.
Get in Touch
Talk to an NVIDIA product specialist about moving from pilot to production with the assurance of security, API stability, and support that comes with NVIDIA AI Enterprise.
Shell
Shell Trains Custom AI Chatbot With NVIDIA NeMo to Uplevel Operations
Shell, a global leader in the energy industry, has leveraged NVIDIA NeMoβ’ to empower their journey toward developing a custom AI chatbot for chemical domain expertise. This innovative solution has the potential to significantly enhance employee productivity by streamlining search processes, improving decision-making, and supporting research and development in production environments.
AI Sweden
Accelerate Industry Applications With LLMs
AI Sweden facilitated regional language model applications by providing easy access to a powerful 100 billion-parameter model. They digitized historical records to develop language models for commercial use.
Amazon
How Amazon and NVIDIA Help Sellers Create Better Product Listings With AI
Amazon doubles inference speeds for new AI capabilities using NVIDIA TensorRT-LLM and GPUs to help sellers optimize product listings faster.
Amdocs
NVIDIA and Amdocs Bring Custom Generative AI to Global Telco Industry
Amdocs plans to build custom LLMs for $1.7 trillion global telecommunications industry using NVIDIA AI foundry service on Microsoft Azure.
AT&T
AT&T Drives Customer Care AI Agentsβ Accuracy, Efficiency, and Performance With NVIDIA NeMo
AT&T, one of the worldβs largest telecommunications companies, is reimagining customer care through the power of AI. Facing challenges like model drift, rising computational demands, and the need for real-time data access, AT&T turned to NVIDIA NeMoβ’ microservices to build a feedback-driven AI platform that continuously improves performance while optimizing cost, speed, and compliance.
AWS
NVIDIA Powers Training for Some of the Largest Amazon Titan Foundation Models
Amazon leveraged the NVIDIA NeMo framework, GPUs, and AWS EFAs to train its next-generation LLM, giving some of the largest Amazon Titan foundation models customers a faster, more accessible solution for generative AI.
Accenture
Accelerate Generative AI Adoption for Enterprises
ServiceNow, NVIDIA, and Accenture announced the launch of AI Lighthouse, a first-of-its-kind program designed to fast-track the development and adoption of enterprise generative AI capabilities.
Azure
Harnessing the Power of NVIDIA AI Enterprise on Azure Machine Learning
Get access to a complete ecosystem of tools, libraries, frameworks, and support services tailored for enterprise environments on Microsoft Azure.
Bria
Bria Builds Responsible Generative AI for Enterprises Using NVIDIA NeMo, Picasso
Bria, a startup based in Tel Aviv, is helping businesses who are seeking responsible ways to integrate visual generative AI technology into their enterprise products with a generative AI service that emphasizes model transparency alongside fair attribution and copyright protections.
Cohesity
Unlock Your Data Superpower: NVIDIA Microservices Unleash Enterprise-Grade Secure Generative AI for Cohesity
With NVIDIA NIM and optimized models, Cohesity DataProtect customers can add generative AI intelligence to data backups and archives. This allows Cohesity and NVIDIA to bring the power of generative AI to all Cohesity DataProtect customers. Leveraging the power of NIM and NVIDIA optimized models, Cohesity DataProtect customers obtain the power of data-driven insights from their data backups and archives, unleashing new levels of efficiency, innovation, and growth.
CrowdStrike
Shaping the Future of AI in the Cybersecurity Domain
CrowdStrike and NVIDIA are leveraging accelerated computing and generative AI to provide customers with an innovative range of AI-powered solutions tailored to efficiently address security threats.
Dell
Dell Validated Design for Generative AI With NVIDIA
Dell Technologies and NVIDIA announced an initiative to make it easier for businesses to build and use generative AI models on premises quickly and securely.
Deloitte
Unlock the Value of Generative AI Across Enterprise Software Platforms
Deloitte will use NVIDIA AI technology and expertise to build high-performing generative AI solutions for enterprise software platforms to help unlock significant business value.
Domino Data Lab
Domino Offers Production-Ready Generative AI Powered by NVIDIA
With NVIDIA NeMo, data scientists can fine-tune LLMs in Dominoβs platform for domain-specific use cases based on proprietary data and IPβwithout needing to start from scratch.
Dropbox
Dropbox and NVIDIA to Bring Personalized Generative AI to Millions of Customers
Dropbox plans to leverage NVIDIAβs AI foundry to build custom models and improve AI-powered knowledge work with Dropbox Dash universal search tool and Dropbox AI.
Google Cloud
AI Titans Collaborate to Create Generative AI Magic
At its Next conference, Google Cloud announced the availability of its A3 instances powered by NVIDIA H100 Tensor Core GPUs. Engineering teams from both companies have collaborated to bring NVIDIA NeMo to the A3 instances for faster training and inference.
HuggingFace
Leading AI Community to Accelerate Data Curation Pipeline
Hugging Face, the leading open platform for AI builders, is collaborating with NVIDIA to integrate NeMo Curator and accelerate DataTrove, their data filtering and deduplication library. βWe are excited about the GPU acceleration capabilities of NeMo Curator and canβt wait to see them contributed to DataTrove!β says Jeff Boudier, Product Director at Hugging Face.
KT
Creating New Customer Experiences With LLMs
South Koreaβs leading mobile operator builds billion-parameter LLMs trained with the NVIDIA DGX SuperPOD platform and NeMo framework to power smart speakers and customer call centers.
Lenovo
New Reference Architecture for Generative AI Based on LLMs
Solution to expedite innovation by empowering global partners and customers to develop, train, and deploy AI at scale across industry verticals with utmost safety and efficiency.
Quantiphi
Enabling Enterprises to Fast-Track Their AI-Driven Journeys
Quantiphi specializes in training and fine-tuning foundation models using the NVIDIA NeMo framework, as well as optimizing deployments at scale with the NVIDIA AI Enterprise software platform, while adhering to responsible AI principles.
SAP
SAP and NVIDIA Accelerate Generative AI Adoption Across Enterprise Applications Powering Global Industries
Customers can harness their business data in cloud solutions from SAP using customized LLMs deployed with NVIDIA AI foundry services and NVIDIA NIM Microservices.
ServiceNow
Building Generative AI Across Enterprise IT
ServiceNow develops custom LLMs on its ServiceNow platform to enable intelligent workflow automation and boost productivity across enterprise IT processes.
Perplexity
Enhance Model Performance for AI-Powered Search Engines
Using NVIDIA NeMo, Perplexity aims to quickly customize frontier models to improve the accuracy and quality of search results and optimize them for lower latency and high throughput for a better user experience.
VMware
VMware and NVIDIA Unlock Generative AI for Enterprises
VMware Private AI Foundation with NVIDIA will enable enterprises to customize models and run generative AI applications, including intelligent chatbots, assistants, search, and summarization.
Weight & Biases
Debug, Optimize, and Monitor LLM Pipelines
Weights & Biases helps teams working on generative AI use cases or with LLMs track and visualize all prompt-engineering experimentsβhelping users debug and optimize LLM pipelinesβas well as provides monitoring and observability capabilities for LLMs.
Writer
Startup Pens Generative AI Success Story With NVIDIA NeMo
Using NVIDIA NeMo, Writer is building LLMs that are helping hundreds of companies create custom content for enterprise use cases across marketing, training, support, and more.
Arize
Arize Powers Self-Improving AI Data Flywheels
Arizeβs LLM engineering and observability platform integrates NVIDIA NeMo microservices to power AI data flywheels, enabling continuous model refinement through real-world feedback. With NeMo Customizer, Evaluator, and Guardrails, Arize ensures agentic systems are performant, safe, and aligned with evolving enterprise needs. This collaboration supports the development of adaptive AI that learns and evolves over time.
DataRobot
Enterprise-Ready, Trustworthy AI Agents With NeMo on DataRobot
With NVIDIA NeMo embedded into the DataRobot Enterprise AI Suite, enterprises can ensure agentic systems are safe, compliant, and grounded in enterprise-specific data. This integration facilitates the development of AI agents that deliver accurate, context-aware responses while adhering to organizational standards.
DataStax
DataStax and NVIDIA Build Data and AI Platform
Over the past year, DataStax has partnered with NVIDIA to adopt the NVIDIA NeMo microservices to enhance generative AI, retrieval-augmented generation, and hybrid search across its database and AI offerings. The results have been impressive: 19x better performance in throughput, a significant reduction in costs, and improved latency.
Galileo
Galileo and NVIDIA NeMo: De-Risking Agentic AI in Production
Galileo integrates NVIDIA NeMo microservices to build AI data flywheels that strengthen agent performance, reliability, and trust. NeMo adds complementary capabilities to the Galileo platformβenabling continuous domain-specific fine-tuning via NeMo Customizer, advanced evaluation with NeMo Evaluator, and safeguarding user interactions with NeMo Guardrails to empower AI teams to build, evaluate, and monitor agentic AI systems that learn and improve continuously in real-world environments.