Start your day with intelligence. Get The OODA Daily Pulse.
Nvidia Corp. today announced the general availability of NeMo microservices, a set of tools designed to assist developers get artificial intelligence agents up faster by tapping into AI inference and information systems at scale. Agents have become a focal point for creating “digital teammates” capable of driving workforce productivity for knowledge and service workers by taking orders, discovering information and doing proactive work. Unlike AI chatbots, agents can take autonomous actions with little or no human oversight but they need data to make accurate and efficient decisions as part of their reasoning. This can be particularly true for proprietary knowledge, which might be locked behind company firewalls or when using rapidly changing real-time information. “Without a constant stream of high-quality inputs — from databases, user interactions or real-world signals — an agent’s understanding can weaken, making responses less reliable, which makes agents less productive,” said Joey Conway, senior director of generative AI software for enterprise at Nvidia. To help developers rapidly build and deploy agents, Nvidia is releasing NeMo microservices, including Customizer, Evaluator, Guardrails, Retriever and Curator. They are designed to ease enterprise AI engineers’ experience building agentic AI experiences when scaling and accessing data.