Nvidia opens AWS Storefront with NGC Software Application Catalog


Nvidia makes it easier for AWS cloud customers to find and integrate Nvidia software applications into their AI and deep learning projects through a brand new all-in-one “storefront” on the AWS Marketplace.

The storefront, which initially contains 21 applications from the Nvidia GPU Cloud (NGC) software application catalog, is designed to bring Nvidia applications directly to AWS so that users can quickly locate them according to their needs, said Adel El Hallak, director from the NGC catalog. HPC wire sister site Corporate AI.

As part of the deal, AWS Marketplace is the first cloud provider to offer the NGC Application Catalog directly in its own integrated storefront, he said. “Rather than releasing an app here or a container there, we’re lifting and evolving, bringing our entire in-store presence to the AWS Marketplace. “

Adel El Hallak

The AWS Marketplace is a destination where cloud customers can find, buy, and immediately start using software and services that run on AWS. The Nvidia NGC Software Catalog, which was created in 2017, is optimized to run on Nvidia GPU cloud instances, such as Amazon EC2 P4d instances that use Nvidia A100 Tensor Core GPUs. AWS customers will be able to deploy Nvidia’s software for free to accelerate their AI deployments. The NGC Catalog includes AI containers, pre-trained models, application frameworks, Helm charts, and other machine learning resources.

The creation of the storefront will help Nvidia simplify application deployment for its customers, El Hallak said.

“For example, if you wanted to use any of our software with Amazon SageMaker, one of the precursors was to copy the container to AWS Elastic Container Registry (ECR),” he said. “But by bringing [NGC] in the AWS Marketplace, these entities [already] live in ECR, which simplifies deployment with SageMaker, in addition to simplifying deployment with other AWS services such as Elastic Compute Cloud (EC2), Elastic Kubernetes Service, and Elastic Container Service.

What the NGC showcase will offer

The new showcase includes 21 of Nvidia’s most popular apps to accelerate work in AI, conversational AI, HPC, healthcare, data science, robotics and more. El Hallak would not comment on future additions to the storefront, but it is likely that more Nvidia apps will be added over time.

“This is the first step in a partnership,” El Hallak said. “It was part of our interest to bring our portfolio to cloud service providers [like AWS], but it was also a reaction to cloud service providers, who always ask us for our software portfolio. They see the users [need such applications]. “

To meet these customer needs, Nvidia is releasing new domain-specific AI frameworks on a monthly basis and on a regular basis, El Hallak said.

“We are seeing… tremendous growth for NGC,” he said. “We have exceeded one million downloads, with 250,000 [developer and data scientist] users in the last 14 to 15 months. So that [storefront] makes sure that as soon as we release the software, AWS users will have immediate access to it as it federates into their market… and integrates more closely with their users. It’s really a reaction to listening to AWS users requesting that our software be transferred.

Having the Nvidia NGC storefront in AWS Marketplace is like having a Starbucks store in a Target store, El Hallak said. “You know how you got a store in a store over there?” It’s a similar concept here. We bring an entire store presence natively to live in AWS Marketplace.

A smart move, say analysts

So what does all of this mean for Nvidia and AWS cloud customers?

“This is a game of convenience for the joint customers of AWS and Nvidia,” said Patrick Moorhead, president and senior analyst at Moor Insights & Strategy. Corporate AI. “AWS customers could still install the software, but now it’s point-and-click. I think AWS is doing this because it wants to show that even though it has alternatives – like Inferentia, Trainium, AMD Radeon Pro, and Intel Habana – to Nvidia silicon, it still wants to be the closest partner to Nvidia.

Another analyst, Addison Snell, CEO and senior analyst at Intersect360 Research, agrees.

“This announcement is ultimately good for Nvidia, good for AWS and good for HPC users,” he said. “By making it easier to kick off the development of HPC and AI applications in the public cloud, Nvidia and AWS are driving innovation and expanding the research base. For AWS, this increases the portfolio of offerings on their primary public cloud portal. And for Nvidia, this helps consolidate a leading position in accelerated computing with its GPU solutions.

The first Nvidia software applications in the new NGC showcase on AWS Marketplace include:

Nvidia AI: A suite of frameworks and tools, including MXNet, TensorFlow, Nvidia Triton Inference Server, and PyTorch.

Nvidia Clara Imaging: An application framework optimized for Nvidia’s domain that accelerates deep learning training and inference for medical imaging use cases.

Nvidia DeepStream SDK: A scalable, cross-platform video analytics framework to deploy to the edge and connect to any cloud.

Nvidia HPC SDK: a suite of compilers, libraries and software tools for high performance computing.

Nvidia Isaac Sim ML Training: A Toolkit to Help Machine Learning Robotics Engineers Use Isaac Sim to Generate Synthetic Images to Train an Object Sensing Deep Neural Network.

Nvidia Merlin: An open beta framework for building large-scale deep learning recommendation systems.

Nvidia NeMo: an open source Python toolkit for developing cutting-edge conversational AI models.

RAPIDS: a suite of open source software libraries for data science.

Source link


Leave A Reply