NVIDIA NIM on AWS Supercharges AI Inference
NVIDIA News, Wednesday, December 4th, 2024
Optimized NIM microservices are now available on Amazon Bedrock Marketplace, SageMaker JumpStart and AWS Marketplace for a broad catalog of NVIDIA and ecosystem models.
Generative AI is rapidly transforming industries, driving demand for secure, high-performance inference solutions to scale increasingly complex models efficiently and cost-effectively.
Expanding its collaboration with NVIDIA, Amazon Web Services (AWS) revealed today at its annual AWS re:Invent conference that it has extended NVIDIA NIM microservices across key AWS AI services to support faster AI inference and lower latency for generative AI applications.