NVIDIA A100 Aces Throughput, Latency Results In Key Inference Benchmark For Financial Services Industry
NVIDIA News, February 2nd, 2023
A100 GPUs running on Supermicro servers deliver top throughput and leading latency in STAC-ML Markets standard.
NVIDIA A100 Tensor Core GPUs running on Supermicro servers have captured leading results for inference in the latest STAC-ML Markets benchmark, a key technology performance gauge for the financial services industry.
The results show NVIDIA demonstrating unrivaled throughput - serving up thousands of inferences per second on the most demanding models - and top latency on the latest STAC-ML inference standard.