M6i Instances Accelerated Image Classification Over M5n Instances with Previous-Generation Processors
Running deep learning workloads in the cloud can give organizations the power to make sense of their data while also getting the flexibility and easy scalability the cloud provides. For those using the ResNet50 framework to classify images, Principled Technologies compared the performance of two instance types:
- AWS M6i instances with 3rd Gen Intel® Xeon® Scalable processors
- AWS M5n instances with 2nd Gen Intel Xeon Scalable processors
Using int8 precision and a batch size of 128 on the ResNet50 benchmark, results showed that for both small and large instance sizes, AWS M6i instances offered up to 1.21x the frames per second rate for image classification. This means that if your organization seeks to run these types of image classification workloads in the cloud, AWS M6i instances can cut through the data faster to deliver insights sooner.
Making Sense of Data Faster on Large Instances
First, to show how workloads with higher throughput demands might compare, Principled Technologies tested with large, 96 vCPU instances. The updated AWS M6i instances with 3rd Gen Intel® Xeon® Scalable processors offered a significant performance advantage over the M5n instances with previous-generation processors, handling 1.21x the frames per second on the ResNet50 benchmark (see Figure 1).
Making Sense of Data Faster on Small Instances
As Figure 2 shows, small instances with 16 vCPUs offered similar performance deltas as the larger instances with 96 vCPUs. Test results show that AWS M6i instances with 3rd Gen Intel® Xeon® processors classified 1.19x the frames per second of M5n instances with previous-generation processors.
Using deep learning frameworks for image classification can offer new ways to diagnose medical conditions or assess damages to city infrastructure after a hurricane. No matter your particular use case for running ResNet50 to classify images, getting through more frames per second can lead to insights. Tests show that opting for AWS M6i instances with 3rd Gen Intel Xeon Scalable processors over M5n instances with previous-generation processors can improve the frames per second rate for image classification by as much as 1.21x.
Analyzing images at a faster rate has more implications than just getting answers more quickly. If the cloud instance type you choose can process more images, faster, it can reduce the number of instances you need to purchase—which is also a win for your bottom line.