The application version number applies to the software as a whole. It changes often as we update the application to add new features and ensure compatibility with the latest hardware. We recommend using the latest application version.

A benchmark version number—for example, Photo Editing Benchmark v1.0—is specific to a test. Benchmark version numbers change rarely and only when absolutely necessary to accommodate changes in third-party applications or bug fixes.


AI Computer Vision for MacOS v2.1.38 — October 4, 2024

This update adds support for updated computer vision models available in MacOS 15 Sequoia. This allows Apple Silicon based Macs to take advantage of performance improvements introduced in the latest version of macOS and Core ML Tools. 

We recommend re-running the AI Computer Vision Benchmark using the latest version of Procyon for hardware that benefit from these updates. 


Updated

  • All Core ML FP32, FP16, and INT8 models have been re-converted with the latest version of Core ML Tools.
  • All models now default to using MLMultiArray inputs.
  • All INT8 AI inference models are now built with activation quantization (W8A8 mode).
  • Added support for the ‘Fast prediction’ mode available on Apple Silicon-based Neural Engines.

AI Computer Vision for MacOS v2.1.33 — July 23, 2024

Please note that updates to inference engine runtimes impact results and should not be compared to results from previous workload versions. Results from the AI Inference Benchmark for MacOS from Procyon v2.1.33 or later are not comparable with results from earlier versions of Procyon. 


Updated

  • Overall runtime reduced from 3 minutes to 1 minute per model. This does not affect performance.
  • Updated the workload implementation from Python to Objective-C for lower overhead.
  • Updated the below listed models to use “ImageType” input. Refer to the documentation here: https://apple.github.io/coremltools/docs-guides/source/image-inputs.html. 
    • MobileNetV3
    • InceptionV4
    • DeepLabV3
    • YOLOV3 

AI Computer Vision for MacOS v2.1.24 — April 4, 2024

This update is the release version of the AI Computer Vision for MacOS.