All ONNX models

  • Storage: 18.25 GB

All OpenVINO models

  • Storage: 15.45 GB


Phi-3.5-mini 

ONNX with DirectML 

  • 6GB VRAM (discrete GPU)
  • 16GB System RAM (iGPU)
  • Storage: 2.15 GB

Intel OpenVINO

  • 4GB VRAM (Discrete GPU)
  • 16GB System RAM (iGPU)
  • Storage: 1.84 GB


Mistral-7B

ONNX with DirectML 

  • 8GB VRAM (discrete GPU)
  • 32GB System RAM (iGPU)
  • Storage: 3.69 GB

Intel OpenVINO

  • 8GB VRAM (discrete GPU) 
  • 32GB System RAM (iGPU) 
  • Storage: 3.48 GB


Llama-3.1-8B

ONNX with DirectML 

  • 8GB VRAM (Discrete GPU) 
  • 32GB System RAM (iGPU)
  • Storage: 5.37 GB

Intel OpenVINO

  • 8GB VRAM (Discrete GPU)
  • 32GB System RAM (iGPU)
  • Storage: 3.88 GB


Llama-2-13B

ONNX with DirectML 

  • 12GB VRAM (Discrete GPU)
  • 32GB System RAM (iGPU)
  • Storage: 7.04 GB

Intel OpenVINO

  • 10GB VRAM (Discrete GPU)
  • 32GB System RAM (iGPU)
  • Storage: 6.25 GB