Skip to main content
Question

Multi core mode

  • May 12, 2026
  • 0 replies
  • 3 views

I am currently working with metis M2 card. Trying to run yolov8 model using inference.py file from the sdk. The throughput is very low. I set the AIPU core to 4 and verfied the same in the compile_config.json file. But there is another argument called multicore_mode("multicore_mode": "batch"). what exactly does the multi core mode do? and is there way to set it to other option than ‘batch’?