Reproducing the FPS/W benchmark claim

Hello,

There seems to be two different published benchmarks for ResNet50.

The first is in the Voyager SDK’s documentation : 1756 FPS (M.2) / 1946 FPS (PCIe) :
- https://github.com/axelera-ai-hub/voyager-sdk/blob/latest/docs/reference/model_zoo.md

The second is on the Metis Marketing page : Up to 3200 frames per second (ResNet-50)
- https://axelera.ai/ai-accelerators/aipu/metis

I was able to achieve 2050 FPS, which is higher than the modelzoo documentation, but MUCH lower than the marketing claim:

- https://mariobergeron.com/posts/edge-ai-power-p04-axelera-metis/

Where does the 3200 FPS benchmark claim come from ?   How was this benchmark achieved on Metis ?  Which hardware platform ?

Which brings me to the next marketing claim : Industry-Leading FPS / Watt ratios on ResNet50v1 (graph showing 614 FPS/W

- https://axelera.ai/ai-accelerators/aipu/metis

I was only able to achieve 270 FPS/W :

- https://mariobergeron.com/posts/edge-ai-power-p04-axelera-metis/

What does the 614 FPS/W benchmark come from ?  Is it for ResNet50 ?  How was it achieved ?

Thank you in advance for any feedback and/or clarifications.

Cheers !

Mario.