vram usage on axelera metis aipu

Morning ​@retr0 !

The Metis AIPU doesn't have VRAM in the same sense as a GPU, so much as dedicated LPDDR4x memory on the card. So memory allocation is largely handled by the compiler and runtime when your model is compiled and loaded, rather than being dynamically allocated at runtime like GPU VRAM.

That said, there are a couple of tools worth knowing about:

• axdevice -v will show you the device info, including the total memory capacity on the card (e.g. 4GiB pcie or 1GiB m.2), firmware version, clock speed, etc.
• AxMonitor is also available for tracking resource usage including memory consumption. It's pretty cool actually. There’s a bit more info in the SDK docs.

If you can share a bit more about what you're working on, like whether you're trying to figure out if a particular model will fit on your card, or if you're hitting memory-related errors, we can dig a bit more!

What SDK version and hardware are you running?