Skip to main content
Question

Deploy available LLMs with custom weights

  • December 4, 2025
  • 0 replies
  • 5 views

Hi!

First of all, thank you very much for your work — the Axelera tools are really impressive and perform exceptionally well!

I’m currently working on deploying LLMs on the METIS PCIe accelerator using the Voyager SDK v1.5.1.  
From my understanding, the LLMs currently available are already precompiled, and we simply download the compiled model files.

Would it be possible to access the deployment or compilation process so that we can deploy our own fine-tuned LLMs — even if they share the same architecture as the models already available in the model zoo?