Skip to main content

hi there,

I was wondering if you have a planned feature to enables the usage of multiple PCIe cards in the same system. 

if so, is there any feature to use large models over multiple cards?

 

Ah, if it’s not already on the roadmap, this would be a great question to add as a feature request!


Support for Multiple cards are planned in the GA release. However, support for model sharing across cards will not be there and is currently not a roadmap feature. Multi-chip model support is likely supported earlier.


Reply