Location: Venue 4 - 338
Currently, SGLang exclusively supports the PyTorch AI framework and runs on Ascend NPUs through the torch_npu plugin. We designed a dual-framework collaborative solution for PyTorch and MindSpore, fully considering cross-framework resource reuse while simplifying interfaces to leverage MindSpore's performance advantages on Ascend NPUs. Developers can easily integrate MindSpore models into SGLang while maintaining unchanged user workflows. MindSpore's integration solution also provides a foundation for subsequent integration of other frameworks.
Speakers
Share:
