ONNX Runtime
Microsoft. Broad platform support. Windows + Mac + Linux + mobile. Good ecosystem + GenAI extension.
Advertisement
MLC LLM
ML Compilation. WebGPU + iOS + Android. Model-specific compilation. WebLLM (browser LLM) built on it.
Advertisement
ExecuTorch
Meta. PyTorch → mobile. Same model definition as training. Growing rapidly.