openmmlab/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLM.

Latest release: over 1 year ago - 539,583 downloads - 419 dependencies

More details on packages.ecosyste.ms - JSON

Versions