openmmlab/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLM.
Latest release: over 1 year ago - 543,156 downloads - 419 dependencies
More details on packages.ecosyste.ms - JSON
LMDeploy is a toolkit for compressing, deploying, and serving LLM.
Latest release: over 1 year ago - 543,156 downloads - 419 dependencies
More details on packages.ecosyste.ms - JSON