openmmlab/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLM.
Latest release: almost 2 years ago - 556,537 downloads - 419 dependencies
More details on packages.ecosyste.ms - JSON
LMDeploy is a toolkit for compressing, deploying, and serving LLM.
Latest release: almost 2 years ago - 556,537 downloads - 419 dependencies
More details on packages.ecosyste.ms - JSON