simonmok/vllm : demo

Latest release: almost 3 years ago - 94 downloads - 2,083 dependencies

Dependencies

bash 5.0.17
node 16.15.1
python 3.8.10

Babel 2.10.1
Cython 0.29.32
GitPython 3.1.27
HeapDict 1.0.1
Jinja2 3.1.1
Jinja2 3.1.2
Markdown 3.3.6
Markdown 3.4.1
MarkupSafe 2.1.1
Pillow 8.3.1
Pillow 9.2.0
PyYAML 6.0
Pygments 2.11.0
Pygments 2.13.0
Send2Trash 1.8.0
Werkzeug 2.2.2
absl-py 1.3.0
aiohttp 3.8.5
aiosignal 1.3.1
anyio 3.7.1
apex 0.1
appdirs 1.4.4
argon2-cffi-bindings 21.2.0
argon2-cffi 21.3.0
asttokens 2.2.1
astunparse 1.6.3
async-timeout 4.0.3
attrs 22.1.0
attrs 23.1.0
audioread 3.0.0
awscli 1.16.35
backcall 0.2.0
beautifulsoup4 4.11.1
black 22.6.0
bleach 5.0.1
blis 0.7.9
boto3 1.19.12
breathe 4.25.0
breathe 4.31.0
breathe 4.33.1
breathe 4.34.0
breathe 4.5.0
build 0.8.0
bytecode 0.13.0.dev0
cachetools 5.2.0
catalogue 2.0.8
certifi 2021.10.8
certifi 2022.12.7
cffi 1.15.0
cffi 1.15.1
charset-normalizer 2.0.12
charset-normalizer 2.1.1
charset-normalizer 3.3.0
clang-format 14.0.6
click 8.1.2
click 8.1.3
cloudpickle 2.2.0
cmake 3.24.1.1
colorama 0.4.6
comm 0.1.2
confection 0.0.3
contourpy 1.0.6
coremltools 5.0b5
csscompressor 0.9.5
cuda-python 11.7.0 0.g95a2041.dirty
cudf 22.10.0a0 316.gad1ba132d2.dirty
cugraph 22.10.0a0 113.g6bbdadf8.dirty
cuml 22.10.0a0 56.g3a8dea659.dirty
cupy-cuda118 11.0.0
cycler 0.11.0
cymem 2.0.7
dask-cuda 22.10.0a0 23.g62a1ee8
dask-cudf 22.10.0a0 316.gad1ba132d2.dirty
dask 2022.9.2
dataclasses 0.6
debugpy 1.6.4
decorator 5.1.1
defusedxml 0.7.1
distributed 2022.9.2
docutils 0.16
docutils 0.17.1
entrypoints 0.4
enum34 1.1.6
exceptiongroup 1.0.4
execnet 1.9.0
executing 1.2.0
exhale 0.2.3
exhale 0.3.1
expecttest 0.1.3
fastapi 0.104.0
fastjsonschema 2.16.2
fastrlock 0.8.1
filelock 3.12.4
flake8-bugbear 20.1.4
flake8-comprehensions 3.3.0
flake8-executable 2.0.4
flake8-pyi 20.5.0
flake8 3.8.2
flatbuffers 2.0
fonttools 4.38.0
fpdf 1.7.2
frozenlist 1.4.0
fsspec 2023.9.2
furo 2022.6.21
future 0.18.2
ghp-import 2.0.2
gitdb 4.0.9
google-auth-oauthlib 0.4.6
google-auth 2.15.0
graphsurgeon 0.4.6
grpcio 1.51.1
h11 0.14.0
hf_transfer 0.1.3
html5lib 1.1
htmlmin 0.1.12
httplib2 0.20.4
httptools 0.6.1
huggingface-hub 0.18.0
hypothesis 5.35.1
hypothesis 6.56.4
idna 3.3
idna 3.4
importlib-metadata 4.11.3
importlib-metadata 5.1.0
importlib-resources 5.10.1
iniconfig 1.1.1
inquirerpy 0.3.4
intel-openmp 2021.4.0
ipykernel 6.19.2
ipython-genutils 0.2.0
ipython 8.7.0
jedi 0.18.2
jinja2 3.0.1
joblib 1.1.0
joblib 1.2.0
jsmin 3.0.1
json5 0.9.10
jsonschema 4.17.3
junitparser 2.1.1
jupyter-tensorboard 0.2.0
jupyter_client 7.4.8
jupyter_core 5.1.0
jupyterlab-pygments 0.2.2
jupyterlab-server 1.2.0
jupyterlab 2.3.2
jupytext 1.14.4
kiwisolver 1.4.4
langcodes 3.3.0
librosa 0.9.2
lintrunner 0.9.2
lit 17.0.3
livereload 2.6.3
llvmlite 0.39.1
locket 1.0.0
lunr 0.6.2
markdown-include 0.6.0
markdown-it-py 2.1.0
matplotlib-inline 0.1.6
matplotlib 3.5.3
matplotlib 3.6.2
mccabe 0.6.1
mdit-py-plugins 0.3.3
mdurl 0.1.2
mergedeep 1.3.4
mistune 2.0.4
mkdocs-git-revision-date-localized-plugin 1.0.1
mkdocs-material-extensions 1.0.3
mkdocs-material 8.2.10
mkdocs-minify-plugin 0.5.0
mkdocs-simple-hooks 0.1.5
mkdocs 1.3.0
mkl-devel 2021.1.1
mkl-include 2021.1.1
mkl 2021.1.1
mock 4.0.3
mpmath 1.2.1
msgpack 1.0.4
multidict 6.0.4
murmurhash 1.0.9
mypy 0.600
mypy 0.770
mypy 0.782
mypy 0.960
myst-nb 0.13.2
nbclient 0.7.2
nbconvert 7.2.6
nbformat 5.7.0
nbsphinx 0.8.8
nest-asyncio 1.5.6
networkx 2.6.3
networkx 2.8.7
ninja 1.10.0.post1
ninja 1.11.1.1
nltk 3.7
nose 1.3
notebook 6.4.10
numba 0.49.0
numba 0.54.1
numba 0.55.2
numba 0.56.0
numba 0.56.4
numpy 1.16.6
numpy 1.19.0
numpy 1.19.3
numpy 1.19.4
numpy 1.19.5
numpy 1.20.0
numpy 1.21.3
numpy 1.21.5
numpy 1.22.2
nvidia-cublas-cu11 11.10.3.66
nvidia-cuda-cupti-cu11 11.7.101
nvidia-cuda-nvrtc-cu11 11.7.99
nvidia-cuda-runtime-cu11 11.7.99
nvidia-cudnn-cu11 8.5.0.96
nvidia-cufft-cu11 10.9.0.58
nvidia-curand-cu11 10.2.10.91
nvidia-cusolver-cu11 11.4.0.1
nvidia-cusparse-cu11 11.7.4.91
nvidia-dali-cuda110 1.20.0
nvidia-nccl-cu11 2.14.3
nvidia-nvtx-cu11 11.7.91
nvidia-pyindex 1.0.9
nvidia-tensorrt 8.4.3.1
nvtx 0.2.5
oauthlib 3.2.2
onnx 1.12.0
opencv 4.6.0
opt-einsum 3.3
packaging 21.3
packaging 22.0
pandas 1.1.5
pandas 1.5.2
pandocfilters 1.5.0
parso 0.8.3
partd 1.3.0
pathy 0.10.1
pexpect 4.8.0
pfzy 0.3.4
pickleshare 0.7.5
pillow 7.1.0
pip 21.2.4
pkgutil_resolve_name 1.3.10
plantuml-markdown 3.5.2
plantuml 0.3.0
platformdirs 2.6.0
pluggy 1.0.0
polygraphy 0.43.1
pooch 1.6.0
pre-commit 2.20.0
preshed 3.0.8
prettytable 3.5.0
prometheus-client 0.15.0
prompt-toolkit 3.0.36
protobuf 3.16.0
protobuf 3.20.1
protobuf 3.20.2
psutil 5.9.1
psutil 5.9.4
psutil 5.9.5
ptyprocess 0.7.0
pure-eval 0.2.2
pyarrow 9.0.0
pyasn1-modules 0.2.8
pyasn1 0.4.8
pybind11 2.10.1
pybind11 2.6.2
pycocotools 2.0 nv0.7.1
pycodestyle 2.6.0
pycparser 2.21
pydantic 1.10.2
pyflakes 2.2.0
pygments 2.12.0
pylibcugraph 22.10.0a0 113.g6bbdadf8.dirty
pylibraft 22.10.0a0 81.g08abc72.dirty
pymdown-extensions 9.3
pynvml 11.4.1
pyparsing 3.0.8
pyparsing 3.0.9
pyrsistent 0.19.2
pytest-rerunfailures 10.2
pytest-rerunfailures 10.3
pytest-shard 0.1.2
pytest-xdist 3.0.2
pytest-xdist 3.1.0
pytest 4.6.9
pytest 6.1.2
pytest 6.2.4
pytest 7.0.0
pytest 7.2.0
python-dateutil 2.8.2
python-dotenv 1.0.0
python-etcd 0.4.5
python-hostlist 1.21
python-hostlist 1.22
pytorch-quantization 2.1.2
pytz 2022.1
pytz 2022.6
pyyaml 6.0
pyyaml_env_tag 0.1
pyzmq 24.0.1
raft-dask 22.10.0a0 81.g08abc72.dirty
ray 2.7.1
regex 2022.10.31
regex 2022.4.24
requests-oauthlib 1.3.1
requests 2.26
requests 2.27.1
requests 2.28.1
resampy 0.4.2
rich 10.9.0
rmm 22.10.0a0 38.ge043158.dirty
rockset 0.8.10
rsa 4.9
safetensors 0.4.0
scikit-learn 0.24.2
scipy 1.2.3
scipy 1.5.4
scipy 1.6.3
scipy 1.8.0
scipy 1.8.1
scipy 1.9.0
sentencepiece 0.1.99
setproctitle 1.2.2
setuptools 59.5.0
simplejson 3.17.5
six 1.16.0
smart-open 6.3.0
smmap 5.0.0
sniffio 1.3.0
sortedcontainers 2.4.0
soundfile 0.11.0
soupsieve 2.3.2.post1
spacy-legacy 3.0.10
spacy-loggers 1.0.4
spacy 3.4.4
sphinx-copybutton 0.5.0
sphinx-gallery 0.3.1
sphinx-glpi-theme 0.3
sphinx-panels 0.4.1
sphinx 1.8.2
sphinx 2.3.1
sphinx 3.1.2
sphinx 3.5.4
sphinx 4.5.0
sphinx 5.0.0
sphinx 5.0.2
sphinx_rtd_theme 0.4.3
sphinx_rtd_theme 1.0.0
sphinxcontrib-moderncmakedomain 3.19
sphinxcontrib-moderncmakedomain 3.21.4
sphinxcontrib-napoleon 0.7
sphinxcontrib-svg2pdfconverter 1.1.1
sphinxcontrib-svg2pdfconverter 1.2.0
srsly 2.4.5
stack-data 0.6.2
starlette 0.27.0
sympy 1.11.1
tbb 2021.7.1
tblib 1.7.0
tensorboard-data-server 0.6.1
tensorboard-plugin-wit 1.8.1
tensorboard 2.10.0
tensorboard 2.9.0
tensorrt 8.5.1.7
terminado 0.17.1
thinc 8.1.5
threadpoolctl 3.1.0
timm v0.4.12
tinycss2 1.2.1
tokenizers 0.14.1
toml 0.10.2
tomli 2.0.1
toolz 0.12.0
torch-tensorrt 1.3.0a0
torch 1.13.0.dev20220921
torch 1.6.0
torch 2.0.1
torchtext 0.13.0a0 fae8e8c
torchtriton 2.0.0
torchvision 0.14.0.dev20220921
torchvision 0.15.0a0
torchvision 0.7.0
tornado 6.1
tqdm 4.64.0
tqdm 4.64.1
traitlets 5.7.1
transformer-engine 0.3.0
transformers 4.17.0
transformers 4.34.1
treelite-runtime 2.4.0
treelite 2.4.0
triton 2.0.0
typer 0.7.0
typing_extensions 4.4.0
ucx-py 0.27.0a0 29.ge9e81f8
uff 0.6.9
urllib3 1.26.13
urllib3 1.26.9
uvicorn 0.23.2
uvloop 0.18.0
vllm 0.2.1.post1
wasabi 0.10.1
watchdog 2.1.7
watchfiles 0.21.0
wcwidth 0.2.5
webencodings 0.5.1
websockets 11.0.3
wheel 0.38.4
xdoctest 1.0.2
xformers 0.0.22
xgboost 1.6.2
yarl 1.9.2
zict 2.2.0
zipp 3.11.0
zipp 3.8.0

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Docker

simonmok/vllm : demo

Dependencies