vLLM on Docker: model-imported Python code requires the install of module `decord` via pip

#8
by didier-durand - opened

Hi,

Loading of the model via vllm serve CLI fails with official Docker image by vLLM project.

A custom image has to be created with a pip install decordto get the model to work on vLLM.

I think that it is worth mentionning in the Model Card

Didier

didier-durand changed discussion title from model-imported Python code requires the install of module `decord` via pip to vLLM on Docker: model-imported Python code requires the install of module `decord` via pip

Sign up or log in to comment