I noticed that some models I have, that appear in docker model list, when run with docker model run somemodel they say "the model isn't found, pulling from server", but then the cli proceeds to run, and then throws an error when i send the first message, as if the model doesn't exist.
Could be closely related to #634, with the main difference being in that other case the models do redownload, in this case they seem not to and the cli then starts normally
OS: Ubuntu 25.10
$ docker model version
Docker Model Runner version v1.0.2-99-gca12aae1-dirty
Docker Engine Kind: Docker Engine
$ docker model status
Docker Model Runner is running
Status:
mlx: not installed
sglang: python3 not found in PATH
vllm: vLLM binary not found
diffusers: python3 not found in PATH
llama.cpp: running llama.cpp version: c55bce4
Screenshot
I noticed that some models I have, that appear in
docker model list, when run withdocker model run somemodelthey say "the model isn't found, pulling from server", but then the cli proceeds to run, and then throws an error when i send the first message, as if the model doesn't exist.Could be closely related to #634, with the main difference being in that other case the models do redownload, in this case they seem not to and the cli then starts normally
OS: Ubuntu 25.10
Screenshot