Skip to content
TheChatArchiveThe Chat Archive
Claudeclaude-sonnet-4-20250514· AnthropicHugging Face LMArena Human Preference 140K

sudo docker run --runtime nvidia --gpus all \ -v…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Claudeclaude-3-7-sonnet-20250219-thinking-32k’s answer.
  1. User

    sudo docker run --runtime nvidia --gpus all
    -v ~/.cache/huggingface:/root/.cache/huggingface
    -p 8000:8000
    --ipc=host
    vllm/vllm-openai:latest
    --model Deepseek/DeepSeek-R1-0528-Qwen3-8B [sudo] xuyan 的密码: docker: Error response from daemon: unknown or invalid runtime name: nvidia

    Run 'docker run --help' for more information

    这个怎么解决?

  2. Claude Assistant

    这个错误表示Docker找不到nvidia运行时。这通常是因为没有安装或配置NVIDIA Container Toolkit。以下是解决步骤:

    1. 安装NVIDIA Container Toolkit

    Ubuntu/Debian系统:

    # 添加NVIDIA包仓库
    curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg
    curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
        sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
        sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
    
    # 更新包列表并安装
    sudo apt-get update
    sudo apt-get install -y nvidia-container-toolkit
    

    CentOS/RHEL/Fedora系统:

    curl -s -L https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo | \
        sudo tee /etc/yum.repos.d/nvidia-container-toolkit.repo
    
    sudo yum install -y nvidia-container-toolkit
    

    2. 配置Docker运行时

    sudo nvidia-ctk runtime configure --runtime=docker
    sudo systemctl restart docker
    

    3. 验证安装

    sudo docker run --rm --runtime=nvidia --gpus all nvidia/cuda:11.0.3-base-ubuntu20.04 nvidia-smi
    

    4. 重新运行你的命令

    安装完成后,你的原始命令应该就能正常工作了:

    sudo docker run --runtime nvidia --gpus all \
        -v ~/.cache/huggingface:/root/.cache/huggingface \
        -p 8000:8000 \
        --ipc=host \
        vllm/vllm-openai:latest \
        --model Deepseek/DeepSeek-R1-0528-Qwen3-8B
    

    临时解决方案

    如果你暂时不需要GPU支持,可以移除GPU相关参数:

    sudo docker run \
        -v ~/.cache/huggingface:/root/.cache/huggingface \
        -p 8000:8000 \
        --ipc=host \
        vllm/vllm-openai:latest \
        --model Deepseek/DeepSeek-R1-0528-Qwen3-8B
    

    不过这样模型会在CPU上运行,速度会很慢。

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.