Skip to content
TheChatArchiveThe Chat Archive
gpt-4.1-mini-2025-04-14· OpenAIHugging Face LMArena Human Preference 140K

How do I download this gguf from the temrinal? Can I use wget or curl or do I have to…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with grok-3-preview-02-24’s answer.
  1. User

    How do I download this gguf from the temrinal? Can I use wget or curl or do I have to use hugging-cli? https://huggingface.co/mradermacher/Veritas-12B-GGUF/blob/main/Veritas-12B.Q5_K_S.gguf

  2. Assistant

    To download the GGUF file from Hugging Face via the terminal, you have a few options:

    1. Using wget or curl

    Directly using wget or curl on the URL you provided won't work because the URL points to the Hugging Face web page, not the raw file. You need the direct download link to the file.

    For example, the URL you gave is:

    https://huggingface.co/mradermacher/Veritas-12B-GGUF/blob/main/Veritas-12B.Q5_K_S.gguf
    

    This is a webpage, not the raw file.

    To get the raw file URL:

    • Go to the page in your browser.
    • Click on the "Download" button or "Raw" button (if available).
    • The raw file URL usually looks like:
    https://huggingface.co/mradermacher/Veritas-12B-GGUF/resolve/main/Veritas-12B.Q5_K_S.gguf
    

    Notice the difference: blob is replaced by resolve.

    So, you can try:

    wget https://huggingface.co/mradermacher/Veritas-12B-GGUF/resolve/main/Veritas-12B.Q5_K_S.gguf
    

    or

    curl -L -O https://huggingface.co/mradermacher/Veritas-12B-GGUF/resolve/main/Veritas-12B.Q5_K_S.gguf
    

    The -L flag in curl follows redirects, and -O saves the file with the original filename.

    2. Using huggingface-cli

    If the repository requires authentication (e.g., private repo or gated model), you need to use the huggingface-cli tool:

    • Install it if you haven't:
    pip install huggingface_hub
    
    • Login:
    huggingface-cli login
    
    • Download the file:
    huggingface-cli repo clone mradermacher/Veritas-12B-GGUF
    

    or use the huggingface_hub Python API to download specific files.

    Summary

    • If the model is public, try the direct download link with wget or curl by replacing blob with resolve.
    • If the model is private or requires authentication, use huggingface-cli to login and download.

    Example command:

    wget https://huggingface.co/mradermacher/Veritas-12B-GGUF/resolve/main/Veritas-12B.Q5_K_S.gguf
    

    If you get a 404 or access denied, then you need to authenticate with huggingface-cli.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.