Skip to content
TheChatArchiveThe Chat Archive
Geminigemini-2.5-pro-exp-03-25-wo-search· GoogleHugging Face LMArena Search Arena 24K

in my mac, i installed llama.cpp with brew. how can i use the tool GGUF split in the…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Geminigemini-2.5-flash-preview-04-17-grounding’s answer.
  1. User

    in my mac, i installed llama.cpp with brew. how can i use the tool GGUF split in the command line?

  2. Gemini Assistant

    Okay, when you install llama.cpp using Homebrew on macOS, the auxiliary tools like gguf-split should typically be installed and linked into your system's PATH as well.

    Here's how you can find and use gguf-split:

    1. Verify Installation Location (Optional but recommended):

      • Open your Terminal.
      • Run which gguf-split.
      • This command should output the path to the executable, likely something like /usr/local/bin/gguf-split or /opt/homebrew/bin/gguf-split (depending on your Mac architecture and Brew setup). If it outputs a path, the tool is ready to use.
      • If which doesn't find it, try updating brew and llama.cpp:
        brew update
        brew upgrade llama.cpp
        
        Then try which gguf-split again.
      • As a last resort if which fails, list the files installed by the formula:
        brew list llama.cpp
        
        Look for gguf-split within the listed paths, particularly inside a bin directory. You might need to run it using its full path if it wasn't linked correctly for some reason.
    2. Check Usage Instructions:

      • Once you've confirmed the tool exists (or just try it directly), get its help message:
        gguf-split --help
        
      • This will display all the available options and the required arguments.
    3. Basic Usage:

      • The core function is to split a large GGUF file based on a maximum size per part.
      • The basic syntax is:
        gguf-split --split-max-size <max_size_mb> <input.gguf> <output_prefix>
        
        • --split-max-size <max_size_mb>: Specifies the maximum size for each output shard in MebiBytes (MiB). Note that 1 GiB = 1024 MiB.
        • <input.gguf>: The path to the large GGUF file you want to split.
        • <output_prefix>: The base name for the output files. The tool will append -XXXXX-of-YYYYY.gguf to this prefix (e.g., mymodel-split-00001-of-00003.gguf).
    4. Example:

      • Let's say you have a large model file named big-model-q4_0.gguf and you want to split it into chunks no larger than approximately 4 GiB (which is 4 * 1024 = 4096 MiB). You want the output files to start with big-model-q4_0-split.
      • Run the following command:
        gguf-split --split-max-size 4096 big-model-q4_0.gguf big-model-q4_0-split
        
      • This will create files in your current directory like:
        • big-model-q4_0-split-00001-of-0000N.gguf
        • big-model-q4_0-split-00002-of-0000N.gguf
        • ... and so on, up to N parts.

    Remember to replace <max_size_mb>, <input.gguf>, and <output_prefix> with your actual desired size, input file path, and output prefix. Make sure you have enough disk space for the split files.</output_prefix></input.gguf></max_size_mb></output_prefix></input.gguf></max_size_mb></output_prefix></input.gguf></max_size_mb>

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.