Skip to content
TheChatArchiveThe Chat Archive
gpt-4.1-mini-2025-04-14· OpenAIAi2 WildChat-4.8M (AI2)

flash-attention follow this video above ^ Triton python.exe -m pip install…

  1. User

    flash-attention follow this video above ^

    Triton python.exe -m pip install https://huggingface.co/madbuda/triton-windows-builds/resolve/main/triton-3.0.0-cp310-cp310-win_amd64.whl

    sageattention python.exe -m pip install sageattention==1.0.6

    xformers python.exe -m pip install --pre -U xformers

    "this for my reference for future" << please remake or improve this word I want to share and I also want to remind my self If I need install again<<make word

  2. Assistant

    Here's a polished and clear version you can use to share and remind yourself for future reference regarding installing these packages:


    Reference for Installing Flash-Attention and Dependencies

    Use the following commands to install the necessary libraries:

    • Triton (Windows build):
    python.exe -m pip install https://huggingface.co/madbuda/triton-windows-builds/resolve/main/triton-3.0.0-cp310-cp310-win_amd64.whl
    
    • SageAttention (version 1.0.6):
    python.exe -m pip install sageattention==1.0.6
    
    • xformers (latest pre-release upgrade):
    python.exe -m pip install --pre -U xformers
    

    Save this as a quick setup guide for installing Flash-Attention dependencies whenever you need to reinstall or set up a new environment.


    If you'd like, I can make it even shorter or more detailed!