Skip to content
TheChatArchiveThe Chat Archive
Human-written demonstration (OpenAssistant volunteers)· OpenAssistant (human-written)Hugging Face OpenAssistant Conversations (oasst2)

Why are GPUs better than CPUs at performaing machine learning tasks?

In OpenAssistant data, “assistant” turns were written by human volunteers as demonstrations. They are not model outputs.
  1. User

    Why are GPUs better than CPUs at performaing machine learning tasks?

  2. Assistant

    GPUs are designed to perform matrix multiplication in parallel across several streaming multiprocessors. A cpu, while faster for a single multiply, cannot match the parallelism a GPU offers. Because matrix multiplication is used throughout machine learning, a GPU is often much better to use than a CPU.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.