Skip to content
The Chat Archive
o3-2025-04-16· OpenAI LMArena Human Preference 140K

Which LLM is better?

  1. User

    Which LLM is better?

  2. Assistant

    “Better” really depends on what you need the model to do. Here are some quick guidelines, followed by a comparison table and a few questions to help you narrow things down.

    1. Define the goal
      • Casual chat or creative writing?
      • Enterprise-grade reasoning or research?
      • Code generation?
      • On-device inference with tight latency or privacy constraints?

    2. Pick the metrics that matter to you
      • Raw accuracy / reasoning ability
      • Speed & cost
      • Model size & deployability (cloud vs. local)
      • Licensing / commercial terms
      • Tooling & ecosystem support

    3. Short headline answers
      • Best raw reasoning (today, June 2024): GPT-4o (OpenAI) and Claude 3 (Opus) are generally top of public leaderboards.
      • Best cost-to-performance open-weights: Llama-3 70B, Mixtral 8×22B, or Mistral-7B v0.2 depending on the hardware you have.
      • Easiest to fine-tune / run locally: Llama-3 and Mistral families (Apache 2 license).
      • Strongest for code: GPT-4o, Claude 3 (Opus/Sonnet) and specialized variants like DeepSeek-Coder or Code Llama.
      • Multimodal (image + text): GPT-4o and Gemini 1.5 Pro lead in publicly available models.


    Popular LLMs at a glance (June 2024)

    ModelProvider / LicenseParamsStrengthsWeak spotsTypical cost & access
    GPT-4oOpenAI (closed)~Trillions (Mixture-of-Experts)SOTA reasoning, multilingual, vision, audio; rich ecosystemClosed weights, usage cost, no local deployment$0.005-0.01 / 1K tokens (chat); API or ChatGPT
    Claude 3 (Opus)Anthropic (closed)undisclosed MoELong-context (200K+ tokens), strong reasoning, safe outputsClosed weights, priced higher than GPT-4o$15 / 1M input tokens
    Gemini 1.5 ProGoogle (closed)undisclosed MoE1M-token context, good multimodal, codeLimited public access, slower roll-outVertex AI, AI Studio
    Llama-3 70BMeta (Apache-2)70 BOpen weights, robust chat, easy fine-tuneNeeds high-end GPU for real-time chat; behind GPT-4o on complex tasksFree weights; infra cost only
    Mixtral 8×22BMistral (Apache-2)8 experts, 22 B eachGreat throughput/price, near-GPT-3.5 quality, open weightsLags GPT-4-class reasoningHugging Face / Mistral API
    Mistral-7B-v0.2Mistral (Apache-2)7 BRuns on laptop/phone, solid quality for sizeLimited reasoning depthFree weights
    DeepSeek-Coder 33BDeepSeek (Apache-2)33 BCode generation & completionGeneral chat weakerFree weights
    Command-RCohere (closed)undisclosedRetrieval-augmented design, enterprise docsClosed weightsCohere API

    Questions to pinpoint “better” for you

    1. Deployment: Do you need the model on-prem / offline, or is cloud fine?
    2. Budget: Are you optimizing for cost per 1 K tokens, or is quality paramount?
    3. Domain: Will it be used mostly for code, legal text, marketing copy, or general Q&A?
    4. Context length: Do you need 16K, 128K, or 1M-token windows?
    5. Compliance: Any data-sovereignty or licensing constraints?

    Feel free to share a bit more about your use-case, and I can give a sharper recommendation.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.