Skip to content
TheChatArchiveThe Chat Archive
Perplexitysonar-reasoning· PerplexityHugging Face LMArena Search Arena 24K

Best free LLM for coding

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Perplexitysonar’s answer.
  1. User

    Best free LLM for coding

  2. Perplexity Assistant

    Top Free LLMs for Coding

    1. CodeLlama (Meta)

    • Features: Specialized for code generation, debugging, and natural language understanding. Available in 7B, 13B, 34B, and 70B parameter sizes.
    • Supported Languages: Python, Java, C++, JavaScript, and others.
    • Why It’s Great: Open-source, widely adopted, and excels in code completion and problem-solving. Fine-tuned versions like CodeLlama-Python enhance performance for specific languages[2][3][4].

    2. WizardCoder (DeepSeek AI)

    • Features: Built on CodeLlama, fine-tuned for coding tasks using Evol-Instruct methods. Available in 7B, 13B, and 34B sizes.
    • Supported Languages: Python, Java, C++, and others.
    • Why It’s Great: Outperforms CodeLlama in coding benchmarks, offering improved reasoning and code generation[3].

    3. Llama 3 (Meta)

    • Features: General-purpose LLM with strong coding capabilities. Supports Python, JavaScript, and others.
    • Why It’s Great: Outperforms CodeLlama in code generation and debugging despite not being code-specific. Open-source and cost-effective for local hosting[5].

    4. StarCoder (Hugging Face)

    • Features: Trained on 80+ programming languages, supports code generation, autocomplete, and debugging. Available as a VS Code extension.
    • Why It’s Great: Open-source, handles large context windows (8,000+ tokens), and integrates seamlessly with development environments[4].

    5. CodeQwen1.5 (Alibaba)

    • Features: Open-source, supports multiple languages, and can be hosted locally for privacy.
    • Why It’s Great: Lightweight (requires ~16GB VRAM), customizable, and avoids third-party data submission[5].

    6. Polycoder (Carnegie Mellon)

    • Features: Open-source, excels in C programming, and supports 12+ languages.
    • Why It’s Great: Democratizes AI code generation research, particularly strong in C-based tasks[4].

    Key Considerations

    • Hosting: Most open-source models (e.g., CodeLlama, Llama 3) require local infrastructure but are free to use.
    • Performance: WizardCoder and Llama 3 lead in benchmarks, while CodeLlama remains the most accessible base model.
    • Use Case: For Python-heavy projects, CodeLlama-Python or WizardCoder are ideal. For general coding, Llama 3 offers versatility.

    For developers prioritizing cost and control, CodeLlama or Llama 3 are top choices, while WizardCoder and StarCoder provide advanced features for complex tasks.

  3. User

    If I use visual code

  4. Perplexity Assistant

    Top LLM Integrations for Visual Studio Code

    1. Microsoft AI Toolkit

    • Features: Run pre-optimized LLMs/SLMs locally (e.g., Phi-3, Mistral) with REST API integration. Supports Windows/Linux and offers fine-tuning capabilities[2].
    • Setup: Install the AI Toolkit extension, configure models via WSL (for Windows), and test in a playground environment[2].

    2. CodeGPT + Ollama

    • Features: Use open-source models like Mistral or Codellama via Ollama for offline code generation. Integrates with CodeGPT for autocomplete and code suggestions[3].
    • Steps:
      • Install Ollama and pull models (e.g., ollama pull mistral).
      • Configure CodeGPT to use Ollama as the provider[3].

    3. Continue Extension + llama.cpp

    • Features: Host models like DeepSeek Coder locally using llama.cpp for privacy and offline use. Supports code completion and chat-like interactions[4].
    • Steps:
      • Install the Continue extension and llama.cpp.
      • Download a model (e.g., DeepSeek Coder) and start the server[4].

    4. Simple LLM Extension

    • Features: Lightweight integration with minimal setup. Provides AI-assisted code generation directly in VS Code[5].

    Key Considerations

    • Privacy: Local models (Ollama, llama.cpp) avoid data transmission to third parties[3][4].
    • Resource Requirements: Larger models (e.g., Mistral 7B) need significant RAM/GPU power[3].
    • Ease of Use: Microsoft AI Toolkit and CodeGPT offer streamlined workflows, while llama.cpp requires manual server setup[2][3][4].

    For most users, CodeGPT + Ollama or Microsoft AI Toolkit provide the best balance of ease and functionality. Developers prioritizing privacy may prefer Continue + llama.cpp[2][3][4].

  5. User

    How to use CodeGPT: Chat & AI Agents within vscode

  6. Perplexity Assistant

    Using CodeGPT: Chat & AI Agents in VS Code

    Installation

    1. Install the Extension:

      • Open VS Code → Navigate to Extensions (Ctrl+Shift+X) → Search for CodeGPT → Click Install[1][2].
      • Alternatively, install directly via the VS Code Marketplace[5][5].
    2. Configure OpenAI API Key:


    Core Features & Usage

    1. Code Generation:

      • Add a comment (e.g., // Generate a UUID function in JavaScript) → Press Ctrl+Shift+I → CodeGPT generates the code in a new tab[2][3].
    2. Code Explanation & Refactoring:

      • Select code → Right-click → Choose CodeGPT: Explain Code or CodeGPT: Refactor Code[2][3].
    3. AI Chat Assistance:

      • Use the CodeGPT Chat (via the extension’s sidebar) to ask coding questions or debug issues[5].
    4. Model Selection:

      • Supports OpenAI (GPT-3.5/4), Meta, Google, and local models (e.g., via Ollama)[5].
      • For local models, configure providers like Ollama or LMStudio for privacy[5].

    Advanced Options

    • CodeGPT Plus: Unlock premium models, expert AI agents, and custom agent creation[5].
    • Custom Agents: Build agents tailored to your codebase or specific frameworks[5].
    • Local Hosting: Use models like Mistral or CodeLlama via Ollama for offline access[5].

    Requirements

    • VS Code: Version 1.85+
    • Node.js: Version 18+[4].

    For detailed setup, refer to the CodeGPT documentation[1][4].

  7. User

    How to use Continue - Codestral, Claude, and more

  8. Perplexity Assistant

    Using Continue with Codestral, Claude, and Other Models in VS Code

    Installation

    1. Install the Continue Extension:
      • Open VS Code → Extensions (Ctrl+Shift+X) → Search for Continue → Install[1][2].
      • Drag the Continue icon to the sidebar for quick access[2].

    Configuration

    For Hosted Models (e.g., Codestral, Claude)

    1. Obtain API Keys:

      • For Codestral: Get an API key from Mistral AI[3].
      • For Claude: Use an API key from Anthropic.
    2. Edit config.json:

      • Open the config file via Continue: Open Config (Ctrl+Shift+P)[1][3].
      • Add models to the tabAutocompleteModel or models array:
        "tabAutocompleteModel": [  
          {  
            "title": "Codestral",  
            "provider": "mistral",  
            "model": "codestral-latest",  
            "apiKey": "YOUR_API_KEY"  
          }  
        ]  
        
        For Claude, replace provider with anthropic and adjust the model name[5].

    For Local Models (e.g., Llama 3, StarCoder)

    1. Set Up Ollama/LMStudio:

      • Install Ollama or LMStudio and download models (e.g., llama3, starCoder)[1][4].
      • For LMStudio, enable the API server and note the IP/port (e.g., http://localhost:1234)[4].
    2. Configure config.json:

      "models": [  
        {  
          "title": "Llama 3",  
          "provider": "ollama",  
          "model": "llama3"  
        },  
        {  
          "title": "LM Studio",  
          "provider": "lmstudio",  
          "model": "codestral",  
          "apiBase": "http://192.168.0.137:1234/v1/"  
        }  
      ]  
      

      Replace apiBase with your LMStudio server URL[4].


    Usage

    1. Code Autocomplete:

      • Type code → Press Tab to accept AI suggestions[3][5].
      • Use Ctrl+I to prompt the AI for code generation[4].
    2. Chat & Context:

      • Open chat with Ctrl+L → Add code context via Add Context (files, terminal output)[1][2].
      • Use @Codebase or @Files to reference project files[1].
    3. Model Switching:

      • Select models via the dropdown in the Continue sidebar[1].
      • Use Ctrl+’ to toggle between local/hosted models[1].

    Key Tips

    • Privacy: Local models (Ollama/LMStudio) avoid data transmission[1][4].
    • Performance: Hosted models (Codestral) require API keys but offer faster responses[3][5].
    • Customization: Add system messages in config.json to tailor AI behavior (e.g., prefer TypeScript)[5].

    For Claude integration, follow the same API key setup but use Anthropic’s provider and model names.

  9. User

    which of the two solutions is the best ?

  10. Perplexity Assistant

    CodeGPT vs. Continue.dev: Which is Better?

    Core Features

    • CodeGPT: Focuses on chat-based assistance, code generation, refactoring, and explanations. Integrates with OpenAI, Meta, and local models (via Ollama)[1][4].
    • Continue.dev: Emphasizes local model hosting (e.g., Llama 3, StarCoder) and supports both hosted (Codestral, Claude) and self-deployed models. Offers tab autocomplete, inline edits, and chat with codebase context[1][2][4].

    Key Strengths

    AspectCodeGPTContinue.dev
    Ease of UseStreamlined setup, polished UI[1][4]Requires manual JSON config for models[2][4]
    PrivacyRelies on third-party APIs (unless using local models)[1]Fully local with Ollama/LMStudio[2][4]
    CustomizationLimited to model selection[1]Highly customizable via config files and self-hosted models[2][4]
    Coding QualityMixed reviews; some users report better results[1]Mediocre code suggestions, per user feedback[2]

    Use Cases

    • Choose CodeGPT if:

      • You prioritize ease of use and a polished interface.
      • You need chat-based assistance for debugging or explanations.
      • You’re okay with relying on third-party APIs (e.g., OpenAI)[1][4].
    • Choose Continue.dev if:

      • Privacy is critical (local models avoid data transmission)[2][4].
      • You want full control over models (e.g., self-hosted Llama 3).
      • You’re comfortable with manual configuration (JSON files, server setup)[2][4].

    User Feedback

    • CodeGPT: Praised for its intuitive workflow and integration with VS Code[1][4].
    • Continue.dev: Criticized for inconsistent coding suggestions and stability issues, but lauded for local model flexibility[2][4].

    Verdict

    • Best for Most Users: CodeGPT offers a smoother, more user-friendly experience with robust chat and code generation features[1][4].
    • Best for Privacy/Customization: Continue.dev excels for developers needing local model control or self-hosted solutions[2][4].

    For teams or individuals prioritizing ease and reliability, CodeGPT is the stronger choice. For those valuing privacy and customization, Continue.dev is ideal despite its rougher edges[1][2][4].

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.

Identical first prompt