Skip to content
The Chat Archive
qwq-32b· Alibaba (Qwen) LMArena Human Preference 140K

i need a module that checks https://beta.lmarena.ai/ and finds my LLM model. it is o3,…

  1. User

    i need a module that checks https://beta.lmarena.ai/ and finds my LLM model. it is o3, but when searching we cant by mistake find the o3-mini. then it needs to check its ranking. the model will usually not be found, which is fine, but once it is, i will need this info to trigger an action. if it is #1 we will do nothing (perhaps except an alert, no need to implement it tho). if it isnt, it will be used to sell ALL shares in polymarket (no need to implement, just so you know the purpose)

  2. Assistant

    Here's a Python module that uses Selenium to check Llama Arena for your "o3" model and its ranking. You'll need to install dependencies and adjust selectors based on the actual page structure:

    from selenium import webdriver
    from selenium.webdriver.common.by import By
    from selenium.webdriver.support.ui import WebDriverWait
    from selenium.webdriver.support import expected_conditions as EC
    from selenium.common.exceptions import TimeoutException, NoSuchElementException
    import time
    
    class LlamaArenaChecker:
        def __init__(self):
            # Initialize WebDriver (ensure ChromeDriver is installed)
            options = webdriver.ChromeOptions()
            options.add_argument('--headless')  # Run in headless mode
            self.driver = webdriver.Chrome(options=options)
        
        def get_o3_rank(self):
            try:
                # Navigate to the page
                self.driver.get("https://beta.lmarena.ai/")
                
                # Wait for models to load (adjust selector as needed)
                WebDriverWait(self.driver, 20).until(
                    EC.presence_of_element_located((By.CSS_SELECTOR, ".model-list"))
                )
                
                # Find all model entries
                models = self.driver.find_elements(By.CSS_SELECTOR, ".model-entry")
                
                for model in models:
                    try:
                        name_element = model.find_element(By.CSS_SELECTOR, ".model-name")
                        name = name_element.text.strip().lower()
                        
                        # Check exact match and exclude mini version
                        if name == "o3" and "mini" not in name:
                            rank_element = model.find_element(By.CSS_SELECTOR, ".rank-number")
                            return int(rank_element.text.strip())
                    
                    except NoSuchElementException:
                        continue  # Skip invalid entries
                
                return None  # Model not found
                
            except TimeoutException:
                print("Page load timeout")
                return None
            finally:
                self.driver.quit()
    
        def check_and_trigger(self):
            rank = self.get_o3_rank()
            
            if rank is not None:
                print(f"Model 'o3' found at rank #{rank}")
                if rank != 1:
                    print("Triggering sell action on Polymarket...")
                    # Add your Polymarket selling logic here
                else:
                    print("Rank #1 - No action needed")
            else:
                print("Model 'o3' not found on Llama Arena")
    
    if __name__ == "__main__":
        checker = LlamaArenaChecker()
        checker.check_and_trigger()
    

    Requirements:

    1. Install dependencies:
    pip install selenium
    
    1. Download ChromeDriver matching your browser version:

    2. Place ChromeDriver in your system PATH or specify its location in the code

    Notes:

    1. Selectors need adjustment: The CSS selectors (.model-list, .model-entry, .model-name, .rank-number) are placeholders. You'll need to inspect the actual page to find:

      • The container element for the model list
      • The class names for individual model entries
      • The exact classes used for model names and ranks
    2. Error handling:

      • Adds basic timeout and element not found handling
      • You can expand logging and error notification mechanisms
    3. Execution:

      • The script runs headless by default
      • Modify the check_and_trigger() method to integrate with your Polymarket API
    4. Performance:

      • Add exponential backoff/retry logic for unstable connections
      • Consider caching previous results to avoid unnecessary checks

    To use this effectively:

    1. Open browser developer tools on the target page
    2. Inspect elements to find correct selectors
    3. Update the CSS selectors in the code
    4. Test with different scenarios (model found/not found, different ranks)

    Would you like help with any specific part of the implementation?

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.