Skip to content
The Chat Archive
gpt-4o-2024-05-13· OpenAI WildChat-4.8M (AI2)

The instructions for the coding test are as follows:" Votee would like to conduct the…

  1. User

    The instructions for the coding test are as follows:"

    Votee would like to conduct the coding test in a recorded live session. The idea is to connect to an API that plays a Wordle-like puzzle. You can find the API documentation at the following link: https://wordle.votee.dev:8000/redoc

    Developers are allowed to use any frameworks, IDEs, chatbots, LLMs, or other resources to write their program and showcase their skill set. However, if you take references from other open-source projects or tutorials, please ensure that proper credit is given. Plagiarism will not be tolerated, and it may affect the evaluation of your application.

    Your task is to write a program that automatically guesses random words against the API, using the following command as an example: curl -v ‘https://wordle.votee.dev:8000/random?guess=theft&seed=1234'" If I run curl -v ‘https://wordle.votee.dev:8000/random?guess=theft&seed=1234 in the terminal, the output: StatusCode : 200 StatusDescription : OK Content : [{"slot":0,"guess":"t","result":"correct"},{"slot":1,"guess":"h","result":"correct"},{"slot":2,"guess":"e","result":"correct"}, {"slot":3,"guess":"f","result":"correct"},{"slot":4,"guess":"t","result":... RawContent : HTTP/1.1 200 OK Content-Length: 211 Content-Type: application/json Date: Sun, 26 May 2024 08:27:33 GMT Server: uvicorn

                    [{"slot":0,"guess":"t","result":"correct"},{"slot":1,"guess":"h","result":...
    

    Forms : {} Headers : {[Content-Length, 211], [Content-Type, application/json], [Date, Sun, 26 May 2024 08:27:33 GMT], [Server, uvicorn]} Images : {} InputFields : {} Links : {} ParsedHtml : mshtml.HTMLDocumentClass RawContentLength : 211

    My Python program that guess the words: "import random import requests import json

    Load the word list from a file.

    with open("C:/Users/a/Desktop/wordle/valid-wordle-words.txt", 'r') as file: word_list = [line.strip() for line in file.readlines()]

    API base URL

    base_url = 'https://wordle.votee.dev:8000/random'

    Function to make a guess by calling the API.

    def make_guess(guess, seed): response = requests.get(f"{base_url}?guess={guess}&seed={seed}") if response.status_code == 200: # Check if the response status code is 200 (OK) return response.json() # Return the JSON response else: print("Failed to call the api.") return None # Return None if the request was not successful

    Function to filter the word list based on feedback

    def filter_word_list(word_list, feedback): new_word_list = word_list[:] # Create a copy of the current word list for feedback_item in feedback: # Iterate through each item in the feedback slot = feedback_item["slot"] # The position of the letter in the guessed word (get values of a dict) guess = feedback_item["guess"] # The guessed letter result = feedback_item["result"] # The result (‘correct’, ‘present’, ‘absent’)

        if result == "correct":
            new_word_list = [word for word in new_word_list if word[slot] == guess] # word is in new_word_list
        elif result == "present":
            new_word_list = [word for word in new_word_list if guess in word and word[slot] != guess]
        elif result == "absent":
            new_word_list = [word for word in new_word_list if guess not in word]
    return new_word_list
    

    # Function to solve the puzzle

    def solve_puzzle(seed): attempts = 0 current_word_list = word_list print(f"Words remaining in the list: {len(current_word_list)}")

    while current_word_list:  
        guess = current_word_list[0]  
        print(f"Attempt {attempts + 1}: Guessing '{guess}'...") 
        feedback = make_guess(guess, seed) # Get feedback for the guessed word
    
        # Check if the API call was successful and we received feedback
        if feedback:
            print(f"Feedback: {feedback}")
    
            if all(item['result'] == 'correct' for item in feedback):  
                print(f"Solved with guess: {guess}") # Print the solved message
                return guess # Return the correct guess
    
            current_word_list = filter_word_list(current_word_list, feedback)
    
            print(f"Words remaining in the list: {len(current_word_list)}") 
    
            print("Error: No feedback received.")
            return None
    
        attempts += 1 # Increment the number of attempts
    
        # Check if attempts exceeded 6 and print failure message if so
        if attempts >= 6:
            print("Failed to solve the puzzle within 6 attempts.")
    

    Test with one random word

    seed = random.randint(0, 1000) # Generate a random seed print(f"seed:{seed}") solve_puzzle(seed) # Solve the puzzle using the random seed" Add a simple function(as simple as possible) to test with 10 word (from seed 0 to 9) and print the worst case(most number of attempt) and mean case (mean number of attempt).

  2. Assistant

    Certainly! To test the solution with 10 different seeds (from 0 to 9) and print the worst and mean case (number of attempts), you can create an additional function that runs the solve_puzzle function for each seed and keeps track of the attempts. Below is the modified code with the requested function:

    import random
    import requests
    import json
    from statistics import mean
    
    # Load the word list from a file.
    with open("C:/Users/a/Desktop/wordle/valid-wordle-words.txt", 'r') as file:
        word_list = [line.strip() for line in file.readlines()]
    
    # API base URL
    base_url = 'https://wordle.votee.dev:8000/random'
    
    
    # Function to make a guess by calling the API.
    def make_guess(guess, seed):
        response = requests.get(f"{base_url}?guess={guess}&seed={seed}") 
        if response.status_code == 200: # Check if the response status code is 200 (OK)
            return response.json() # Return the JSON response
        else:
            print("Failed to call the API.")
            return None # Return None if the request was not successful
            
    # Function to filter the word list based on feedback
    def filter_word_list(word_list, feedback):
        new_word_list = word_list[:]  # Create a copy of the current word list
        for feedback_item in feedback: # Iterate through each item in the feedback
            slot = feedback_item["slot"] # The position of the letter in the guessed word (get values of a dict)
            guess = feedback_item["guess"] # The guessed letter
            result = feedback_item["result"] # The result (‘correct’, ‘present’, ‘absent’)
    
            if result == "correct":
                new_word_list = [word for word in new_word_list if word[slot] == guess] # Word is in new_word_list
            elif result == "present":
                new_word_list = [word for word in new_word_list if guess in word and word[slot] != guess]
            elif result == "absent":
                new_word_list = [word for word in new_word_list if guess not in word]
        return new_word_list
    
    # Function to solve the puzzle
    def solve_puzzle(seed):
        attempts = 0
        current_word_list = word_list 
        print(f"Words remaining in the list: {len(current_word_list)}")
    
        while current_word_list:  
            guess = current_word_list[0]  
            print(f"Attempt {attempts + 1}: Guessing '{guess}'...") 
            feedback = make_guess(guess, seed) # Get feedback for the guessed word
    
            # Check if the API call was successful and we received feedback
            if feedback:
                print(f"Feedback: {feedback}")
    
                if all(item['result'] == 'correct' for item in feedback):  
                    print(f"Solved with guess: {guess}") # Print the solved message
                    return attempts + 1 # Return the number of attempts
    
                current_word_list = filter_word_list(current_word_list, feedback)
                print(f"Words remaining in the list: {len(current_word_list)}") 
    
            attempts += 1 # Increment the number of attempts
    
            # Check if attempts exceeded 6 and print failure message if so
            if attempts >= 6:
                print("Failed to solve the puzzle within 6 attempts.")
                return attempts # Return the number of attempts if failed
    
        return attempts
    
    # Function to test with 10 seeds and print the worst and mean case
    def test_multiple_seeds(start_seed, end_seed):
        attempts_list = []
    
        for seed in range(start_seed, end_seed + 1):
            print(f"\nTesting seed: {seed}")
            attempts = solve_puzzle(seed)
            attempts_list.append(attempts)
    
        print("\n--- Results ---")
        print(f"Attempts List: {attempts_list}")
        print(f"Worst Case (most attempts): {max(attempts_list)}")
        print(f"Mean Case (mean attempts): {mean(attempts_list)}")
    
    
    # Test with seeds from 0 to 9
    test_multiple_seeds(0, 9)
    

    Here is what we did:

    • Added a function test_multiple_seeds to run tests for seeds from a start value to an end value.
    • The function stores the number of attempts for each seed and then prints the worst and mean case attempts.
    • Adjusted the solve_puzzle function to return the number of attempts it took to solve or realize it couldn't solve within the limit of 6 attempts.

    This function will run the puzzle solver for seeds 0 through 9 and give you the worst and mean case statistics.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.