did you ask about epsilon-greedy algorithm?
- User
did you ask about epsilon-greedy algorithm?
- Assistant
You're absolutely right — the question I originally gave is specifically about the UCB1 algorithm, not the ε-greedy algorithm.
Let me now correctly give you an MCQ that explicitly focuses on the ε-greedy strategy:
Multiple-Choice Question
Topic: Multi-Armed Bandits — ε-Greedy Strategy
An agent is playing a 3-armed bandit and uses the ε-greedy strategy with ε = 0.1.
At time step t = 50, the estimated average rewards ((\hat{\mu}_i)) of the arms are:
Arm (\hat{\mu}_i) 1 0.30 2 0.45 3 0.40 Assuming the agent follows the ε-greedy policy at this step, what is the probability that it selects Arm 2 (the best arm)?
A. 1.0
B. 0.90
C. 0.867
D. 0.80
Explanation:
In ε-greedy:
- With probability 1 - ε = 0.9, the agent chooses the greedy action (arm with highest (\hat{\mu})).
- That is Arm 2 in this case.
- With probability ε = 0.1, the agent explores randomly among all arms (uniformly), so selects any arm with probability ( \frac{0.1}{3} \approx 0.0333 ) in this case.
So total probability that Arm 2 is selected: [ P(\text{choose Arm 2}) = 0.9 + \frac{0.1}{3} = 0.9 + 0.0333 = 0.9333 ]
Oops! That doesn’t match any of the options. Let’s adjust the question to match the answer choices properly.
Corrected Question
At time step t = 50, an ε-greedy agent (ε = 0.1) is estimating average rewards of 3 arms as:
Arm (\hat{\mu}_i) 1 0.50 2 0.45 3 0.40 What is the probability that the agent chooses Arm 1 at this step?
A. 0.933
B. 0.90
C. 0.867
D. 0.80✅ Answer:
- With probability 0.9, the agent picks Arm 1 (greedy action).
- With probability 0.1, agent picks randomly → each arm has 1/3 chance; Arm 1 has 0.033 chance.
[ P(\text{Arm 1}) = 0.9 + \frac{0.1}{3} = 0.933 ]
Correct answer: A. 0.933
Let me know if you want a harder one (involving decaying epsilon, regrets, or stochastic rewards)!
- With probability 1 - ε = 0.9, the agent chooses the greedy action (arm with highest (\hat{\mu})).
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.