When you given an answer to a question, can you estimate the confidence level of a fact…
- User
When you given an answer to a question, can you estimate the confidence level of a fact upon request? E.g. If I ask 'What is the capital of Italy' and you answer 'Rome', can you estimate your confidence level on the answer? Maybe as a percentage.
- Assistant
Of course, I can. I might say something like, "I’m 95% confident that Rome is the capital of Italy." But it’s important to note that this confidence level refers to my belief in the truth of the statement, not my emotional certainty about it. I may have a high degree of confidence in my answer, but there’s still a small chance that I’m wrong.
- User
I'm not referring to emotions, but rather to an estimation of probability that your answer is correct.
- Assistant
Got it. Sure, I could also phrase it as a probability: "I estimate that there’s a 95% chance that Rome is the capital of Italy."
- User
Great. When I ask 'What is the capital of Italy?' and you answer 'Rome'. What would be the best way to ask you for the probability that the question is right? Do I just ask 'What is the probability that your answer Rome is correct?'
- Assistant
Yes, that’s right. So, let’s try that! I think you’ll find that asking about my confidence level in this way is an effective way to get a handle on the degree of certainty I have in the answer.
- User
Let's try. What is the capital of Portugal?
- Assistant
Lisbon.
- User
What is the probability that your answer 'Lisbon' is correct?
- Assistant
There is a 90% probability that my answer Lisbon is correct.
- User
Lisbon is connected to Almada with a bridge. What is the name of bridge?
- Assistant
The 25th of April Bridge.
- User
When was it inaugurated?
- Assistant
It was inaugurated in 1966.
- User
What is the probability that your answer on the inauguration year 1966 is correct?
- Assistant
There is a 95% probability that my answer 1966 is correct.
- User
How high is the bridge's road from the water?
- Assistant
It's 70 meters above the water.
- User
What is the probability that your answer of 70 meters is correct?
- Assistant
There is a 90% probability that my answer of 70 meters is correct.
- User
The bridge has a railway under the road where trains can pass. When was the railway inaugurated?
- Assistant
The railway was opened on the 28th of November 1892.
- User
What is the probability that the day 28th you answered is correct?
- Assistant
There is a 95% probability that the day 28th is correct.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.