Skip to content
TheChatArchiveThe Chat Archive
gpt-4o-2024-08-06· OpenAIAi2 WildChat-4.8M (AI2)

Rate Answer Credibility Query: ugliest group of people in the world Query Location: San…

  1. User

    Rate Answer Credibility Query: ugliest group of people in the world Query Location: San Jose,California Answer: Irish men and German women are the ugliest in the WORLD according to controversial dating website beautifulpeople.com which only attractive people are allowed to join. Irish men and German women are the 'ugliest in the world' according to a controversial dating app that only allows attractive people to join.Feb 17, 2020 Answer Url: https://www.dailymail.co.uk/femail/article-8012643/Irish-men-German-wo... Required: What is the credibility level of the Query? (How much credibility would a user expect to need from a Source Page for this Query?) Required: Rate Answer Authority Optional Feedback

    Instructions Web Source Google Bing Instructions The authority of an answer’s source is very important to a user, especially when the query is about a critical topic such as health issues, legal matters, finances, etc. In this task, we provide a User Query, an Answer to their query pulled from a webpage, and the Answer URL of the site the answer was pulled from.

    Your task is to identify what level of credibility a user would expect for their query, then decide whether the shown answer is extracted from a credible enough source for a user to trust the answer to their query.

    HitApp Steps Credibility level Determine how important the credibility of the answer is to the user : High-Impact: The query is about a sensitive topic for which the credibility of the answer is important and could impact the user greatly. Eg.: health, finances, legal information, etc... Low-Impact: The query represents every-day question that can be answered by a reasonably authoritative source. There are also queries on topics which a user would not expect there to be institutions or authors having reputation in the topic (gossip, fan fiction, etc). Check the source page: You need to spend time looking at the source page of the answer to determine the credibility of the page. You can check the source page by clicking on the Answer URL or the Web Source tab on the top-right. Make sure the page is still available. If the page is unavailable or a 404 error, select "Not Credible". Investigate the Source Page to determine the credibility by investigating aspects of it such as: How much authority the page has on the topic The author of the site (if applicable) Any references/sources listed Note: If the source page is broken or returns an error (such as 404's, page not found, etc.) the final rating should be Not Credible.

    [ONLY HIGH IMPACT QUERIES] Compare the credibility of the Source Page to the Search Results: Once the credibility of the source page has been determined, look at the Google results tab and determine if there are any URLs with higher credibility in the search results. Note: Even if two results are “Credible” according to the table, one URL can still be more credible than the other. For example, for the query “How to Install Microsoft 10” both Quora.com and Microsoft.com would be seen as “Credible” in the table above, but Microsoft.com would be the highest authority on the topic and would be seen as more credible Select a rating using the table below: Rating Descriptions Detrimental

    High-Risk/Impact

    e.g., health, finances, legal information

    Low-Risk/Impact

    e.g., every-day questions, fan-fiction, gossip

    Credible

    Not Credible

    Credible

    Less Credible

    Not Credible

    The Answer or Source Page has Detrimental Content that we would not want to show the user. The categories below are further expanded upon in the “Detrimental Content” section below.

    Hate Adult Gore or Profane Unsafe Sensitive The Source Page is highly credible and there are no pages in the Search results that are more credible on the query topic.

    Example: Query: US Taxes URL: IRS.gov

    The Source Page is not credible enough for the query given and/or

    There are pages in the Search Results that are more credible than the Source Page on the query topic.

    Answer is from a highly credible or fairly credible source for the query topic.

    Answer is from a low-credibility source for the topic

    Answer is from a Source Page that is actively spammy, junky, misinformative, or otherwise harmful to the user. Additionally used for a Source Page with no credibility on the topic.

    Detrimental Content There are certain categories of content that we would not want to show users in the Answer or Source Page under any circumstances. If this type of content is found in the Answer or Source Page then the final rating should instantly be “Detrimental” regardless of any other factors. The categories for detrimental content are:

    Hate: Hateful content that is targeted towards a person/group that shares a certain attribute such as gender, race, occupation, age, national origin, religion. Adult: Content that is pornographic, suggestive, or sexualized Gore: Overly-violent or profane content Unsafe: Content which may steer someone towards hurting themselves or others such as suicide/self-harm, illegal drugs, or weapons. Sensitive: Content related to controversies, conspiracies, misinformation, fake news, traumatic historical events, known hate entities, and social issues such related to health, religion, politics, and civics. This can change depending on the market. Crime: Content that is seedy or illegal. This content will depend based on market/location. It's important to remember that Queries involving the topics above will not automatically make a Hit "Detrimental", the Answer and/or Source Page must contain detrimental information for a final rating of "Detrimental". Facts on the above topics that come from reputable sources should be rated normally, even if it's about a topic listed above.

    *** In order to see the search results on the right, you need to use Chrome browser, and install W5P Chrome Extension *** If the query or answer is in a different language from the one marked in the title, For example, if the hitapp title is "Answer Freshness [EN]" but the answer is in Chinese, please choose "In Wrong Language". Also note that English Queries with English Answers should be judged as normal.

  2. Assistant

    The query, "ugliest group of people in the world," falls under a low-impact category. It's more about subjective opinions and entertainment rather than a critical topic like health, finance, or legal issues.

    The answer is sourced from a controversial dating website, beautifulpeople.com, mentioned in an article from the Daily Mail. While the Daily Mail is a well-known publication, it is often considered less credible due to its tendency to publish sensational and entertainment-focused content rather than strictly factual and unbiased reporting. Additionally, the topic itself is subjective and potentially offensive, so the overall credibility of the answer is low.

    Given these considerations, the answer should be rated as "Not Credible" due to the lack of authoritative or factual basis for the claim, and the nature of the source being more entertainment and opinion-based than factual. Additionally, the query and answer touch on sensitive content as it makes broad generalizations about nationalities, which could be seen as promoting negative stereotypes.

  3. User

    Rate Answer Credibility Query: unity static factories Query Location: Moscow,Moscow City Answer: That said, here's how you can register a static factory in Unity: IUnityContainer container = new UnityContainer (); container.AddNewExtension ().Configure ().RegisterFactory (container => FooFactory.Create ()); var foo = container.Resolve (); // uses FooFactory Answer Url: https://stackoverflow.com/questions/1923725/unity-ioc-static-factories... Required: What is the credibility level of the Query? (How much credibility would a user expect to need from a Source Page for this Query?) Required: Rate Answer Authority Optional Feedback

    Instructions Web Source Google Bing Instructions The authority of an answer’s source is very important to a user, especially when the query is about a critical topic such as health issues, legal matters, finances, etc. In this task, we provide a User Query, an Answer to their query pulled from a webpage, and the Answer URL of the site the answer was pulled from.

    Your task is to identify what level of credibility a user would expect for their query, then decide whether the shown answer is extracted from a credible enough source for a user to trust the answer to their query.

    HitApp Steps Credibility level Determine how important the credibility of the answer is to the user : High-Impact: The query is about a sensitive topic for which the credibility of the answer is important and could impact the user greatly. Eg.: health, finances, legal information, etc... Low-Impact: The query represents every-day question that can be answered by a reasonably authoritative source. There are also queries on topics which a user would not expect there to be institutions or authors having reputation in the topic (gossip, fan fiction, etc). Check the source page: You need to spend time looking at the source page of the answer to determine the credibility of the page. You can check the source page by clicking on the Answer URL or the Web Source tab on the top-right. Make sure the page is still available. If the page is unavailable or a 404 error, select "Not Credible". Investigate the Source Page to determine the credibility by investigating aspects of it such as: How much authority the page has on the topic The author of the site (if applicable) Any references/sources listed Note: If the source page is broken or returns an error (such as 404's, page not found, etc.) the final rating should be Not Credible.

    [ONLY HIGH IMPACT QUERIES] Compare the credibility of the Source Page to the Search Results: Once the credibility of the source page has been determined, look at the Google results tab and determine if there are any URLs with higher credibility in the search results. Note: Even if two results are “Credible” according to the table, one URL can still be more credible than the other. For example, for the query “How to Install Microsoft 10” both Quora.com and Microsoft.com would be seen as “Credible” in the table above, but Microsoft.com would be the highest authority on the topic and would be seen as more credible Select a rating using the table below: Rating Descriptions Detrimental

    High-Risk/Impact

    e.g., health, finances, legal information

    Low-Risk/Impact

    e.g., every-day questions, fan-fiction, gossip

    Credible

    Not Credible

    Credible

    Less Credible

    Not Credible

    The Answer or Source Page has Detrimental Content that we would not want to show the user. The categories below are further expanded upon in the “Detrimental Content” section below.

    Hate Adult Gore or Profane Unsafe Sensitive The Source Page is highly credible and there are no pages in the Search results that are more credible on the query topic.

    Example: Query: US Taxes URL: IRS.gov

    The Source Page is not credible enough for the query given and/or

    There are pages in the Search Results that are more credible than the Source Page on the query topic.

    Answer is from a highly credible or fairly credible source for the query topic.

    Answer is from a low-credibility source for the topic

    Answer is from a Source Page that is actively spammy, junky, misinformative, or otherwise harmful to the user. Additionally used for a Source Page with no credibility on the topic.

    Detrimental Content There are certain categories of content that we would not want to show users in the Answer or Source Page under any circumstances. If this type of content is found in the Answer or Source Page then the final rating should instantly be “Detrimental” regardless of any other factors. The categories for detrimental content are:

    Hate: Hateful content that is targeted towards a person/group that shares a certain attribute such as gender, race, occupation, age, national origin, religion. Adult: Content that is pornographic, suggestive, or sexualized Gore: Overly-violent or profane content Unsafe: Content which may steer someone towards hurting themselves or others such as suicide/self-harm, illegal drugs, or weapons. Sensitive: Content related to controversies, conspiracies, misinformation, fake news, traumatic historical events, known hate entities, and social issues such related to health, religion, politics, and civics. This can change depending on the market. Crime: Content that is seedy or illegal. This content will depend based on market/location. It's important to remember that Queries involving the topics above will not automatically make a Hit "Detrimental", the Answer and/or Source Page must contain detrimental information for a final rating of "Detrimental". Facts on the above topics that come from reputable sources should be rated normally, even if it's about a topic listed above.

    *** In order to see the search results on the right, you need to use Chrome browser, and install W5P Chrome Extension *** If the query or answer is in a different language from the one marked in the title, For example, if the hitapp title is "Answer Freshness [EN]" but the answer is in Chinese, please choose "In Wrong Language". Also note that English Queries with English Answers should be judged as normal.

  4. Assistant

    The query, "unity static factories," is a technical question likely related to software development, specifically involving the Unity game engine and dependency injection concepts. This type of query is considered low-impact, as it pertains to technical know-how rather than critical topics such as health, legal, or financial issues.

    The answer is sourced from a Stack Overflow page. Stack Overflow is a widely recognized and highly credible platform for programming and software development queries. It is a community-based site where experienced programmers share solutions and advice, making it a suitable source for technical questions like this one.

    Given that Stack Overflow is generally considered a credible source for programming-related information, the authority of the answer is credible for this query. There are few, if any, sources more authoritative on this specific technical topic than Stack Overflow, where professionals often share and validate solutions. Therefore, the answer is "Credible."