Skip to content
TheChatArchiveThe Chat Archive
Claudeclaude-instant-1· AnthropicHugging Face Arena Human Preference 55K

I have normalized data and want to take a ratio, but there is one very large value…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Claudeclaude-2.1’s answer.
  1. User

    I have normalized data and want to take a ratio, but there is one very large value around 94, while the median is 0.01. how do i prevent this big difference in ratios?

  2. Claude Assistant

    Here are a few options to consider when taking ratios of normalized data with a large outlier value:

    • Clip/cap the outlier value to something more in line with the rest of the data before taking ratios. For example, cap the 94 value to 5 or 10.

    • Remove the outlier data point altogether before calculating ratios. Whether this is appropriate depends on your specific use case.

    • Take the logarithm of the values before calculating ratios. This will compress the scale and reduce the influence of extreme outliers.

    • Calculate ratios using medians instead of means. The median is less impacted by outliers compared to the mean.

    • Winsorize the data - replace the outlier value with the next highest non-outlier value. This reduces the outlier's influence without fully removing it.

    • Calculate percentiles/quantiles instead of raw ratios. Compare the 25th/75th percentiles for example rather than means.

    • Consider a transformation that dampens outliers, like a square root or inverse hyperbolic sine transformation before ratios.

    The best approach depends on your specific goals and tolerance for outlier influence. Capping, removing, or transforming the data are common ways to handle outliers when calculating ratios or other relative measures.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.