Skip to content
The Chat Archive
claude-sonnet-4-20250514-thinking-32k· Anthropic LMArena Human Preference 140K

Write a Python function to check for missing values in a Pandas DataFrame and report the…

  1. User

    Write a Python function to check for missing values in a Pandas DataFrame and report the columns with null counts.

  2. Assistant

    Here's a Python function to check for missing values in a pandas DataFrame:

    import pandas as pd
    
    def check_missing_values(df, show_percentage=True, only_missing=True):
        """
        Check for missing values in a pandas DataFrame and report null counts.
        
        Parameters:
        -----------
        df : pandas.DataFrame
            The DataFrame to check for missing values
        show_percentage : bool, default True
            Whether to show percentage of missing values alongside counts
        only_missing : bool, default True
            If True, only show columns that have missing values
            If False, show all columns
        
        Returns:
        --------
        pandas.DataFrame
            A summary DataFrame with columns showing null counts and percentages
        """
        # Calculate null counts
        null_counts = df.isnull().sum()
        
        # Calculate total rows
        total_rows = len(df)
        
        # Create summary DataFrame
        if show_percentage:
            null_percentages = (null_counts / total_rows * 100).round(2)
            summary = pd.DataFrame({
                'Column': df.columns,
                'Null_Count': null_counts.values,
                'Null_Percentage': null_percentages.values
            })
        else:
            summary = pd.DataFrame({
                'Column': df.columns,
                'Null_Count': null_counts.values
            })
        
        # Filter to only columns with missing values if requested
        if only_missing:
            summary = summary[summary['Null_Count'] > 0]
        
        # Sort by null count (descending)
        summary = summary.sort_values('Null_Count', ascending=False).reset_index(drop=True)
        
        return summary
    
    # Alternative simpler version
    def simple_missing_check(df):
        """
        Simple function to quickly display missing value counts.
        
        Parameters:
        -----------
        df : pandas.DataFrame
            The DataFrame to check
        """
        missing = df.isnull().sum()
        missing = missing[missing > 0].sort_values(ascending=False)
        
        if len(missing) == 0:
            print("No missing values found!")
        else:
            print("Missing values by column:")
            print(missing)
        
        return missing
    
    # Example usage:
    if __name__ == "__main__":
        # Create sample DataFrame with missing values
        data = {
            'A': [1, 2, None, 4, 5],
            'B': [1, None, None, 4, 5],
            'C': [1, 2, 3, 4, 5],
            'D': [None, None, None, None, None]
        }
        df = pd.DataFrame(data)
        
        print("Sample DataFrame:")
        print(df)
        print("\n" + "="*50)
        
        # Using the detailed function
        print("\nDetailed missing value report:")
        missing_report = check_missing_values(df)
        print(missing_report)
        
        print("\n" + "="*50)
        
        # Using the simple function
        print("\nSimple missing value check:")
        simple_missing_check(df)
    

    The main function check_missing_values() provides several useful features:

    • Flexible output: Shows both counts and percentages of missing values
    • Filtering options: Can show only columns with missing values or all columns
    • Sorted results: Orders columns by number of missing values (highest first)
    • Clean format: Returns results as a DataFrame for easy viewing and further analysis

    The simple_missing_check() function provides a quick way to just print the missing value counts for columns that have them.

    Both functions will help you quickly identify which columns in your DataFrame have missing data and how extensive the missing data problem is in each column.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.