Skip to content
The Chat Archive
deepseek-v3-0324· DeepSeek LMArena Human Preference 140K

What is "-8s" in: [code] ? How to make sure the timestamp is utc and the logging is in…

  1. User

    What is "-8s" in:

    formatter = logging.Formatter(
        fmt="%(asctime)s | %(levelname)-8s | %(name)s | %(message)s",
        datefmt="%Y-%m-%d %H:%M:%S"
    )
    

    ?

    How to make sure the timestamp is utc and the logging is in UTF-8 formating?

  2. Assistant

    1. What Does -8s Mean in the Logging Formatter?

    The -8s in %(levelname)-8s is a string formatting directive that ensures the log level (DEBUG, INFO, etc.) is:

    • Left-aligned (due to the - sign).
    • Padded to 8 characters (so shorter levels like INFO get trailing spaces to align columns neatly).

    Example Output:

    2024-02-20 12:34:56 | INFO     | my_app | Program started
    2024-02-20 12:34:57 | ERROR    | my_app | File not found
    

    Without -8s, the log levels wouldn’t align, making logs harder to read.


    2. Forcing UTC Timestamps

    By default, Python’s logging uses local time. To use UTC:

    Option 1: Use logging.Formatter.converter

    Override the timestamp conversion function:

    import logging
    import time
    
    class UTCFormatter(logging.Formatter):
        def formatTime(self, record, datefmt=None):
            # Convert record.created (float timestamp) to UTC struct_time
            utc_time = time.gmtime(record.created)
            if datefmt:
                return time.strftime(datefmt, utc_time)
            return time.asctime(utc_time)
    
    # Apply the formatter
    formatter = UTCFormatter(
        fmt="%(asctime)s | %(levelname)-8s | %(message)s",
        datefmt="%Y-%m-%d %H:%M:%S UTC"
    )
    

    Option 2: Use datetime with UTC (Python 3.3+)

    from datetime import datetime, timezone
    
    formatter = logging.Formatter(
        fmt="%(asctime)s | %(levelname)-8s | %(message)s",
        datefmt="%Y-%m-%d %H:%M:%S UTC"
    )
    formatter.converter = lambda *args: datetime.now(timezone.utc).timetuple()
    

    3. Ensuring UTF-8 Encoding in Log Files

    By default, Python’s logging uses the system encoding. To enforce UTF-8:

    For File Handlers

    Explicitly set encoding="utf-8" when creating the handler:

    from logging.handlers import RotatingFileHandler
    
    file_handler = RotatingFileHandler(
        "app.log", 
        encoding="utf-8",  # ← Critical for non-ASCII text
        maxBytes=5_000_000,
        backupCount=3
    )
    

    For Console Output

    If your terminal supports UTF-8 (most modern ones do), no extra steps are needed.
    For Windows, ensure the terminal is configured for UTF-8 (e.g., chcp 65001 in CMD).


    Full Example: UTC + UTF-8 Logging

    import logging
    from logging.handlers import RotatingFileHandler
    import time
    
    # 1. Force UTC timestamps
    class UTCFormatter(logging.Formatter):
        def formatTime(self, record, datefmt=None):
            utc_time = time.gmtime(record.created)
            if datefmt:
                return time.strftime(datefmt, utc_time)
            return time.asctime(utc_time)
    
    # 2. Configure logger
    logger = logging.getLogger("my_app")
    logger.setLevel(logging.DEBUG)
    
    # 3. Formatter with UTC and alignment
    formatter = UTCFormatter(
        fmt="%(asctime)s | %(levelname)-8s | %(name)s | %(message)s",
        datefmt="%Y-%m-%d %H:%M:%S UTC"
    )
    
    # 4. Handlers (UTF-8 enforced for files)
    console_handler = logging.StreamHandler()
    console_handler.setFormatter(formatter)
    
    file_handler = RotatingFileHandler(
        "app.log", 
        encoding="utf-8",  # ← UTF-8 guarantee
        maxBytes=5_000_000,
        backupCount=3
    )
    file_handler.setFormatter(formatter)
    
    logger.addHandler(console_handler)
    logger.addHandler(file_handler)
    
    # 5. Test non-ASCII characters
    logger.info("こんにちは UTF-8 works! ✅")
    

    Key Takeaways

    1. -8s → Left-align and pad log levels to 8 characters.
    2. UTC Timestamps → Override formatTime() or set formatter.converter.
    3. UTF-8 Logs → Explicitly set encoding="utf-8" in file handlers.

    This ensures clean, aligned, timezone-aware logs that handle global characters. 🌍

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.