Skip to content
TheChatArchiveThe Chat Archive
Grok 4.1 Fast· xaiHugging Face Frontier Reasoning Traces

Plan a device lab automation using BrowserStack, Playwright, and video capture to replay…

  1. User

    Plan a device lab automation using BrowserStack, Playwright, and video capture to replay design flows.

  2. Assistant

    Device Lab Automation Plan: BrowserStack + Playwright + Video Capture for Replaying Design Flows

    1. Overview & Objectives

    This plan outlines an automated testing pipeline for a device lab (real mobile/web devices via BrowserStack cloud) to:

    • Automate design flows (e.g., UI interactions, user journeys like onboarding, form submissions, or design tool workflows).
    • Use Playwright for cross-browser/device automation scripting.
    • Leverage BrowserStack for parallel execution on 1000s of real devices/browsers (iOS/Android Safari/Chrome).
    • Capture videos of sessions for easy replay, debugging, and stakeholder review.
    • Replay mechanism: Record flows via Playwright's codegen tool → Generate reusable scripts → Run automated replays on BrowserStack → Download/review videos.

    Key Benefits:

    • Scale to 100+ devices in parallel.
    • Realistic testing (no emulators).
    • Visual replays for non-technical teams.
    • CI/CD integration (e.g., GitHub Actions, Jenkins).

    Assumptions:

    • Testing web apps (mobile browsers); for native apps, use BrowserStack App Automate.
    • Node.js environment.

    2. Prerequisites

    ComponentRequirements
    AccountsBrowserStack username/key (free trial available).
    ToolsNode.js ≥18, npm/yarn. Playwright: npm init playwright@latest.
    Repo SetupGit repo with your app URL/design flows.
    BrowserStack PlanAutomate plan (starts at ~$100/mo for parallels).
    OptionalCI tool (GitHub Actions), Percy/Applitools for visual diffs.

    3. High-Level Architecture

    [Local/CI] Playwright Test Scripts
              ↓ (Config: browserstack.json)
    [BrowserStack Cloud] Real Devices (iOS/Android, Browsers)
              ↓ (Sessions Recorded)
    [Videos & Artifacts] Download for Replay/Debug
              ↓
    [Reports] Allure/JUnit + Video Links
    
    • Flow: Script runs → Launches BrowserStack sessions → Executes design flow → Captures video/screenshots → Ends session → Aggregates results/videos.

    4. Setup Instructions

    Step 1: Install Dependencies

    mkdir device-lab-automation && cd device-lab-automation
    npm init -y
    npm install -D @playwright/test @browserstack/playwright
    npx playwright install --with-deps
    

    Step 2: BrowserStack Config

    Create browserstack.json (Playwright config extension):

    {
      "version": 1,
      "browsers": [
        {
          "browser": "chromium",
          "browserstack": {
            "name": "Design Flow Test on iPhone",
            "buildName": "Design-Flow-Build-${BUILD_NUMBER}",
            "device": "iPhone 14",
            "os": "iOS",
            "osVersion": "16.0",
            "projectName": "Device Lab Automation",
            "buildTag": "v1.0",
            "local": false,
            "debug": false
          }
        },
        // Add more: Android Galaxy S22, etc.
      ]
    }
    

    Step 3: Playwright Config (playwright.config.ts)

    import { defineConfig, devices } from '@playwright/test';
    import { browserstackName } from '@browserstack/playwright'; // Optional helper
    
    export default defineConfig({
      testDir: './tests',
      fullyParallel: true,
      forbidOnly: !!process.env.CI,
      retries: process.env.CI ? 2 : 0,
      workers: process.env.CI ? 1 : undefined,
      reporter: [['html'], ['junit', { outputFile: 'results.xml' }]],
      use: {
        baseURL: 'https://your-app-url.com', // Your design app
        trace: 'on-first-retry', // Captures traces for replay
        screenshot: 'only-on-failure',
        video: 'retain-on-failure', // Playwright video capture
      },
      projects: [
        {
          name: 'browserstack-ios',
          use: {
            ...devices['iPhone 14'],
            launchOptions: {
              browserName: 'chromium', // Or 'webkit' for Safari
            },
          },
        },
        // Parallel projects for Android, etc.
      ],
      webServer: { command: 'npm run start', url: 'http://localhost:3000' }, // If serving local app
    });
    

    5. Implementation: Scripting Design Flows

    Step 5.1: Record Initial Flows (One-Time)

    Use Playwright Codegen on BrowserStack (manual first run):

    # Inspect & record locally first
    npx playwright codegen https://your-app-url.com
    
    # Then adapt for BrowserStack
    BS_LOCAL=false npx playwright test --headed --project=browserstack-ios
    
    • Interact with design flow (e.g., drag-drop UI elements, click buttons).
    • Generates example.spec.ts → Refine into reusable tests.

    Step 5.2: Write Automated Replay Tests (tests/design-flow.spec.ts)

    import { test, expect } from '@playwright/test';
    
    test.describe('Design Flow Replay', () => {
      test('Replay Onboarding Flow @ios @android', async ({ page }) => {
        // Navigate to design canvas/flow
        await page.goto('/design-onboarding');
        
        // Replay steps (e.g., design interactions)
        await page.click('#start-design');
        await page.fill('#user-name', 'Test User');
        await page.dragAndDrop('#element1', '#canvas-dropzone'); // Example design action
        await page.click('#submit-design');
        
        // Assertions
        await expect(page.locator('#success-toast')).toBeVisible();
        
        // Custom video marker (optional)
        await page.pause(); // Pause for video review
      });
    });
    
    • Tag tests (@ios, @android) for selective runs.
    • Handle waits: page.waitForSelector(), page.waitForLoadState('networkidle').

    6. Video Capture & Replay

    Sources:

    1. Playwright Videos: Auto-recorded (test-results/videos). Config: video: 'retain-on-failure' or 'on' (every test).
    2. BrowserStack Videos: Always-on for sessions. Access via:
      • Dashboard: https://automate.browserstack.com → Builds → Session Video.
      • API: Download via curl -u "$BS_USERNAME:$BS_ACCESS_KEY" "https://api-cloud.browserstack.com/app-automate/sessions/<session-id>.json".
    3. Traces for Replay: npx playwright show-trace trace.zip → Interactive step-by-step replay.

    Replay Workflow:

    1. Run tests → Get session IDs from logs (BrowserStack session: <id>).
    2. Download videos: Integrate script:
      # post-test.sh
      curl -u "$BS_USERNAME:$BS_ACCESS_KEY" -X GET "https://api-cloud.browserstack.com/app-automate/sessions/$SESSION_ID.json" | jq -r '.video_url' | xargs curl -o replay.mp4
      
    3. Share: Embed in Allure reports or Slack.

    7. Running the Pipeline

    Local Run:

    # Set env vars
    export BROWSERSTACK_USERNAME=your_username
    export BROWSERSTACK_ACCESS_KEY=your_key
    export BUILD_NUMBER=1
    
    # Dry-run
    npx playwright test --project=browserstack-ios --grep @ios
    
    # Full parallel
    npx playwright test
    

    CI/CD (GitHub Actions Example: .github/workflows/test.yml):

    name: Device Lab Tests
    on: [push]
    jobs:
      test:
        runs-on: ubuntu-latest
        steps:
          - uses: actions/checkout@v4
          - uses: actions/setup-node@v4
            with: { node-version: 20 }
          - run: npm ci
          - run: npx playwright install --with-deps
          - uses: browserstack/github-action@v1
            with:
              username: ${{ secrets.BROWSERSTACK_USERNAME }}
              access-key: ${{ secrets.BROWSERSTACK_ACCESS_KEY }}
          - run: npx playwright test
            env:
              BUILD_NUMBER: ${{ github.run_number }}
          - uses: actions/upload-artifact@v4
            with:
              name: videos
              path: test-results/
    

    8. Monitoring, Debugging & Best Practices

    • Parallelism: Up to your BrowserStack plan (e.g., 5 concurrent).
    • Debug: --debug, BrowserStack Live Inspector.
    • Visual Testing: Integrate Percy: npm i @percy/playwright.
    • Flakiness: Retries, explicit waits, network mocking.
    • Scaling: Matrix strategy in config for 50+ device combos.
    • Cost Optimization: Run only on failures, schedule nightly.
    • Metrics: BrowserStack dashboard (pass/fail rates, video watch time).
    • Edge Cases: Orientations (page.setViewportSize({ width: 390, height: 844, isMobile: true })), gestures (page.tap()).

    This setup enables reliable, visual replay of design flows across a virtual device lab. Start with 2-3 devices, iterate based on videos. For questions/customization, provide your app URL!

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.