Build a win/loss investigation program: sample design, interview scripts, coding, and…
- User
Build a win/loss investigation program: sample design, interview scripts, coding, and dissemination.
- Assistant
Win/Loss Investigation Program
Program Overview
A Win/Loss Investigation Program systematically analyzes closed sales deals to uncover why opportunities were won (closed successfully) or lost (lost to competitors, no decision, etc.). The goal is to identify actionable insights for sales enablement, product improvements, pricing strategy, competitive intelligence, and process optimization.
Key Benefits:
- Improve win rates by 10-20% through targeted actions.
- Reduce churn by understanding buyer pain points.
- Quarterly cadence for timely insights.
Program Components:
- Sample Design: Structured selection of deals.
- Interview Scripts: Standardized questions for consistency.
- Coding & Analysis: Thematic coding of responses with tools.
- Dissemination: Reports, dashboards, and action plans.
Resources Needed:
- 1-2 dedicated analysts (or outsource to a service).
- CRM access (e.g., Salesforce) for deal data.
- Tools: Google Forms/Typeform for surveys, Zoom for calls, Excel/Google Sheets for coding, Tableau/Power BI for dashboards.
Estimated Time per Cycle: 20-30 hours for 20 interviews.
1. Sample Design
Select a balanced, representative sample of deals quarterly. Aim for 10-20 deals (50% wins, 50% losses) to keep it manageable.
Selection Criteria
Criterion Details Rationale Timeframe Last 90 days (Q1: Oct-Dec deals, etc.) Recency bias minimized. Deal Size Stratify: 40% <50-250K, 20% >$250K Represents revenue impact. Win/Loss Ratio 50/50 (adjust if <10 losses: include older ones) Balanced insights. Segments By industry (e.g., 30% Tech, 30% Healthcare, 40% Other), product line Avoids skew. Exclusions No-decisions <30 days old; internal transfers; VIP/exec deals (handle separately) Clean data. Sample Size Calculation
- Minimum: 10 deals/quarter.
- Power: For 80% confidence in trends, scale to 20 if >500 deals/quarter.
Implementation Steps
- Export CRM deals: Filter by close date, stage="Closed Won/Lost".
- Use random stratified sampling (Excel RAND() or Python pandas).
- Prioritize: Losses first (higher learning value).
Sample Excel Template: Download here – Columns: Deal ID, Customer, Win/Loss, Size, Segment, Interview Date, Status.
2. Interview Scripts
Conduct 15-30 min phone/Zoom interviews or email surveys (80% response rate target). Interview 3 parties per deal:
- External Buyer (decision-maker).
- Internal Sales Rep.
- Internal Leader (optional, for context).
Best Practices:
- Neutral tone: "Help us improve" vs. "Why didn't you buy?"
- Incentives: $25 Amazon gift card.
- Record/transcribe (Otter.ai).
Script 1: Lost Deal Customer (Priority)
Intro: "Hi [Name], thanks for your time. We're reviewing past opportunities to improve. This is confidential. May I record?"
- Decision Process: "Walk me through your buying process. Who was involved?"
- Our Strengths: "What did you like most about our solution/team?"
- Our Weaknesses: "What concerns prevented us from moving forward?"
- Competitors: "Who else did you evaluate? Why did you choose [Competitor/No Buy]?"
- Price/Value: "Was price a factor? How did we compare on value?"
- Future: "What would it take for us to win next time?"
- NPS-style: "On a scale of 0-10, how likely to recommend us?"
Close: "Any final thoughts? Thanks!"
Script 2: Won Deal Customer
Intro: Same.
- Decision Process: Same as above.
- Winning Factors: "What tipped the scales in our favor?"
- Competitors: "Who was the runner-up? Why us over them?"
- Value/Price: "How did we stack up on price/value?"
- Onboarding: "Any early feedback on implementation?"
- Future: "Likelihood of expansion/referral (0-10)?"
Script 3: Internal Sales Rep (Post-Customer Interview)
Intro: "Quick debrief on [Deal]. What did customer say?"
- Pre-Close View: "What did you think was our biggest strength/weakness?"
- Surprises: "Anything from customer feedback you didn't expect?"
- Process: "Any internal gaps (e.g., demo, proposal timing)?"
- Actions: "What one change would improve win rate here?"
Pro Tip: Send survey link first; follow up with calls for low-response deals.
3. Coding & Analysis
Qualitative Coding: Tag responses into themes for quantitative trends. Use a pre-defined codebook (expand as needed).
Coding Framework (Win/Loss Reasons)
Category Sub-Themes Win Score Loss Score Example Quote Product Fit Feature gap, Usability, Scalability +2 -2 "Lacked AI integration" Price/Value Too expensive, Poor ROI proof +1 -3 "Competitor 20% cheaper" Competitor Better features, Relationship 0 -2 "Chose Salesforce" Sales Process Slow response, Poor demo +1 -2 "Proposal took 3 weeks" Relationship Trust, Rep knowledge +3 -1 "Your rep understood us" Other Internal buyer changes, Budget cut 0 -1 "Project paused" Scoring: + for wins, - for losses. Aggregate for trends.
Tools & Process
- Collect Data: Transcribe to Google Sheet (columns: Deal ID, Interviewee, Quote, Code1, Code2, Score).
- Code Manually: 2 reviewers for inter-rater reliability (>80% agreement).
- Analyze: Pivot tables for % by category.
Sample Python Code for Analysis (using pandas; run in Jupyter/Colab):
import pandas as pd # Load data df = pd.read_csv('win_loss_data.csv') # Columns: Deal_ID, Win_Loss, Category, Score # Aggregate scores summary = df.groupby(['Win_Loss', 'Category'])['Score'].agg(['mean', 'count']).reset_index() # Top loss reasons losses = summary[summary['Win_Loss'] == 'Loss'].sort_values('mean') print(losses.head()) # Export dashboard data summary.to_csv('insights.csv')Output Example:
Win_Loss | Category | mean | count Loss | Price/Value | -2.8 | 12 Loss | Product Fit | -2.1 | 8Advanced: Use NLP (e.g., GPT API) for auto-coding: Prompt = "Code this quote into [framework]: [quote]".
4. Dissemination
Share insights monthly (raw) and quarterly (deep dive) to drive action.
Deliverables
-
Executive Dashboard (Tableau/Public link):
- Win rate by reason (bar chart).
- Heatmap: Segment x Reason.
- Trend over time.
-
Quarterly Report (5-10 pages, PDF):
Section Content Executive Summary Top 3 wins/losses, ROI impact (e.g., +5% win rate = $XM). Key Findings Charts: % losses by reason. Quotes. Actions SMART items: Owner, Due Date (e.g., "Sales: Shorten proposal by 2 days – Q2"). Appendix Full codes, raw data. -
Meetings:
- Sales All-Hands: 15-min review.
- Cross-Functional: Product/Sales/Marketing workshop.
Sample Action Tracker
Insight Action Item Owner Due Status Price objections (40%) Revamp ROI calculator Product Q2 End In Progress Slow demos (25%) Train reps on fast demos Sales Q1 End Done Rollout Plan:
- Week 1: Pilot 5 deals.
- Month 1: Full quarter.
- Track Program ROI: Pre/post win rate delta.
This program is plug-and-play. Customize for your CRM/industry. Questions? Let's iterate! – Sherlock