How to Scope a Win/Loss Research Program
Scope a win/loss program by setting five inputs before outreach begins: the program’s objective and success criteria, the deal segment under review, an interview count and ratio weighted toward losses, a research timing window relative to deal close, and a deal-sourcing method that pulls the list from the CRM rather than through sales approval.
- Define the objective and success criteria
- Set the deal segment
- Set interview count, ratio, and timing window
- Pull the deal list under executive sponsorship
- Estimate the effort range before committing
Step 1: Define the Objective and Success Criteria
Write the program’s objective as a single sentence before setting any other scope input. “Understand our win rate better” is a discipline, not an objective, and a program scoped around a discipline drifts once the first busy quarter arrives. “Explain the ten-point win rate drop in Enterprise over the last two quarters” is an objective, because it names a metric that already moved and gives the program a specific question to answer.
Attach a success criterion to the objective at the same time. A useful test: name the decision the program needs to change. If a program can’t point to a specific pricing call, messaging test, or resourcing decision it’s meant to inform, the objective isn’t specific enough yet. Revise it until it names one.
A scoping worksheet forces this discipline before interview planning starts:
Program Objective: [one sentence naming the specific, already-felt problem] Decision This Program Should Inform: [the pricing, messaging, or resourcing call] Executive Sponsor: [name, title] Target Report Date: [date leadership needs an answer by]
Don’t leave the report date blank. A program scoped without one tends to lose the urgency that got it funded in the first place.
Step 2: Set the Deal Segment
Define which deals fall inside the program before pulling a single record. Scope by segment (Enterprise, Mid-Market, SMB), deal size range, geography, and product line, matched to whatever the objective in Step 1 actually points to. A program scoped around an Enterprise win rate drop should pull only Enterprise deals. Mixing segments into one interview set blurs a finding that may only be true for one of them.
Set inclusion and exclusion criteria explicitly rather than leaving them implied. A standard set: closed-won and closed-lost deals only (exclude deals still active or stalled with no decision), deals closed within the research window defined in Step 3, and deals above a minimum size threshold if very small deals follow a meaningfully different buying process than the segment the program is actually trying to understand.
Step 3: Set Interview Count, Ratio, and Timing Window
Target 20 to 30 total interviews, split roughly two loss interviews for every win interview, commonly 20 losses and 10 wins. Below about 15 interviews, a single unusual conversation can distort the whole dataset. Above 30, additional interviews tend to confirm what’s already emerged rather than surface anything new. Losses carry more weight because a loss usually has a specific, nameable cause, while a win can happen for several reasons at once that are hard to isolate.
Schedule interviews 30 to 180 days after deal close. Inside 30 days, a buyer is often still transitioning into onboarding and hasn’t had distance to reflect. Past 180 days, specific detail compresses into a general impression. A straightforward, single-stakeholder deal can support an interview closer to the 30-day mark; a longer enterprise cycle with a large buying committee may still be settling at 90 or 120 days.
Step 4: Pull the Deal List Under Executive Sponsorship
Source the deal list directly from the CRM using the criteria set in Step 2, not from a shortlist sales nominates. Letting reps flag which deals are worth reviewing hands curation to the people whose read on each loss is, by definition, one-sided. The deals a rep leaves off the list are frequently the ones where the buyer’s actual reason for leaving would be most revealing.
Put an executive sponsor’s authority behind the pull instead. Sales leadership can be informed of the research window and consulted on which segments to prioritize strategically, but individual deal-by-deal approval is where selection bias enters, and it stays out only if that line holds. Frame the program to sales explicitly as pattern recognition across an aggregated deal set, not an evaluation of individual reps or deals, before the first outreach email goes out.
Step 5: Estimate the Effort Range Before Committing
Running a program internally costs real hours, and naming a bounded range before committing avoids a team discovering the true cost mid-cycle. A standard 20-to-30 interview cycle typically requires:
Scoping and executive sponsorship alignment: 5-10 hours Target list build and outreach: 15-25 hours Interview scheduling and coordination: 10-15 hours Conducting 20-30 interviews at up to 1.5 hours each, including prep and debrief: 30-45 hours Analysis and pattern synthesis: 20-30 hours Report drafting and readout prep: 15-25 hoursTotal: roughly 95-150 hours across a 75-to-90-day cycle
Treat this as a planning range, not a precise forecast. Actual hours shift with buying committee complexity, questionnaire length, and how experienced the person running interviews is. The range exists to answer one question before scoping goes further: does the team committing to this program have 95 to 150 hours available across the next 75 to 90 days, spread across the roles above, and can it hold that commitment through the full window without the cycle stalling out. If the answer is no, that’s a scoping decision to make now, not a discovery to make in week six.
An hours range shows how much time a scoped program takes to run, not whether the team can commit that time inside the window, or whether an internal interviewer gets the same candor a neutral third party gets by default. Neutrality and a real time-bound commitment, not the hours total, determine whether a scoped program delivers an actionable answer. See why third-party neutrality changes what buyers will say.