Should I run win/loss research internally or hire a third party?
Third-party win/loss research avoids two problems that compound in internal programs: buyers self-select into interviews requested by the vendor’s own team, skewing the pool toward buyers who left on decent terms, and even willing participants soften their answers when talking to someone who represents the company they’re evaluating. A neutral interviewer removes both problems at once.
These are two distinct failure modes, and it’s worth separating them rather than treating internal conflict of interest as a single, vague concern.
The Selection Problem
The first problem happens before a single question gets asked. When an internal team sends interview requests to buyers who chose a competitor or walked away, the buyers who agree to talk are disproportionately the ones who left on reasonably good terms. A decent response rate can look like evidence the process is working, while the buyers with the sharpest criticism simply never reply. Those buyers had nothing to gain from a conversation with the team they just turned down, and often archived the request without a second thought.
This means an internal program’s dataset is compromised before the first interview happens, regardless of how well the interviews themselves are conducted.
The Candor Problem
The second problem shows up in the interviews that do happen. Even buyers willing to talk to an internal team calibrate what they share the same way they calibrated their feedback during the sales process itself. A rep or internal researcher asking what could we have done better tends to get a polite, softened answer: credit given to price because it’s the easiest thing to say, and the detail that actually drove the decision left out entirely. This reflects buyers managing a relationship they may still want to preserve, or simply being kind on the way out the door, rather than any intent to mislead.
Layer the candor problem on top of the selection problem and an internal program’s findings are wrong twice over: wrong about who agreed to talk, and wrong about what those who did talk were willing to say.
What Third-Party Research Changes
An independent researcher has no relationship to protect and no sale at stake, which changes both dynamics at once. Buyers who wouldn’t return an internal team’s call will often take one from a neutral third party, expanding the pool beyond buyers still willing to engage with the vendor. And once on the call, those buyers tend to share the version of events they’d never volunteer to someone representing the company being evaluated.
This is also why sustaining neutrality gets harder for an internal team running research on an ongoing basis rather than as a single engagement. The same team that owns the relationship with sales and product eventually owns the interviews too, and the structural conflict compounds with every cycle.