Executive Search Evidence: Retained, In-House, and Validity Considerations

Executive search — hiring at the VP, SVP, and C-suite level — is the highest-stakes selection task most organizations undertake. A single executive hire shapes the strategic trajectory of a function or a company; a mis-hire at this level can destroy years of accumulated organizational capability. The selection-research literature on executive hiring is more sparse than on other career bands (the sample sizes are smaller, the outcome measures are noisier, and the confounds are denser), but a coherent body of evidence has emerged on what works, what fails, and what the structural choice between retained search and in-house executive recruiting actually trades off.

This article walks through the evidentiary landscape for executive selection, what Khurana’s research on CEO search found about how the process actually operates, what validity considerations apply at this band, and how organizations should think about retained-vs-in-house tradeoffs.

Data Notice: Validity coefficients and executive- selection findings cited here reflect peer-reviewed research at time of writing. Specific weights for executive role bundles are documented in the scoring methodology and may evolve as calibration data accrues.

The structural anatomy of executive search

An executive search engagement typically spans 12-16 weeks and involves several distinct phases: scope definition with the hiring committee, longlist generation (~50-100 names), shortlist development (~8-15 candidates), preliminary interviewing, finalist interviewing with the hiring committee, reference and background checks, offer and negotiation. Two structural variants dominate the market:

Retained search firms. External executive recruiting firms (Heidrick & Struggles, Korn Ferry, Spencer Stuart, Egon Zehnder, et al.) charge ~one-third of first-year total compensation as a retained fee. They access passive-candidate networks at a depth most in-house teams cannot match, and they manage the engagement on behalf of the hiring committee.
In-house executive recruiting. Internal teams within the hiring company own the search end-to-end, often paired with hourly research support from boutique firms. The cost is materially lower (typically ~30-50% of retained fees on comparable searches), the relationship continuity is better, and the in-house team accumulates knowledge about the organization’s unique context.

Each model carries tradeoffs. Retained search produces wider candidate access and stronger process discipline; in-house recruiting produces deeper organizational context-fit and materially lower per-search cost. The choice should match the search’s specific characteristics — for first-of-kind roles or roles outside the organization’s existing network, retained search typically outperforms; for roles where the organization already has strong network access and clear context, in-house recruiting typically outperforms.

What Khurana’s research found

Rakesh Khurana’s “Searching for a Corporate Savior” research on CEO selection produced a sobering set of findings about how executive search actually operates in practice. Three are worth highlighting:

The “obviousness” trap. Khurana documented that boards conducting CEO searches consistently converged on a small number of “obvious” candidates — typically sitting CEOs at peer firms or COOs of named-brand companies — even when the strategic context of the hiring firm called for a different profile. The mechanism: search firms surface candidates the board’s directors recognize, which biases toward in-network sitting executives.
Performance-prestige decoupling. The most recognized-name candidates in a search are not, on average, the candidates who produce the strongest subsequent firm performance. Boards that hire on prestige rather than on capability-context fit consistently underperform.
Process theatricality. Many CEO searches involve performative elements — the broad longlist, the international travel, the multiple board interviews — that contribute more to legitimating the eventual choice to shareholders than to identifying the right candidate.

The implications for organizational design are direct. The process matters; retaining a high-quality search firm does not substitute for the hiring committee doing the context-specific work of figuring out what kind of executive the role actually requires.

Validity considerations at the executive level

Executive selection validity is materially harder to study than non-executive selection validity. The sample sizes are small, the outcome measures (firm performance, strategic success, board satisfaction) are noisy, and the confounds (market conditions, prior firm trajectory, sector dynamics) are dense. With those caveats, several findings from the upper-echelons and executive-selection literatures are robust:

Cognitive ability remains predictive. General mental ability validity at executive levels appears to remain substantial, though attenuated relative to non-executive bands. The cognitive-ability-in-hiring page covers the underlying evidence.
Personality factors gain weight. Conscientiousness remains a positive predictor at executive levels; emotional stability becomes more important than at lower levels (because executive roles involve sustained high-pressure decision-making); narcissism shows a more nuanced relationship (modest amounts may be a positive predictor of executive ambition, but high levels predict downstream firm risk-taking and ethical failures). See big-five-in-hiring for the underlying framework.
Track record carries real but context-bound validity. Executive performance is heavily firm-specific; the Groysberg “chasing stars” finding extends to executive hiring with even more force at this band. Boards evaluating executive candidates should weight transfer- of-context heavily.
Reference depth matters. Multi-source executive reference checks (board peers, direct reports, cross-functional partners, customers, investors) produce materially better information than manager-only or board-only references. See reference-checking-evidence.

Structured interviewing at the executive level

Executive interviews are routinely unstructured — conversational, often over meals, with rotating board members each running their own format. The structure-vs- unstructure literature is unambiguous on what this costs: unstructured interviews carry materially lower predictive validity than structured behavioral interviews regardless of career band, and the cost of unstructured interviewing is highest at the executive level because the financial-and-strategic stakes are highest.

Best-practice executive hiring loops use structured interview protocols even when the ambient culture would default to conversation: a defined set of behavioral questions per board interviewer, a defined scenario- based exercise (often a strategic case-study or a written response to a specific organizational challenge), and a calibration meeting before the offer decision. The structured-interview-design and interview-question-design pages cover the design patterns.

Retained search vs. in-house: the actual tradeoff

The retained-vs-in-house decision is often discussed as a cost-vs-quality tradeoff. The actual tradeoff is more nuanced and turns on three dimensions:

Network access. Retained firms access passive- candidate networks at a depth in-house teams typically cannot. For roles where the candidate the organization needs is unlikely to be in the organization’s existing network, retained search materially outperforms.
Process discipline. Retained firms run executive searches as their core competency; the engagement manager has executed dozens of similar searches and knows the failure modes. In-house teams that do executive search occasionally accumulate this expertise more slowly.
Context fit. In-house teams understand the organization’s strategic context, culture, and decision-making style at a depth retained firms typically cannot. For roles where context-fit is the primary determinant of executive success, in-house recruiting can outperform retained search.

The hybrid model — in-house executive recruiting paired with hourly research support from boutique firms — has gained traction at organizations that hire executives at sufficient volume to justify in-house expertise but want to retain access to specialized network research.

Common failure modes

Executive search failure patterns recur across organizations:

Hiring on prestige. As Khurana documented, boards consistently over-weight prestige and under-weight context-fit. The result: capable-but-mismatched hires who underperform.
Compressed timelines. Executive searches that target ~6-week timelines (rather than the standard 12-16 weeks) systematically produce weaker hires because the longlist development and reference-check phases get compressed.
Single-source references. Board-only or source-firm-CEO-only references produce thin signal at the executive level. Multi-source reference protocols produce materially better information.
Skipping current-capability evidence. Executive candidates are routinely exempted from current-capability assessment on the assumption that the track record is sufficient. The most expensive executive mis-hires often trace to skipping this step. Even brief scenario-based exercises plus structured behavioral interviewing produce material validity gains.

Takeaway

Executive search is the highest-stakes selection task most organizations undertake, and the literature on what works is clear in broad outline. The retained-vs-in-house choice is real but more nuanced than a cost-vs-quality framing suggests; both can produce strong outcomes when paired with disciplined process. Khurana’s research is a cautionary account of how the executive search process can substitute prestige-driven candidate selection for context-driven candidate selection. Boards that demand structured interview protocols, multi-source reference checks, and scenario-based current-capability evidence outperform boards that rely on conversational interviewing plus single-source references plus track-record-only evaluation.

For deeper coverage of related concepts, see succession-planning-evidence for the build-vs-buy framing, reference-checking-evidence for the executive-reference design pattern, and the hire workspace for the broader recruiter-side view.

Sources

Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2), 262-274.
Sackett, P. R., & Lievens, F. (2008). Personnel selection. Annual Review of Psychology, 59, 419-450.
Khurana, R. (2002). Searching for a Corporate Savior: The Irrational Quest for Charismatic CEOs. Princeton University Press.
Hambrick, D. C., & Mason, P. A. (1984). Upper echelons: The organization as a reflection of its top managers. Academy of Management Review, 9(2), 193-206.
Finkelstein, S., Hambrick, D. C., & Cannella, A. A. (2009). Strategic Leadership: Theory and Research on Executives, Top Management Teams, and Boards. Oxford University Press.
Groysberg, B. (2010). Chasing Stars: The Myth of Talent and the Portability of Performance. Princeton University Press.