Week 6 — Structured Interviews & Hiring Debriefs

60-Second Summary

Week 6 of the 12-week program. Theme: Hire well, defend the bar.
Post-hire calibration (3 months in) — the ritual you install this week.
60 min pre-read + 90 min cohort + Friday homework with a falsifiable artefact.
Reviewed by HR Director, line manager, and OB faculty lenses.

A new manager's first 5 hires will define their team for 18 months. The literature is unambiguous: unstructured interviews are barely better than chance at predicting performance, while structured interviews with calibrated scorecards are 2–3× more predictive. Yet most new managers default to unstructured 'gut feel' interviews. Week 6 installs the discipline.

What the evidence says

Schmidt & Hunter meta-analyses (100+ years of selection research): structured interviews (r=.51) substantially outperform unstructured (r=.31). Combined with work samples, predictive validity nearly doubles.
Google's Project Oxygen / re:Work: switching from 'culture fit' to structured interviews + 'general cognitive ability + role-related work sample' nearly eliminated the hiring quality dispute internally.
Kahneman (Thinking Fast and Slow): structured assessment beats expert judgment even when the experts believe their judgment is superior. The effect persists after the experts are told this.

Pre-read (60 minutes)

Read: Structured hiring — the operator's version — 25 min.
Read: Writing a calibrated scorecard — 15 min.
Read: Three failure modes in hiring debriefs (anchoring, dominance, halo) — 15 min.
Reflect (10 min): your last hire — write the scorecard you wish you had used.

Live session (90 minutes)

Cohort flow with a senior-manager coach

1
Scorecard design (25 min)
Coach walks each manager through writing a scorecard for an open role: 4–6 dimensions, behavioural anchors at each level (1–4), and the 'must-haves' clearly separated from the 'nice-to-haves'.
2
Question library (20 min)
Each dimension needs 2–3 calibrated questions. Coach teaches the STAR follow-up discipline: keep asking 'and then what?' until you have a specific, behavioural answer.
3
Debrief simulation (30 min)
Coach plays a hiring committee. Each manager presents a real recent candidate. Coach forces evidence ('what specifically did you see?'), challenges weak signals ('how do you know that?'), and demonstrates the move to consensus.
4
Bar defense (15 min)
Practice the conversation when a teammate wants to hire someone you think is below bar — without making it personal.

The ritual you install this week

Post-hire calibration (3 months in)

For every hire you make, schedule a 30-minute review 3 months after start. Review: what did the scorecard predict correctly? What did it miss? Update the scorecard. This is the only way a hiring system actually gets better. Most companies skip this and hire on the same flawed scorecards for years.

Modern tools for this skill

Category	Examples (2026)	Use
ATS scorecards	Ashby, Greenhouse, Workable, Lever	Capture structured scoring per dimension
Interview kit	Notion / Coda scorecard template, BambooHR	Standardise across loops
AI question helper	Claude/ChatGPT with role brief	Draft behavioural questions per dimension; you review
Interview transcripts	Otter.ai, Read.ai, Metaview	Re-read for evidence; use carefully — privacy + consent
Work-sample tools	CoderPad, CodeSignal, HackerRank for tech; written exercises for non-tech	The single strongest predictor when role-related

Copy-paste AI prompt

Here is the role description [paste]. Draft a 5-dimension interview scorecard with behavioural anchors for each level (1–4). For each dimension, propose 3 STAR-style interview questions, plus 2 follow-up probes per question.

Friday homework — falsifiable artefacts

Scorecard written for one open role (or last hire) with behavioural anchors.
At least one interview conducted using the scorecard.
Hiring debrief led using the structured format — every interviewer presented evidence before voicing a recommendation.
Post-hire calibration scheduled in calendar for every team member hired in the last 6 months.
Submitted to coach: scorecard + debrief notes (redacted).

Success signal

By end of week 6, you can defend a hiring decision in 5 minutes with specific evidence per dimension. Your debrief produced agreement faster than your previous debriefs. You can name what your scorecard doesn't yet capture.

Reviewer notes

HR Director (15+ yrs)

When a hire fails 6 months in, the question I ask is: what was on the scorecard? If the answer is 'we didn't have one' or 'we had one but didn't follow it', the manager owns 80% of the miss. With a scorecard, the failure mode is identifiable and fixable; without one, it's roulette dressed up as judgment.

Line Manager (20+ yrs)

The two interview questions that have served me 20 years: 'Tell me about a time you got something wrong — what was it, and what did you change?' and 'What does your manager say about you in their performance review?' Both get past prepared answers and force specifics.

OB / HR Professor (25+ yrs)

Schmidt & Hunter's meta-analysis is one of the most-cited in I/O psychology. The discomfort it produces — that structured assessment beats expert judgment — is exactly why most companies don't adopt it. The managers who do are doing applied science; the ones who don't are doing folklore.

Written by Pawan Joshi.Sources cited inline.

First published 23 Jun 2026See site changelog →