Beyond Completion Rates: How to Actually Measure Sales Capability in Medical Devices
There is a question that every Head of Commercial Excellence in medical devices has been asked by their VP or board member at some point: "How do we know our reps are actually good at selling?"
The honest answer, in most organisations, is: we don't. Not really.
We know who attended the training. We know who passed the certification. We know who scored well on the product knowledge quiz. We know who their managers rate as strong performers. We know who hit quota last quarter.
But none of these measures actually assess whether a rep can handle the conversations that medical device selling demands. They are proxies. Some are reasonable proxies. Others are entirely misleading. And collectively, they create an illusion of measurement where no genuine assessment of capability exists.
The measurement problem in medical device sales
Medical device sales capability is fundamentally a conversational skill. Can this rep articulate clinical value to a sceptical surgeon? Can they justify premium pricing to a procurement director? Can they navigate a buying committee with conflicting priorities? Can they handle unexpected objections without losing composure or credibility?
These are performance skills. They are demonstrated in real-time, under pressure, with another human being. And therein lies the measurement problem. The conversations happen behind closed doors. In operating theatres. In hospital meeting rooms. In procurement offices. The only observers are the other people in those conversations, who are not evaluating rep capability. They are making buying decisions.
The result is that medical device commercial teams have defaulted to measuring what they can observe rather than what actually matters. And the gap between what they measure and what drives revenue is enormous.
What we measure versus what matters
Training completion. The most common metric. It tells you nothing about capability. A rep who sat through a two-day workshop and checked their email throughout registers the same completion as one who engaged deeply and transformed their approach. Completion measures attendance. Attendance does not predict performance.
Certification pass rates. Slightly better than completion but still fundamentally a knowledge test. A rep can explain the correct way to handle a procurement objection on a written test and still freeze when a real procurement director pushes back aggressively. Knowing what to say and being able to say it under pressure are different cognitive processes.
Manager assessments. Valuable but inherently limited by frequency, consistency, and manager capability. Managers see a tiny fraction of their reps' conversations. Their assessments are influenced by recency bias, personal relationships, and their own selling philosophy. Two managers evaluating the same rep may reach different conclusions. And the assessment happens infrequently enough that it measures a snapshot, not a trend.
Revenue and quota attainment. The ultimate lagging indicator. It correlates with capability but is confounded by territory quality, product portfolio, market conditions, competitive dynamics, and account history. A rep in a strong territory with legacy accounts may hit quota without exceptional selling skill. A rep in a competitive territory may miss quota despite excellent capability. Revenue is an outcome. It is not a direct measure of the skill that produces it.
Win rates. Closer to the mark but still confounded. Win rates vary by deal size, competitive intensity, product line, and buying complexity. A rep with a 40 percent win rate on large capital deals may be far more skilled than one with a 60 percent win rate on commodity consumables.
None of these metrics answer the fundamental question: can this rep execute the conversations that our commercial model requires, consistently and under pressure?
What a genuine capability measurement looks like
Genuine capability measurement has several characteristics that distinguish it from the proxies above.
It is behavioural, not knowledge-based. It measures what the rep does in a realistic conversation, not what they know about how they should behave.
It is specific to defined competencies. Rather than an overall "good at selling" rating, it breaks capability into discrete, measurable skills: value articulation, objection handling, clinical evidence delivery, stakeholder engagement, competitive positioning.
It is frequent enough to show trends. A single assessment is a data point. A monthly capability measurement reveals trajectory: is this rep improving, plateauing, or declining in specific skill areas?
It is consistent across reps. Every rep is assessed against the same standard, in the same type of situation, with the same evaluation criteria. This removes the variability introduced by different managers, different observation contexts, and different rating philosophies.
It is leading, not lagging. It measures the inputs that drive revenue outcomes, not the outcomes themselves. A rep whose capability scores are declining will eventually miss quota. But by the time the quota miss is visible, months of revenue have been lost. A leading measure enables early intervention.
How AI practice creates a measurement capability
When reps practise conversations with AI personas, every interaction generates data. That data, properly structured, creates the genuine capability measurement that commercial excellence teams have never had.
Each practice conversation can be evaluated against specific criteria: Did the rep articulate value clearly? Did they handle the objection without conceding unnecessarily? Did they demonstrate clinical credibility? Did they address all stakeholder concerns? Did they advance the conversation toward a next step?
These evaluations, accumulated over time, create a capability profile for every rep across every competency your framework defines. The profile is not based on a single observation or a knowledge test. It is based on repeated demonstration of conversational skill under realistic conditions.
This is analogous to how flight simulators are used in aviation. Every simulation session generates performance data across defined competencies. Over time, the data shows not just whether the pilot can handle an emergency today, but whether their capability is improving, stable, or degrading. This enables proactive intervention before capability gaps create real-world consequences.
For medical device commercial teams, the same principle applies. If a rep's procurement objection handling scores decline over three consecutive months, that signals a development need. If the entire team shows a weakness in competitive positioning, that signals a systemic training gap. If a new hire's capability curve is steeper than average, that identifies early talent worth investing in.
Building a capability measurement system
For Heads of Commercial Excellence and Commercial Directors, building a genuine measurement system involves several practical steps.
Define what you're measuring. Map your competency framework to specific, observable conversational behaviours. "Value-based selling" is too abstract to measure. "Articulates total cost of care argument with supporting evidence when procurement challenges on price" is measurable in a practice conversation.
Create assessment scenarios. Build AI practice scenarios specifically designed to elicit the behaviours you want to measure. These are not generic role plays. They are structured assessments that create consistent conditions for every rep.
Establish baseline and track trajectory. Measure every rep's current capability level, then track how it changes over time. The trajectory matters more than the absolute score. A rep who starts at 4/10 and improves to 7/10 in three months is on a strong development path regardless of where they started.
Connect capability data to commercial outcomes. Over time, correlate capability scores with revenue metrics. Which specific competencies most predict win rate improvement? Which capability gaps most correlate with quota misses? This connection between leading and lagging indicators makes the measurement system commercially relevant, not just developmentally interesting.
Use the data to direct resources. Capability data should inform where coaching time, training investment, and development resources are allocated. Managers focus their limited time on reps with identified gaps. Training programmes address the competencies where systemic weakness exists. Individual development plans are built on evidence rather than assumption.
The commercial value of genuine measurement
For Commercial Directors making investment decisions, genuine capability measurement changes the economics of training and development.
Without measurement, training investment is an act of faith. You spend the budget, run the programme, and hope it works. When leadership asks for ROI, you point to completion rates, satisfaction scores, and anecdotal success stories. The connection to revenue remains asserted but unproven.
With genuine measurement, you can demonstrate that specific capability improvements predict specific commercial outcomes. You can show that the team's procurement objection handling improved by 30 percent following targeted practice, and that this improvement corresponded to a five-point increase in win rates for deals involving procurement scrutiny.
This transforms training from a cost centre that leadership tolerates into a revenue lever they actively invest in. The conversation with the board shifts from "we need budget for training" to "investing X in capability development will generate Y in incremental revenue based on the relationships we've proven between skill and outcomes."
Platforms like TrainBox provide the infrastructure for this measurement system. Every practice conversation generates structured data against defined competencies. Dashboards show capability levels, trends, and gaps across individuals, teams, and regions. The data connects directly to the business questions that Commercial Directors and Heads of Commercial Excellence need to answer.
The era of measuring training completion and hoping it correlates to performance should be ending. The tools exist to measure what actually matters: whether your reps can execute the conversations that drive your commercial results.
TrainBox helps medical device teams practise real conversations so they're ready when it matters.