Services
Every engagement rests on the same premise: consequential assessment decisions deserve independent, evidence-based advice. Some start with a focused review. Others become ongoing partnerships.
Working on clinical outcome assessments? See Clinical Outcomes →
A focused, fixed-fee look at where your program stands, before a board, accreditor, or court asks.
Scoring, equating, reliability, score reporting, and technical documentation, reviewed against professional standards. You receive written findings, a prioritized list of fixes, and a briefing your board can act on.
Typically 4 to 6 weeks
An evidence review against accreditation standards, with a clear picture of what you already have and a plan to close what's missing.
Typically 3 to 6 weeks
Differential item functioning analyses, subgroup performance review, and a look at the policies that shape fairness, such as retakes and accommodations. Draws on methods I've applied to national licensure exams and published in peer-reviewed journals.
Typically 4 to 8 weeks
An independent evaluation of vendor claims for automated scoring or AI item generation: what the evidence supports, where the validity risks are, and the questions your board should ask before adopting.
Typically 3 to 5 weeks
Hands-on technical work, delivered by me, not handed off.
Most assessment programs generate data. Few generate the evidence that actually drives decisions.
Recent example: research agenda and governance roadmap for a medical specialty board.
Leadership is where technical excellence either scales or stalls.
Strong standards require capable leadership.
How we work together
Engagements range from focused, fixed-fee reviews to ongoing advisory relationships. Some organizations need a defined scope with a clear deliverable. Others benefit from a retained advisor present for the questions that arise between scheduled meetings. Either way, the work is calibrated to your context, not a standard package.
Let's find out if there's a fit.
Book a 30-minute callQuestions first? Email john@empiricallysound.com