Platform · Shipped
Measured Ensemble Judgment — expert judgment with its error attached
Where a judgment previously required a human expert, N INDEPENDENT models make it, agreement is MEASURED (Krippendorff's alpha), unverifiable evidence is dropped BEFORE aggregation, and low agreement WITHHOLDS rather than guessing. Validated once against a hand-authored expert reference at 85%. The claim is not that AI can do expert judgment; it is that AI judgment can be held to the standard we hold human raters to.
- Cluster
- Platform
- Type
- primitive
- Status
- Shipped
- Used by
- people-analytics-toolbox, peopleanalyst-site, canonicai, devplane
Maturity evidence
- Functioning
- Three production consumers: role-reality-gap, canon-occupation-pairing, ai-source-validation. 19 tests.
- Valuable
- 85% agreement with a hand-authored expert reference; caught the Role Reality Gap measuring the wrong occupation (Specialists vs Managers) before publication.
- Understood
- docs/programs/MEASURED-ENSEMBLE-JUDGMENT.md + the shareable explainer.
- Integrated
- 18 of 26 declared AI sites remain single-rater. check:runtime-llm prints the ratio every run; MEJ-2 register lists the conversion order.
How to use it
Not surfaced with a callable endpoint yet — still building. Tell us you want Measured Ensemble Judgment — expert judgment with its error attachedand we’ll prioritize it.
Request Measured Ensemble Judgment — expert judgment with its error attachedOther Platform capabilities
- Comp audit self-serve — CSV intake, free validate, commerce-gated watermarked run (HO-155)
- Gift pass — gifted ownership on the entitlement store (magic-link claim)
- JobFrame canonical Job Family × Focus × Level taxonomy + classifier
- SMB pay-system wizard — chocolate/vanilla over the pay-system catalog
- Support channel — portfolio-wide /support form → ticket store → operator email
- Ask-your-data — generalizable NL→rank→tier→cite spoke (HO-378)
- Diagnostic acquisition — next-best-ask over a live hypothesis set
- Executive-Priorities Elicitation Instruments (static catalog)
Capability detail sourced from the People Analytics Toolbox capability feed (source of truth), snapshot retrieved 2026-07-23.