External Validation: JAMA Network Open Confirms Structural Unreliability of Interview-Based Assessment

A McMaster University Meta-Analysis Independently Confirms the Foundation on Which the Structural Identity Profiler Was Built

On May 28, 2026, JAMA Network Open published a meta-analysis by Duncan et al. that confirms from an independent, peer-reviewed source a foundational premise of Structural Identity Sciences: interview-based assessment instruments do not produce structurally reliable results.

STUDY SUMMARY

The McMaster University research team meta-analyzed 57 studies involving more than 8,000 adults from 26 countries. The study focused on test-retest reliability of standardized diagnostic interviews for adult psychiatric disorders — the instruments the clinical and assessment fields have treated as the gold standard for diagnosis.

Key finding: these interviews demonstrate only moderate test-retest consistency. The same individual, assessed with the same instrument under similar conditions, produced different diagnostic outcomes when assessed again days later. Consistency varied substantially by disorder category, with conditions relying more heavily on subjective experience showing lower reliability.

The researchers concluded that the field should reconsider treating standardized diagnostic interviews as a gold standard of assessment.

Reference: Duncan LJ et al. Test-Retest Reliability of Standardized Diagnostic Interviews for Common Adult Psychiatric Disorders. JAMA Network Open. 2026. DOI: 10.1001/jamanetworkopen.2026.15039

CONVERGENCE WITH THE 81.4% FINDING

The McMaster study and the LifePillar Institute's 10,000-case Monte Carlo simulation (Gaconnet, 2026; SSRN 7657314) arrive at the same structural conclusion from independent directions.

The McMaster study examined the instrument: does the diagnostic interview produce consistent results? Finding: no, not reliably.

The LifePillar simulation examined the source: does the person under structural load produce accurate self-report? Finding: no. 81.4% misidentify the domain. 73.0% minimize the depth. 61.1% exhibit compound risk — wrong about both simultaneously. The error is systematic, directional, and type-specific.

The convergence is structurally significant. The tool is inconsistent (McMaster) AND the person using the tool cannot produce accurate input data (Gaconnet). The interview-based assessment methodology carries two independent sources of structural error operating simultaneously.

IMPLICATIONS FOR THE STRUCTURAL IDENTITY PROFILER

The Structural Identity Profiler was designed from its origin to bypass both of these structural limitations.

The instrument does not rely on the diagnostic interview. The instrument does not rely on the subject's self-report. Four biometric channels — EEG, heart-rate variability, facial affect, voice prosody — read the subject's structural state independently of their conscious narrative.

This design decision was not made for convenience. It was made because the structural framework underlying the instrument — Cognitive Field Dynamics — predicts that self-report reliability degrades as a function of structural load. The 10,000-case simulation quantified this prediction. The McMaster meta-analysis now confirms independently that the interview instruments the field relies on to capture self-report do not produce consistent results even before the structural load variable is introduced.

The JAMA finding strengthens the instrument's foundational rationale. The interview was never a reliable starting point. Now the field's own peer-reviewed literature confirms it.

IMPLICATIONS FOR REFERRAL PARTNERS AND PROFESSIONAL RISK ASSESSMENT

Every professional risk assessment that relies on the executive's verbal narrative — behavioral interviews, personality assessments, scenario-based questioning, 360-degree reference checks — shares the same structural dependency the McMaster study has now demonstrated to be inconsistent.

For private equity firms: the behavioral interview assessing founder readiness shares the same structural limitation. The tool produces inconsistent results. The founder's self-report is unreliable at the population level.

For attorneys: the diagnostic evaluation assessing client capacity uses the same class of instruments the JAMA study examined. The gold standard does not produce consistent results.

For boards and fiduciaries: the executive assessment tools rooted in interview methodology carry two sources of structural error — tool inconsistency and source unreliability — operating simultaneously on the very population where accurate assessment carries the highest stakes.

Independent structural measurement — assessment that does not begin from the interview and does not depend on self-report — is not supplemental. It is the correction for a systematic error the field has now documented.

SCIENTIFIC INTEGRITY NOTE

The LifePillar Institute maintains a documented Methodological Declaration covering non-directional prompting, multi-system cross-validation, Monte Carlo validation methodology, binary criterion application, and named limitations. The 81.4% finding is a simulation-based result (N = 10,000) with 95% Wilson score confidence intervals. Empirical validation with living subjects is the next phase. The simulation validates the instrument's logic, computation, and classification system. It does not constitute empirical prevalence validation.

This limitation is stated in every publication.

Full scientific framework documentation is maintained at lifepillarinstitute.org.

Don L. Gaconnet, CSE IIIFounder, LifePillar Institute for Structural Identity SciencesLake Geneva, WisconsinJune 2026