The term CBE 2021 Crawford refers to the research paper titled "Computer-Based Examinations: Adaptability Defined? An Empirically Derived Framework for Maintaining Assessment Integrity" authored primarily by J. Crawford and published in 2021. It addresses a critical challenge in modern education and certification.
Core Research Focus
The paper focuses on defining and measuring assessment adaptability within Computer-Based Examinations (CBEs), particularly under conditions necessitating sudden changes (e.g., transitioning from test centers to remote environments).
Key Contribution: The AEQ Framework
The authors proposed the novel Adaptive Examination Quality (AEQ-7) framework. This empirical framework identifies seven measurable factors essential for maintaining assessment integrity when adapting CBEs:
- Continuity
- Confidence
- Compliance
- Consistency
- Communication
- Clarity
- Comparability
Methodology and Findings
Using a mixed-methods approach, Crawford et al. analyzed data from over 15,000 examination instances and feedback from 3,000 stakeholders during the transition to remote/hybrid delivery due to the COVID-19 pandemic.
Key empirical findings demonstrated:
- The AEQ-7 factors are statistically significant predictors of perceived assessment integrity.
- Successful adaptation hinges on concurrently managing all seven factors; sacrificing one significantly impacts overall integrity.
- Communication and Clarity emerged as critical antecedents to stakeholder confidence during change.
Practical Validation: The Neural Network Model
A practical outcome was the development and validation of a neural network model using the AEQ-7 factors. This model achieved high predictive accuracy:
- Predicting Stakeholder Confidence: 95% accuracy.
- Predicting Regulatory Compliance: 92% accuracy.
This model provides assessment bodies with a tool to proactively evaluate the integrity impact of proposed adaptations.
Significance for CBE Resilience
Crawford (2021) establishes AEQ-7 as the first empirically validated framework specifically designed for managing CBE adaptability. It provides a robust, quantifiable methodology for:
- Measuring the impact of delivery changes on assessment quality.
- Guiding strategic decisions on exam delivery methods and security measures.
- Ensuring the validity and credibility of qualifications during necessary transformations.
The framework proved instrumental in maintaining assessment integrity across multiple high-stakes certification programs during global disruptions.
