...
From the QC Setup page, Qualification sets can be created to use when a item's Qualification settings are enabled. A Qualification set is a number of responses that are either Escalated from Scoring or the Auditing page or are loaded directly into the Qualification set from outside of OSCAR. Qualification responses are saved to a set and their true scores configured using the Manage Responses feature. Each set must have a scoring Rule and a Pass Percent configured that will determine if raters successfully pass the set. Qualification sets will not be be fed to scorers until the set is made Active from the Set Options. Qualification sets will follow a set of rules and processes when used or a Qualification Set Workflow.
Rules
The set rule will determine determines how results are calculated for meeting the Pass Percent. There are five rule settings available in the Qualification set:
Exact Agreement, By Response: The rater's score on each response must have the exact same overall score as the true score for the response to be counted as correct.
Exact Agreement, By Trait: The rater's score on each trait must have the exact same scores as the true score to be counted as correct.
Exact/Adjacent, By Response: The rater's overall score on each response must be within 1 one point of the overall true score for the response to be counted as correct.
Exact/Adjacent, By Trait: The rater's score on each trait must be within 1 one point of the true score to be counted as correct.
Omaha: Customize the maximum overall difference in score allowed (Max Score Diff) and the number of non/adjacent trait scores (Max Non-adjacent) to determine if the response is counted as correct.
...