...
Enable permissions for access to the various OSCAR tools used to monitor rater performance and create/modify responses and scores.
Quality Control (QC) – There : There are separate permissions for each page of the QC features that can be limited to the Sections the user is assigned (Auditing to Assigned Sections).
- QC Setup- access : Access to the QC Setup page to create and modify QC sets
- QC Report- view : View the QC Reporting page to view item and set level QC performance
- QC Portfolio- view : View individual QC performance by QC type on the User Portfolio page
Rangefinding – Access : Access to create Rangefinding sets (Rangefinding Setup) and view Rangefinding reports (Rangefinding Reports), though the permission to score Rangefinding sets can be found in Scoring.
Auditing – Usually : Usually only high-level users will have access to Auditing pages (Auditing, Candidate Auditing, Score Auditing) as they can be empowered to upload and delete responses, view and modify scores, and perform other project tasks like export or release responses. Use the Score Auditing permission with "Score Auditing to own scores" to allow raters a very limited access that will allow them to review their own scores and make changes if they also have the Scoring permission for "Reset Own Scores."
- Candidate Auditing- access to Candidate Auditing page where responses can be searched for across an entire Project and all responses with matching ref ids can be viewed
- Auditing- access to Auditing page
- Auditing to Assigned Sections- limits user on Auditing page to only sections and items the user's Team is assigned. This limitation will also prevent the user from viewing items not on the user's team in QC Setup as well as all Reporting pages.
- Auditing to School Code- user can only view responses in Auditing that share a matching School Code
- Create/Delete Responses & Scores- user can import responses to an item as well as delete scores and responses that do not have any scores
- Unprotect Responses- user can unprotect responses that have been marked protected to allow scores to be reset or additional scores added.
- Queue For Export- user can queue responses for export.
- Export Scores- can create a .csv export of the item's responses and scores
- Show Score History- can view all previous scores applied to a response that have been deleted
- Assign Scorers (Assigned Delivery)- allows assigning scorers to a response if the Item has the Assigned Delivery option enabled
- Request Rescores- while viewing a response, the user can request a scored response be rescored by the same rater. This rescore request will be viewed and the new score applied through the raters' mail.
- Escalate in Preview Mode- allows Escalating responses to Rangefinding or QC while viewing the Auditing table in Preview mode
Score Auditing – Like : Like Auditing, though a table of scores applied to items rather than by response. The page includes score time and score creation data and can be filtered by score date.
- Score Auditing to Own Scores- limits Score Auditing page to only scores generated by the user
- Show Past 24 Hours Only- further limits own scores to the last 24 hours
- Allow Access to Reset History- access to Reset History page where all bulk score deletion records are kept
Reporting – Enable : Enable access to specific reporting pages designed to provide detailed information about project progress and rater performance. When the "Auditing to Assigned Sections" is also enabled, users on Reporting pages will be restricted to data generated from the teams the user is assigned.
- Completion- view the status of all responses for active Projects and use links to jump to Auditing to view the responses representing specific values
- Scorers- view all scores applied by each user for a Section or Item
- Daily- view frequency distribution data by trait and user score distribution against average score distribution
- Daily Scoring Management- custom report for user and AI scoring that is generated once per day at 4 am CST
- Payroll- reports all user scores by section and item for a specified date range
- Quotas- view users' score data in relation to the active Item Quota(s) (Item Setup)
- User Summary- user performance such as IRR and QC data on all Items
- Item Summary- item IRR and frequency distribution data
- User Agreement- IRR, Validity, and Resolution data for each user by Item
- Backread Agreement- performance for each rater against Backread scores by Item
- Project Agreement- IRR and Validity agreement data for all items by Project
- Training Completion- view and/or modify user progress on Training Courses
- SLA- view the count of incomplete responses that were loaded since the number of hours selected.
Operations
These The following permissions are for the project scheduling tools and access to Dashboards.:
Project Forecast – Access to a page for a viewing project completion based on Project Schedules as well as creating project completion forecasts.
...
User Management
User Setup – Add : Add and modify users using the User Import feature or make users active/inactive or even archived if they should no longer be able to login.
- Force Password Reset- allows sending a password reset email to a specific user from the user's detailed page (user Edit)
Team Setup – Create : Create teams of raters but note that the permission for assigning a Team to a Section is found in Setup/Configuration (Section Setup).
...
Very few users will typically have access to the Setup/Configuration pages as this is where the project infrastructure is created and modified.
All Tenants Setup – Only : Only an account manager should have this access as it will allow a user to create new tenants and import users across tenants.
Current Tenant Config – This : This is required for access to the Roles page and can be combined with an access level to allow a supervisor to change the role access for scorers as needed without the possibility of higher level users losing any access.
Project Setup – Create : Create Projects and project availability schedules. Projects can be made inactive to remove their data from the Reporting pages and "hidden" to remove all associated objects from the Setup view.
Section Setup – Create : Create new Sections, functionally Item groups, and assign Teams to existing Sections as well as require Training.
Add/Remove Teams Only- limits users to only having access to update (add/remove) section team assignments
Item Setup – Add : Add new Items for scoring projects or modify items to change their scoring rules, the scoring view, or the integration with other systems.
- Activate/Inactivate Items Only- limits : Limits the user to view the Items table but only interact with the active/inactive toggle
- Only can Modify Resources - limits : Limits the user to only modify or delete item resources
Rubric Setup – Define : Define a Rubric that can be assigned to multiple items. Note that once a rubric has been used for scoring, it cannot be modified or deleted until all associated scoring records are also deleted.
Training Setup – Build : Build Training Courses that can be required for access to items within a Section.
Resolution Group Setup – Create : Create Resolution Groups of multiple items so responses that share a ref id can be resolved by the same rater at the same time.
Limit Visibility of Inactive Objects – Remove : Remove inactive objects from the list view of the user on multiple pages.
Use Config Sheets – Access : Access to create and apply Configuration Sheets that can create objects and apply settings changes en masse on a tenant.
Manage IEA Models- Access : Access to IEA model configuration (See OSCAR team member for more information.)
...