OSCAR

Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

These roles can be modified to suit a project's need and new roles can also be created. The Roles page has three main sections (from left to right): 1) a list of all active roles in order of access level,     2) tabs that detail permissions by OSCAR page Category, and 3) a preview of the currently selected role's page access. To get started, select a role and begin reviewing the permissions or create a new role. After all the changes to a selected role have been finished, the changes will not take effect until the Save button is used. Note, after saving the role of the current user, the Director role will be selected by default.  

...

  • Score Rangefinding: Access to the Rangefinding Scoring queue on the Scoring page.
  • .Backreading: Access to the Backreading Scoring queue on the Scoring page
    • Auto-populate Backread Score: scores and comment codes will be pre-selected based on the score that is being Backread. Backread rater can still submit a different score if desired.
    • Show Agreement Stats: display backread agreement stats on the Backread home page.
    • Backreading to Own Teams: limits Backreading to only responses scored by users on the Backreaders' teams.
  • Has Resolution Access: Provides access to the Resolution Scoring queue on the Scoring page.
  • Has Adjudication Access: Provides access to the Adjudication Scoring queue on the Scoring page.
  • Has Appeals Access: Provides access to the Appeals Scoring queue on the Scoring page.
  • .Flag Queue Scoring: Provides access to the Flag Scoring queue on the Scoring page
    • Delete Flags: Allows users to delete flags.
    • Can Send Flag to Supervisor: allows users to send a mail message to a user with a higher role permission (e.g., Supervisor) that includes the current response being reviewed.
    • Is Flag Supervisor: Allows users to review and be able to resolve the responses sent via email but the user with the Can Send Flag to Supervisor permission.
  • Not Required to View all: Allows users to skip and score audio and video media without having to view the whole response (despite item configuration). This is designed for scoring leadership.
  • Allow Response Printing: Allows users to Print from the browser while Scoring.
  • Show Help Link: Enables the Help link to Zendesk support and articles from the User Profile menu.
  • Prevent Auto-Enter: Limits the user from using the Auto-enter feature on the Scoring page to automatically enter the Scoring queue of the first item with available responses in a Section.
  • Can Escalate: Enables the Escalate button during Scoring to escalate responses into QC pools.
  • Apply Admin Flags: User can apply Flags and Condition Codes with an Admin type.
  • Review Restricted Flags: User can access responses with flags that have the Restricted Review setting.
  • View Hidden Response ID: User will see the response ID as normal when the item is configured to "Hide Response ID"
  • View Admin Metadata: Metadata keys saved in Tenant Setup will be viewable while Scoring.
  • View Copyleaks Reports: View Copyleaks reports while Scoring, IF Copyleaks integration is on.
  • Skip Validity: User will not score Validity responses while in Scoring.
  • Show Count While Scoring: Displays a count of all scores, including validity and calibration, in Scoring.
  • Show Score & Time Per Item: Displays scores and time spent on each item on the Scoring page.
  • Show 1st Scorer's Annotations: While Scoring a Reliability response, the user can view any highlighting/annotations saved by the first rater.
  • Reset Own Scores: User can reset their own scores IF they also have access to Auditing.
  • Is Beginner: In the Scoring queue, user will only be able to score Unscored responses and responses with a first read by a non-beginner.
  • First Read Only: In the Scoring queue, user will only be able to score Unscored responses.
  • Prevent Downloading Resources: Disables the download button when viewing a Resource.
  • Require Lockdown Browser: Prevents access to OSCAR unless the user has installed the Lockdown Browser.
  • Prevent Multiple Scores of Same ID: Prevents users from Scoring a response with the same ref id as a previously scored response.
  • Skip Training: Users are not required to complete training in order to begin scoring. Users will still be able to view the training content.  
  • Exempt from Rate Exception: Users assigned this permission can access scoring anytime overriding the Project > Setup > Project Availability settings.

Bulletin Board: Enable access to view the Bulletin Board page where static messages can be created for all users or for specific Roles. 

  • Post BulletinsAllows creating and editing Bulletins.
  • Exempt from Scoring Availability: Limit when users can access scoring. Example: Scoring leadership users have access all the time but scorers/markers only have access during the assigned scoring time/period.
  • Can View Incentives:Displays the Incentive Score Bar in the Scoring viewer, showing daily scoring progress and incentive targets when configured. 

Bulletin Board: Enable access to view the Bulletin Board page where static messages can be created for all users or for specific Roles. 

  • Post BulletinsAllows creating and editing Bulletins.

Mail: Allow basic Mail access Mail: Allow basic Mail access to view messages. Options allow access to contact a supervisor or enable advanced permissions for sending raters feedback messages or receiving email notifications when new responses are loaded. 

  • Send Mail to Anyone: Users can create mail messages to any other user.
  • Send Mail to Supervisors: Users can only create mail messages to a user with an access level of 40 or higher.
  • Only Mail to Team (limits access): Users may only send mail to their team members and not all users associated with the tenant.
  • Reply to Mail from Anyone: Users can reply after receiving a mail message.
  • Send to External Emails: Users can send Mail messages to the email address associated with user accounts.
  • Mark Mail as Important: Allows users to require a Mail message to be read before the Scoring queue can be accessed.
  • Receive Emails on New Responses: Automated messages will be sent to the users email address when new responses are loaded in Sections the user is assigned.
    • Even from Unassigned Sections: Automated messages will contain response loading counts from all items in the tenant.
  • Receive User Lockout Emails: Automated messages will be sent to the user's email address when any user on their team is locked outmessages will be sent to the user's email address when any user on their team is locked out.
    • Receive User Lockout Emails – Only from Assigned Teams: Limits lockout email notifications to users on the same team(s) as the locked‑out user.
  • Receive Alert Emails: Receive emails when a flag that is an Alert type is used by any rater.
  • Receive Daily Email: Receive email with a cumulative list of appeals for all tenants.
  • Receive Appeal Email on Request: Receive emails when a response is flagged for an appeal score.

...

Auditing: Usually only high-level users will have access to Auditing pages (Auditing, Candidate Auditing, Score Auditing) as they can be empowered to upload and delete responses, view and modify scores, and perform other project tasks like export or release responses. Use the Score Auditing permission with "Score Auditing to own scores" to allow raters a very limited access that will allow them to review their own scores and make changes if they also have the Scoring permission for "Reset Own Scores."

  • Candidate Auditing- access : access to Candidate Auditing page where responses can be searched for across an entire Project and all responses with matching ref ids can be viewed
  • Auditing-  access :  access to Auditing page
    • Auditing to Assigned Sections- limits : Limits user on Auditing page to only sections and items the user's Team is assigned. This limitation will also prevent the user from viewing items not on the user's team in QC Setup as well as all Reporting pages.
    • Auditing to School Code- user : User can only view responses in Auditing that share a matching School Code
    • Create/Delete Responses & Scores- user : User can import responses to an item as well as delete scores and responses that do not have any scores
    • Unprotect Responses- user : User can unprotect responses that have been marked protected to allow scores to be reset or additional scores added.
    • Queue For Export- user : User can queue responses for export.
    • Export Scores: User can create a .csv export of the item's responses and scores
    • Show Score History: User can view all previous scores applied to a response that have been deleted
    • Assign Scorers (Assigned Delivery)- allows : Allows assigning scorers to a response if the Item has the Assigned Delivery option enabled
    • Request Rescores- while : While viewing a response, the user can request a scored response be rescored by the same rater. This rescore request will be viewed and the new score applied through the raters' mail. 
    • Escalate in Preview Mode- allows : Allows Escalating responses to Rangefinding or QC while viewing the Auditing table in Preview mode

Score Auditing: Like Auditing, though a table of scores applied to items rather than by response. The page includes score time and score creation data and can be filtered by score date.

  • Score Auditing to Own Scores- limits : Limits Score Auditing page to only scores generated by the user.
    • Show Past 24 Hours Only- further : Further limits own scores to the last 24 hours.
  • Allow Access to Reset History- access : Access to Reset History page where all bulk score deletion records are kept.

Reporting: Enable access to specific reporting pages designed to provide detailed information about project progress and rater performance. When the "Auditing to Assigned Sections" is also enabled, users on Reporting pages will be restricted to data generated from the teams the user is assigned.

  • Completion: view View the status of all responses for active Projects and use links to jump to Auditing to view the responses representing specific values.
  • Scorers: view View all scores applied by each user for a Section or Item.
  • Daily: View frequency distribution data by trait and user score distribution against average score distribution.
  • Daily Scoring Management: Custom report for user and AI scoring that is generated once per day at 4 am CST.
  • Payroll: Reports all user scores by section and item for a specified date range.by section and item for a specified date range.
    • Can Set Incentives: 
      Allows users to create and manage Incentive configurations in Payroll Reporting, including targets for validity, scoring thresholds, and daily limits. 
  • Quotas: View users' score data in relation to the active Item Quota(s) (Item Setup).
  • User Summary: User performance such as IRR and QC data on all Items.
  • Item Summary: Item IRR and frequency distribution data.
  • User Agreement: IRR, Validity , and Resolution data for each user by Item.
  • Backread Agreement: Performance for each rater against Backread scores by Item.
  • Project Agreement: IRR and Validity agreement data for all items by Project.
  • Training Completion: View and/or modify user progress on Training Courses.
  • SLA: View the count of incomplete responses that were loaded since the number of hours selected. 
  • .
  • SLA: View the count of incomplete responses that were loaded since the number of hours selected.
  • Validity Report: View special customer report. 
  • Alert Status Report: View all responses that have been flagged as an alert and the status of each.

Operations

The following permissions are for the project scheduling tools and access to Dashboards:

  • Project Forecast: Access to a page for a viewing project completion based on Project Schedules as well as creating project completion forecasts.
  • Schedule Sign-up: Access to My Schedule page where users can schedule and view shifts for projects that use the Scoring Availability Project options.
  • Supervisor Calendar: Access to the Calendar page to view all scheduled shifts by raters for a Project with Limited Availability settings.
  • Project Dashboard: A dashboard view of completion status for all items by Project. Also allows creating exports by Section. 
  • Tenant Dashboard: View counts for all imported and exported responses on the tenant over a specified date range.  
  • Supervisor Dashboard: A page for viewing user activity by Team with the option to perform some user actions: active/inactive, send mail, and view reports.
  • Dashboard Reporting Data to Own TeamsLimit page access to only users that share a team with the supervisorreporting data to their own team.

Dashboards Personal: The default Scorer role will have access to the Personal Dashboard where raters can view personal scoring progress and assignments.

...

Video Meetings: Access to the video meeting functionality within OSCAR. (Please contact the OSCAR team for cost information.)

  • Create Meetings: Permission to create/schedule a video meeting.
  • View All Meetings: Permission to view all meetings created/scheduled (e.g., start time, duration, invited attendees).
  • Manage All Meetings: Permission to manage/edit all meetings meetings. 

User Management

User Setup: Add and modify users using the User Import feature or make users active/inactive or even archived if they should no longer be able to login.

...

This grants permission to view all logs of exported responses from the Loopback, Outgoing, and Observational Scoring Outgoing pages.


...

Tiny Link: https://support.assessment.pearson.com/x/EgCcD