Configure a Program

A program is a way to group tests that are delivered over multiple testing windows for reporting purposes. This allows you to track student performance over time. A test must be assigned to a program if you want to access the Performance Report.

In most cases, Customer Support will configure programs after working with customers to determine their reporting requirements.

Step-by-Step

1. Select Test Management, then select Program Configuration.
2. To create a program, you can: 
   • Select the Create New to set up a new program.
   • Select the Clone icon in the Actions column to duplicate an existing program.

3. Reference the expandable sections below to configure the new program as needed. 
   

   After creating a program...

   You can assign tests to it when creating a test from Test Management > Tests.

   Once you've assigned a test to a program, the program's performance objectives, windows, grade levels, and content areas cannot be changed. Make sure to plan and configure the program carefully before assigning tests. The checkboxes on the General Settings tab and the ISR Settings can be modified later, even when students are taking tests.

   General Settings

   Complete initial program setup on the General Settings tab. Define when, who, and what the program is used for. 

   You must define a primary performance objective before you can save data in General Settings.

   

   Program Name: Required. This name will be used when selecting a program in the performance reports, so it should be easy to recognize.

   Program Code: Optional. Not currently used or displayed on reports. 

   Scored: Select for tests delivered through the ADAM player. Leave this checkbox unchecked for tests delivered externally (such as through TestNav). A program cannot contain both ADAM and external tests.

   Active: Select to make the program available when assigning a test to a program and in reporting. You can leave this unchecked until you are ready to use the program.

   Standards Reporting: Standard subscores will be calculated and standard reporting will be available to teachers and administrators. For ADAM-delivered test only.

   Item Analysis Reporting: Item analysis reporting will be available to teachers and administrators. For ADAM-delivered test only.

   • Show item content, answers, and student responses: This checkbox becomes available after selecting Item Analysis Reporting.

   Show Student Their Results: Allows students to see their results in ADAM. For ADAM-delivered test only.

   Show Student Item View: Allows students to see the test items in ADAM. For ADAM-delivered test only.

   Available Testing Windows: Required. Enter one or more window names (such as Fall, Spring). Note that testing windows do not exist elsewhere in ADAM.

   Available Grades: Required. Select one or more grade levels to use in the program. 

   Available Content Areas: Required. Select one or more content areas used in the program, such as Algebra or ELA (these are defined in System > Client Settings). Content areas are similar to subjects but more specific. For example, Math is a subject while Geometry is a content area.

   Define Performance Objectives

   On the right side of the screen, define the performance objectives that you want to appear in reports, such as raw score. The available objectives will vary based on whether the Scored checkbox is selected in General Settings. Raw Score and Percent Correct objectives appear by default. 

   The objective configuration is a template that can be changed at the test level. For example, if you define cut scores here, they can be changed on individual tests when assigning them to the program. 

   Raw Score (RAW_SCORE): Always available. Reports show raw score if selected as a primary or secondary objective.

   Percent Correct (PERCENT_CORRECT): Always available. Reports show percent correct if selected as a primary or secondary objective.

   

   Additional Objectives

   Select from the Add Objective dropdown to add additional objectives. You can rename objectives in the Objective Name field. 

   Performance Level (PERF_LEVEL):

   • Usually set as the primary objective when used.
   • Input Variable: Select RAW_SCORE or PERCENT_CORRECT (or another input based on an objective you have created). This value will be used to determine the output score.
   • Performance Level Settings: Enter the Label, Text description (such as "Above expectations"), and Cut Score.
     
     • Check the Proficient box when applicable for the performance level. You can also import a CSV file.
     • Optionally, select new colors by selecting an existing color. Select Add to create more levels.
       

   Lookup (LOOKUP):

   • Enter a database key in the Objective Key field, such as "LOOKUP_Scale." This field CANNOT be blank.
   • Input Variable: Select RAW_SCORE or PERCENT_CORRECT (or another input based on objectives you have created). This value will be used to determine the output score.
   • Lookup Settings: Enter data in the Cut Score and Output fields. You can also import a CSV file.
     • The cut score starts at zero, so the lowest value you enter can be greater than zero, but you may use zero if you define a cut score for every raw score.
     • Optionally, select the Use Color Picker checkbox to customize the colors of the score groups. Select Add to create more levels.
       

   Dynamic Metadata (ITEM_METADATA):

   • Enter a database key in the Objective Key field, such as "DYNAMIC_METADATA." This field CANNOT be blank.
   • Score Calculation: Select NUMBER or PERCENT.
   • Select Metadata: Select a Bank, then select a Metadata Field.
     • You can only select one Metadata Field for each Dynamic Metadata objective.
       
       

   External (EXTERNAL):

   • Only available when the Scored checkbox is NOT selected in General Settings (i.e., tests are delivered in TestNav).
   • Objective Key must match the external passed data, for example "SCALE_SCORE."
   • Score Calculation: Select NUMBER or PERCENT.
   • Range Designation: Enter the default low and high scaled scores or number of questions, with 0 as minimum.
     • The range for each test can be defined later when tests are added to the program.
       

   Primary and Secondary Objectives

   A program must have a primary performance objective Optionally, you can select a secondary objective. The primary objective is the main focus of the report and will be emphasized on the report. The secondary objective will also be visible but not as prominent. For example, the primary objective may be Performance Level and the secondary objective may be Raw Score Percent Correct. Performance reports will emphasize score groups (with colors) defined in the Performance Level objective, while the secondary objective provides the score used to determine the performance levels. You may define additional objectives that feed data to the primary or secondary objectives shown on the reports. 

   Select the Primary or Secondary checkbox on a performance objective.
   

   ISR Settings

   You can set up the Individual Student Results report on the ISR Settings tab. These settings can be modified at any time, even during test taking. The ISR report can be accessed from the Performance Report.

   General Settings:

   • Report Title: Enter a name for the report.
   • Report Logo: Optional. Select a logo by browsing or drag and drop a file. JPG, PNG, and GIF are supported.

   Student Information:

   • Show ID: Show the student ID on the report.
   • Show Date of Birth: Show the student's date of birth on the report.
   • Show Grade Level: Show the student's grade level on the report.
   • Show School Name: Show the student's school name on the report.
   • Show District Name: Show the student's district on the report.

   Report Components IMAGE

   After defining the general settings, you can select and configure each section you want to include on the ISR.

   Add Report Section: Select this button to add a report section. Each section may contain one or more report components. 

   Section Title: Enter a name for the report section.

   Add Report Component: Select this button to add a report component to a section. You can add one or more components to a section. For each component, select a single Content Area, one or more Test Windows, and an Objective (database field).

   You can add the following components to the ISR.

   External Named: Only supports external data (currently TestNav). The External Objective is from TestNav data, such as scaled score.

   Growth: Shows a graph with performance over time. For performance levels, score groups appear as background colors on the chart. Supports both ADAM and external data from TestNav.

   Metadata Performance: Similar to the Growth report but using a grouping of items, such as reading comprehension or writing ability. Supports ADAM data only. 

   Outcome Table: Only supports external data from TestNav. You can build a table with up to 2 columns and as many rows as needed.

   Score and Performance: Shows the scaled score and a bar with colors for each performance level. Select the checkboxes to show test information, score group summary statements, and school and district averages. Supports ADAM data only.

   Score with Bar: Only supports external data from TestNav. Similar to the Score and Performance component but with an objective from TestNav data.

   Simple Level Output: Select a Performance Level Objective. Supports ADAM data only.

   Text: Use this component to share text information, including links. Enter a heading and text or links in the content area.

   If data does not exist for an ISR component you have defined, it will not appear on the report.
4. Select Save. The program appears on the Program Config page.

IMAGE