This page is intended to help implementation teams determine the best way to set up programs if there are multiple categories of assessments.
Audience: Pearson delivery and customer lead project teams
This page explains:
Programs group tests that are delivered over multiple testing windows for reporting purposes. A test must be assigned to a program if you want to access the Performance Report. Programs are designed to work for a single academic year, not multiple years. In most cases, the Pearson program delivery team will configure programs after working with customers to determine their reporting requirements.
Before building out a program, take an inventory of all types of tests that will use ADAM in the upcoming school year (benchmarks, unit tests, diagnostics, etc.)
For each test type, determine the following:
Each test in a program must have a unique combination of testing window, grade and content area. In the sample program setup shown below, this means:
Sample Program Configuration: Each test must be tagged to a unique combination from these three fields.
You must create a separate program for any test/collection of tests which use and require:
The main advantage of having more programs is fewer options in report filter menus. Consolidating test categories into a single program allows for easier comparison of grades, subjects, and test windows in ADAM reports, including the Individual Student Report. Although reporting in ADAM is grouped by program, it is easy in reports to switch views from one program to another. Cross-program reporting is not currently available in ADAM
Note: The actual student's grade does not determine which grade ‘bucket’ they are reported into. Every student taking a specific test will be reported into the lowest grade tagged in the Program configuration. How students are eligible to take the test can be based on class enrollment or test assignment tags.
Everything is editable in a program until the first test is linked. Make sure to plan and configure the program carefully before assigning tests.
After assigning a test to a program:
Note: Cut scores, performance level labels and the option to display label only can be overridden at the test level before students start testing.
A: Yes – configurations do not need to be set until you are ready to create tests.
Q: Can test window dates overlap? (e.g., fall, spring, BOY)
A: Yes, these are just tags and have no bearing on testing dates.
Q: For a site that needs score groups, how do I set up performance levels?
A: Set the performance level objective as the Primary Objective, using the Percent Correct as the Input Variable. Set Percent Correct as the Secondary Objective. This will optimize reporting. For cut scores, use the most commonly used ones (can override at the test level).
Q: How many score groups/performance levels should I have?
A: Consider the number of items - more than 5-6 is probably not very statistically useful.
Q: When setting up performance levels, do I have to use whole numbers?
A: Yes
Q: Can I reorder the Content Areas if no tests have been linked?
A: No, but can remove a content area and add back in the desired order
Figure 1: All tests are in one program. Can filter by any combination of subjects, grades and test windows. A menu at the top of this page provides access to other programs.
Figure 2: If the program contains multiple sets of Testing Windows, the filter on the Performance report can be quite long. For example, Spring/Winter/Fall, BOY/MOY/EOY, Pre-Test/Post-Test, Unit 1/2/3/4, etc.
Figure 3: In the Program report, the same filters are available as for the Performance report, but results are grouped as shown. If you had multiple test categories, the user could filter on the test windows that apply to limit the view (e.g., include unit 1/2, but not BOY/MOY/EOY). Multi-grade tests are displayed under the lowest tagged grade level.
Figure 4: Both the Performance and Program reports provide a menu to switch programs.
Figure 5: In Program Configuration all of these options are editable, even after students start testing.
Figure 6: For the score groups, only the cut scores, labels for the performance levels and the ability to show only the labels can be overridden at the test level. Nothing else can be changed once tests are linked.
Tint Link: https://support.assessment.pearson.com/x/hYCNC