Observers were categorized as Novice (having observed less than 10 Assessments), Experienced (10-29 Assessments) and Expert (30 or more Assessments). The researchers found that the difference between DISCOVER staff and trained non-DISCOVER personnel was small, but a sizeable variation did occur between the levels of experience. After trained Observers viewed the same assessment, the researchers analyzed the results to determine if individual Observers reached the same conclusions. The studies focused on Observers, the trained individuals who observe problem solving strategies during the Assessment. Researchers, also, have analyzed results to compare the impact of Observers who have varying levels of experience.

They have analyzed results to compare what happens when the Assessment is administered by DISCOVER staff and when the Assessment is administered by trained non-DISCOVER staff. DISCOVER Assessment researchers have analyzed reliability studies for consistency in several categories. For example, an instrument with high reliability will produce consistent results when implemented under similar circumstances by different individuals. Reliability: Reliability is the measurement of how consistently an instrument accomplishes its intended purpose. To learn more, click DISCOVER Assessment. The Assessment has been used with multicultural populations in the United States and abroad and with students from varied economic levels.

DISCOVER research has been supported by the Office of Bilingual Education and Minority Languages Affairs and the Javits Gifted and Talented Education Program. The DISCOVER Assessment was developed and refined over a 13-year period. If you are a researcher who is interested in the statistical particulars of the various studies, click the “Details” graphic where available. To accommodate non-technical readers of this material, many terms and procedures, common to researchers, are explained in an easy-to-read format, and some conclusions are generalized based upon underlying data. This section provides a summary of studies that have been completed to show reliability and validity for the DISCOVER Assessment. DISCOVER Projects-Research Reliability & Validity of Assessment

Validity and reliability in assessment