NAEP Technical DocumentationNAEP 2022 Sample Design
|
|
|
|
2022 State Assessment Sample Design |
The sample design for NAEP 2022 included samples for various operational assessments.
Representative samples were drawn for the following operational assessments:
-
long-term trend (LTT) age 9 and age 13 national assessments in mathematics and reading in public and private schools;
- national assessments in civics and U.S. history in public and private schools at grade 8;
- national assessments in mathematics and reading in private schools at grades 4 and 8; and
- state-by-state assessments and
Trial Urban District Assessments (TUDA) in mathematics and reading in public schools at grades 4 and 8.
The samples for the operational assessments were organized into eight distinct groupings and sampled separately as follows:
- mathematics and reading assessments in public schools at grades 4 and 8;
- mathematics and reading assessments in private schools at grades 4 and 8;
- civics and U.S. history assessments in public schools at grade 8;
- civics and U.S. history assessments in private schools at grade 8;
- mathematics and reading LTT assessments in public schools at age 9;
- mathematics and reading LTT assessments in private schools at age 9;
- mathematics and reading LTT assessments in public schools at age 13; and
- mathematics and reading LTT assessments in private schools at age 13.
The grade 4 and grade 8 assessments were all digitally based assessments (DBA) administered using tablets. The LTT assessments were paper-based assessments (PBA) administered using paper and pencil. LTT age 9 was administered in the winter of 2022 and LTT age 13 was administered in the fall of 2022 (in a different school year than age 9).
The national assessments were designed to achieve nationally representative samples of public and private school students in the fourth or eighth grades (or public and private school students who were age 9 or 13 in the case of LTT). The target populations included all students in public, private, Bureau of Indian Education (BIE), and
Department of Defense Education Activity (DoDEA) schools who were enrolled in grades 4 or 8 (or who were age 9 or 13 in the case of LTT) at the time of assessment. DoDEA schools for LTT and the grade 8 civics and U.S. history assessments were limited to those located in the U.S. (not overseas).
For the fourth- and eighth-grade mathematics and reading assessments in public schools, the TUDA samples formed part of the corresponding state public school samples, and the state samples formed the public school grades 4 and 8 part of the national sample. Nationally representative samples were drawn for civics and U.S. history and for the remaining populations of private school students, DoDEA students, and BIE students separately by grade.
The state assessments were designed to achieve representative samples of students in the respective grade. At grades 4 and 8, the target populations included all students in each participating jurisdiction, which included states, District of Columbia, BIE, DoDEA, and school districts chosen for the TUDA. For each grade and assessment subject, samples were designed to produce aggregate estimates with adequate precision for all the participating jurisdictions, as well as estimates for various student subpopulations of interest.
A one-time feature of some of the 2022 samples was maximum overlap with other earlier NAEP samples. This was done to facilitate certain analyses related to the fact that 2022 was the first assessment year after the COVID-19 pandemic. The state samples were selected to have maximum overlap with the school samples for the NAEP 2021 Monthly School Survey and the NAEP 2021 School and Teacher Questionnaire Study. The LTT samples were selected to have maximum overlap with the NAEP 2020 LTT age 9 and age 13 school samples, respectively. This overlap control was achieved for these samples by using an adaptation of the Keyfitz process.
The figure below illustrates the various sample types and subjects.
Components of the NAEP samples, by assessment subject, grade or age, and school type: 2022
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2022 Assessments.
Last updated 24 July 2024 (SK)