Phase I: Surveys and Interviews to identify and understand FA
2010
|
2011
|
AUG
|
SEP
|
OCT
|
NOV
|
DEC
|
JAN
|
FEB
|
MAR
|
APR
|
MAY
|
JUN
|
JUL
|
AUG
|
Developing data collection instruments (e.g., a statewide survey, interview, etc.) from the literature reviews
|
Principals’ survey to 6,752 public PK-12 schools and 2,676 private schools
|
Analyzing the results of the survey
|
Interviewing CA district assessment officials, 46 States assessment directors, and major FA test providers
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Phase II: School-level Participation
2011
|
2012
|
SEP
|
OCT
|
NOV
|
DEC
|
JAN
|
FEB
|
MAR
|
APR
|
MAY
|
JUN
|
JUL
|
AUG
|
SEP
|
OCT
|
NOV
|
DEC
|
Developing instruments for collecting and analyzing data
|
|
School-level data collection (122 schools) - Principal survey - Teacher survey - Teacher-provided samples of FA * analysis of FA artifacts - Student-level data
|
|
Identifying Schools (using Phase I data) for participation in Phase II
|
Recruitment of Phase II schools
|
Expert selection for the Delphi study
|
Preliminary analysis of collected data
|
Generation of questions for the Delphi study
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Phase III: In-depth School-level Observations
2012
|
2013
|
DEC
|
JAN
|
FEB
|
MAR
|
APR
|
MAY
|
Identifying potential schools for Phase III
|
Northern California school visits (three schools, 6 classrooms) / UC Davis Team
|
Recruiting schools/teachers to participate in Phase III
|
Phase III Tool Development
|
Southern California school visits (four schools, 8 classrooms) / UCLA Team
|
Phase IV: Universe of Formative Assessment Components (UFAC) / 3 Meta-themes, 23 Themes, and 242 Components
2013
|
2014
|
JUN
|
JUL
|
AUG
|
SEP
|
OCT
|
NOV
|
DEC
|
JAN
|
FEB
|
MAR
|
APR
|
MAY
|
JUN
|
JUL
|
AUG
|
(a) Compiling comprehensive list of teacher strategies and tools (Components) for the UFAC
(b) Organizing comprehensive list of Components into 23 Themes or higher order constructs and 3 Meta-Themes, a collection of related Themes
(c) Reviewing and refining initial Component list and Theme identification
|
(a) Reviewing literature to support selection of final Component list
(b) Reviewing and refining Component list informed by the formative assessment literature
(c) Reviewing literature for each formative assessment Component
|
Conducting the Delphi study with the selected five experts (Phase I – IV)
|
Pilot testing (UCLA Team) - Pre-test: 153 students - Post-test: 114 students
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Phase V: Implementation and field testing of UFAC components
2014
|
2015
|
SEP
|
OCT
|
NOV
|
DEC
|
JAN
|
FEB
|
MAR
|
APR
|
MAY
|
JUN
|
JUL
|
AUG
|
Descriptive rating on the strength of the evidence supporting the Component effectiveness
(a) Strong: Some empirical studies that include a vetting process
(b) Some: Studies more descriptive in nature and/or studies without a vetting process
(c) Promising: Articles that focus on theory or philosophy associated with a formative assessment strategy/practice such as what it could or should look like without any systematic investigation or testing
|
UCLA Research team intervention
- Developed a series of formative assessment tasks for Grade 8 math
|
UC Davis Research team pilot testing
- Pre-test: 20 students
- Interim: 13 students
- Post-test: 14 students
|
|
- Targeted Common Core State Standards 8EE 5, 6 and Math Practices#3
- These tasks were developed in collaboration with two expert teachers.
- FAM tasks were implemented in nearly 20 Grade 8 classrooms with 300 students in three schools across two districts.
- The CRESST team is in the process of analyzing study data.
|
|
|
|
|
|
|
|
|
|
|
|
|
2015
|
2016
|
SEP
|
OCT
|
NOV
|
DEC
|
JAN
|
FEB
|
MAR
|
APR
|
MAY
|
JUN
|
JUL
|
AUG
|
(a) Collecting additional literature reviews to support the components
(b) Developing instruments and training materials for the implementation phase
(c) Implementing (continuing to implement) components in the two research sites (i.e., UC Davis and CRESST-UCLA).
|
* UC Davis Research team intervention
- Targeted Common Core State Standards 8EE 5, 6, and 7 - Recruited a total of 60 Grade 8 classrooms (30 Treatment / 30 Control; from August 2015 to March 2016) - Collecting data and grading assessments
|
* CRESST-UCLA Research team intervention (completed in spring 2015) - Targeted Common Core State Standards 8EE 5, 6, and Math Practice 3 - Data were cleaned and analyzed. - Scoring was completed by December, 2015.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2016
|
2017
|
SEP
|
OCT
|
NOV
|
DEC
|
JAN
|
FEB
|
MAR
|
APR
|
MAY
|
JUN
|
JUL
|
AUG
|
* UC Davis Research Team Grading & Analyses
- Grading the assessments of pretest, interim and posttests.
- Run the preliminary analyse, factorial analyses and linear refression.
- Construct the FAMproject. net.
- Upload all the UFAC components.
- Write up the NSF grant final report.
- Write up a series of manuscripts for the AERA journals.
- Present the outcomes and reports in academic conference and disseminate the research study in the academic and practitioner field.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|