Skip to main content
COMMUNITY:
Project Descriptions

Efficacy Study of Metropolitan Denver's Urban Advantage Program: A Project to Improve Scientific Literacy Among Urban Middle School Students

September 15, 2010 - August 31, 2016 | Public Programs, Informal/Formal Connections
This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families? The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work. The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.

Funders

NSF
Funding Program: DRK-12
Award Number: 1020386
Funding Amount: $3,272,614

TEAM MEMBERS

  • Nancy Walsh
    Principal Investigator
    Denver Museum of Nature and Science
  • Kathleen Tinworth
    Former Principal Investigator
    Expose Your Museum
  • 2014 11 13 Andrea 2
    Co-Principal Investigator
    Denver Museum of Nature and Science
  • Ka Yu
    Co-Principal Investigator
  • 2013 11 21 Dierking photo
    Co-Principal Investigator
    Oregon State University
  • Megan John
    Former Co-Principal Investigator
  • Polly Andrews
    Former Co-Principal Investigator
  • 2013 05 23 Falk headshot
    Former Co-Principal Investigator
    Oregon State University
  • Discipline: General STEM | Nature of science
    Audience: Middle School Children (11-13) | Educators/Teachers | Museum/ISE Professionals | Scientists | Learning Researchers
    Environment Type: Public Programs | Museum and Science Center Programs | Public Events and Festivals | Informal/Formal Connections | K-12 Programs

    If you would like to edit a resource, please email us to submit your request.