This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?
The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.
The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.
This report summarizes findings from a research-practice partnership investigating STEM-rich making in afterschool programs serving young people from communities historically under-represented in STEM. The three-year study identified key dimensions related to (1) How STEM-Rich Making advances afterschool programmatic goals related to socio-emotional and intellectual growth for youth; (2) Key characteristics of programs that effectively engage youth historically marginalized in STEM fields; and (3) Staff development needs to support equity-oriented STEM-Rich Making programs.
These blog posts were written by researcher Andee Rubin in 2013 & 2014 as a way to provide technical assistance to investigators planning to carry out research in informal settings. The first post provides a history of human subjects protection as it emerged from medical research and thoughts about the application of these principles to informal settings. The second discusses the set of federally-mandated rules that Institutional Review Boards (IRBs) use to protect human subjects and describes how and when researchers need to seek IRB approval for their work. The third describes techniques for
Scientific literacy is an important educational and societal goal. Measuring scientific literacy, however, has been problematic because there is no consensus regarding the meaning of scientific literacy. Most definitions focus on the content and processes of major science disciplines, ignoring social factors and citizens’ needs. The authors developed a definition of scientific literacy for the California 4-H Program from the citizen’s perspective, concentrating on real-world science-related situations. The definition includes four anchor points: science content; scientific reasoning skills
The fact that inquiry-based science teaching has been defined in various ways makes claims about its effectiveness with students difficult to synthesize. In this meta-analysis, the authors generate a two-dimensional framework to analyze studies of the effectiveness of inquiry-based science instruction in improving student learning outcomes.
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. Science fairs have been taking place for more than 60 years. Yet in spite of their wide implementation and long history, there are few empirical studies that have examined the relationship between student participation in these fairs and their learning and interest in science. Additionally, there have been no studies to understand the real cost of these programs relative to the student benefits. Our 4-year study will be the first step to understanding the
DATE:
TEAM MEMBERS:
Abigail LevyJacqueline DeLisiMarian Pasquale
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. This project is exploring and identifying successful, cross-institutional approaches to using maker activities to engage members of communities of color (with a focus on family groups) in STEM activities.
This study examined the validity of the Draw-A-Scientist Test (DAST), which is commonly used to capture students’ perceptions of scientists. Findings suggest that the DAST is not valid as a sole measurement. The originally identified stereotypical traits are no longer widely held by students.
Citizen science has grown significantly as an area of activity around the world with many different models of practice and forms of participation. Citizen involvement in science can be seen as part of a long history of the role of the amateur in science. Research in the USA and UK suggests that citizen science has a powerful potential to support participation in and the learning of science. Increasingly, research has sought to explore and measure the development of 'science literacy', science identity and learning outcomes through citizen science. The scale, focus, and organisation of projects
Current science education policy advocates for engaging students in scientific practices of inquiry as the best way for students to learn science. McConney et al.’s analysis of PISA data unexpectedly found a negative correlation between frequency of inquiry-based instruction and high levels of student scientific literacy. The analysis confirmed a positive correlation between frequency of inquiry-based instruction and high levels of interest and of engagement in science.
Researchers examined how conducting an authentic science investigation in a bilingual classroom and weaving in discussions about the nature and culture of science affected students. They found that this process supported students’ growth in understanding of the scientific enterprise and made the culture of science more approachable.
The new standards posit that “scientific argumentation,” in which students use data to argue from evidence, is a key practice for student science learning. However, a mismatch in expectations about the purpose of classroom discussions can inhibit productive forms of argumentation. Berland and Hammer compare forms of class discussions to identify how best to support students’ engagement in argumentation.