The pilot test for Changemakers: Advancing Community Science Literacy was a capacity building program integrating strategic discourse & community change theory that identified a new path for advancing community STEM literacies. The results of experiment established partnerships with locally based non-profits, and a collaborative effort to address environmental justice and social disparities in areas threatened by climate change.
The evaluation was underaken with instruments developed for multiple research projects to support cross-project comparative analysis.
This instrumemts presented
This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.
This set of appendices represent all research instruments related to study presented in the I/CaLL Art Experiences and Advancing Science Literacy report (NewKnowledge Publication #NSF.097.115.07).
Appendix A: Installation Site Intercept Interview Instrument
Appendix B: Artists-Scientists Walk & Talks Instrument
Appendix C: Post-Performance Event Survey Instrument
Note that researchers did not use an instrument for the fourth aspect of the study, the post-performance event reflection sessions. Instead, they allowed the discussions to be directed by the reflection participants.
DATE:
TEAM MEMBERS:
John FraserRebecca Joy NorlanderSophie SwansonNezam ArdalanKate FlinnerJoanna Laursen BruckerNicole LaMarca
RMC Research designed evaluation activities to provide formative and summative feedback to the Hubbard Brook Research Foundation (HBRF) on their NSF Pathways project, Forest Science Dialogues (FSD). FSD consists of a plan to engage with scientists at the Hubbard Brook Ecosystem Study and with the surrounding community using the Hubbard Brook Roundtable dialogue process in order to facilitate mutual learning. The purpose of this engagement was to increase public knowledge, understanding, and awareness of ecosystem science in the Northern Forest in order to enrich local dialogue surrounding
With support from the Institute of Museum and Library Services, The Wild Center (TWC) engaged Insight Evaluation Services (IES) to assess the impact of specific outreach activities of the Northern New York Maple Project between September 2013 and September 2015. Data for this two-year evaluation study were collected via in-depth telephone interviews conducted with a total of 25 participants, including 16 Tupper Tappers (Tupper Lake area residents who engaged in backyard tapping to provide sap for syrup production at the museum through the Community Maple Project), four local school teachers
The Designing Our World (DOW) project centers on science, technology, engineering, and mathematics (STEM) equity and addresses the need for more youth, especially girls, to pursue engineering and fill vital workforce gaps. DOW will integrate tested informal science education (ISE) programs and exhibits with current knowledge of engaging diverse youth through activities embedded in a social context. Led by teams of diverse community stakeholders and in partnership with several local girl-serving organizations, DOW will leverage existing exhibits, girls’ groups, and social media to impact girls’
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryAnne Sinkey
This report summarizes findings from a three-year study of the Time Team America: Science of Archeology project, funded by the National Science Foundation. The project included a series of archaeology field schools for youth, four broadcast episodes and a redesigned website with a variety of information and instructional resources. The evaluation included both formative and summative components and a mix of qualitative and quantitative methods including surveys, interviews, and focus groups. Includes interview protocol and survey.
This mixed-methods evaluation, which was conducted at the request of the museum’s Communications department, answers two questions about a suite of special family events at the Burke Museum. First, this project sought to develop a profile of Family Day visitors – including any differences in audiences across individual events, and how visitors were receiving information about the events. Second, this evaluation sought to explore visitors’ expectations of and experiences at the events. Specific evaluation questions included the extent to which expectations and experiences aligned with one
DATE:
TEAM MEMBERS:
Emily CraigBetsy O'BrienRenae YoungsBurke Museum of Natural History and Culture
The Minnesota Department of Natural Resources (DNR) MinnAqua program educates the state's youth about angling and aquatic resources. In 2001, MinnAqua developed a Leaders' Guide so educators could carryout MinnAqua activities in their own setting. As part of the development process, a formative evaluation was undertaken to answer the questions: (a) To what extent are MinnAqua's rewrite guidelines addressed in individual lessons and the Leaders' Guide as a whole?, and (b) To what extent does the Leaders' Guide meet the educational needs of intended users in both formal and informal
DATE:
TEAM MEMBERS:
Amy Grack NelsonMinnesota Department of Natural Resources
Goodman Research Group, Inc. (GRG) conducted summative evaluation of the Journey to Planet Earth: The State of the Ocean's Animals project. GRG has served as external evaluator for Journey to Planet Earth since 1999. Journey to Planet Earth is a PBS series that explores the fragile relationship between people and the world they inhabit. The most recent evaluation included two components: 1) a viewer study of the Ocean's Animals episode in the series (hosted and narrated by Matt Damon), and 2) an evaluation of the outreach initiative that complemented the series. The broad goal of the
DATE:
TEAM MEMBERS:
Marianne McPhersonElizabeth BachrachIrene F GoodmanScreenscope, Inc.American Association for the Advancement of Science
One World, One Sky: Big Bird's Adventure (OWOS) is a bi-national, China-US cooperative project to produce and distribute a planetarium show based on popular characters from Sesame Workshop's television productions in each country for preschool- and kindergarten-aged children, as well as accompanying outreach materials for children, parents and teachers to further enhance learning. The project aims to: (1) provide young Chinese and American children aged four to six with an age-appropriate introduction to astronomy; (2) promote positive attitudes toward science among young children in both
To prepare for future summative research on the synergy among multiple educational media, the present pilot research explored real-life use of Cyberchase outreach materials. The present pilot study included: a Web survey of 48 outreach providers (representing over 3000 children in 19 states), follow-up phone interviews with 26 of these providers, and in-person observations at two outreach sites, one in New York and one in Massachusetts. With an eye toward future summative research, the resulting data yield conclusions and implications in two broadly defined areas: providers' use of Cyberchase