Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of a program developed to immerse adult learners in the processes of scientific research by teaching participants to locate and report orphan and abandoned natural gas wells.
Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of a ten-week adult/community education program about topics related to natural gas development.
Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. Formative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined how effective a series of "Community Conversations" theater and dialogue/discussion events was at a) communicating natural gas development-related science content and community issues, and b) promoting audience members' openness to dialogue about natural gas development-related issues.
Summative evaluation of the Marcellus Matters: EASE project. Marcellus Matters: Engaging Adults in Science and Energy (EASE) was a program of Penn State University’s Marcellus Center for Outreach and Research (MCOR), in collaboration with other experts across the university. The first year of program activities took place in 2012, and the project continued through September 2016. EASE was a multidisciplinary initiative that provided adults in rural Pennsylvania with opportunities to increase their knowledge of science and energy systems and engage in scientific inquiry and investigation
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
RMC Research designed evaluation activities to provide formative and summative feedback to the Hubbard Brook Research Foundation (HBRF) on their NSF Pathways project, Forest Science Dialogues (FSD). FSD consists of a plan to engage with scientists at the Hubbard Brook Ecosystem Study and with the surrounding community using the Hubbard Brook Roundtable dialogue process in order to facilitate mutual learning. The purpose of this engagement was to increase public knowledge, understanding, and awareness of ecosystem science in the Northern Forest in order to enrich local dialogue surrounding
Designing Our World (DOW) was a four-year NSF-funded initiative in which the Oregon Museum of Science and Industry (OMSI) sought to promote girls’ pursuit of engineering careers through community-based programming, exhibition development, and identity research. The overarching aim of DOW was to engage girls ages 9–14 with experiences that illuminate the social, personally relevant, and altruistic nature of engineering. In addition to programming for girls, the project also included workshops for parents/caregivers, professional development for staff from community partners; and an exhibition
MobiLLab is a mobile science education program designed to awaken young people’s interest in science and technology (S&T). Perceived novelty, or unfamiliarity, has been shown to affect pupils’ educational outcomes at similar out-of-school learning places (OSLePs) such as museums and science centers. A study involved 215 mobiLLab pupils who responded to three surveys: a pre-preparation, at-visit, and post-visit survey. Results provide evidence for four dimensions of pupils’ at-visit novelty: curiosity, exploratory behavior, oriented feeling, and cognitive load. Findings also show that classroom
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
“The Roads Taken” virtual conference was part of a three-phase research project designed to explore the very long-term impact of STEM youth programs (such as the iconic YouthALIVE program). In this first phase, a virtual conference was held to engage youth program practitioners in the development and testing of a Program Profile prototype, a structured document that helps institutions to characterize their own youth programs in useful ways.
Following the webinars and the completion of the Program Profile by each organization, participants were asked to complete a brief survey (included as
This longitudinal research study will contribute to a broader understanding of the pathways of STEM-interested high school students from underrepresented groups who plan to pursue or complete science studies in their post-high school endeavors. The project will investigate the ways that formative authentic science experiences may support youth's persistence in STEM. The study focuses on approximately 900 urban youth who are high interest, high potential STEM students who participate in, or are alumni of, the Science Research Mentoring Program. This program provides intensive mentoring for high school youth from groups underrepresented in STEM careers. It takes place at 17 sites around New York City, including American Museum of Natural History, which is the original program site. Identifying key supports and obstacles in the pathways of high-interest, under-represented youth towards STEM careers can help practitioners design more inclusive and equitable STEM learning experiences and supports. In this way, the project will capitalize on student interest so that students with potential continue to persist.
In order to understand better the factors that influence these students, this research combines longitudinal social network and survey data with interviews and case studies, as well as an analysis of matched student data from New York City Public Schools' records. The research questions in the study are a) how do youths' social networks develop through their participation in scientists' communities of practice? b) what is the relationship between features of the communities of practice and youths' social networks, measures of academic achievement, and youths' pursuit of a STEM major? and c) what are the variations in youth pathways in relationship to learner characteristics, composition of social networks, and features of the community of practice? The research design allows for a rich, layered perspective of student pathways. In particular, by employing social network analysis, this study will reveal relational features of persistence that may be particularly critical for underrepresented youth, for whom STEM role models and cultural brokers provide an otherwise unavailable sense of belonging and identity in STEM. The study will also access a New York City Public Schools data set comprised of student-level records containing biographical and demographic variables, secondary and postsecondary course enrollment and grades, exam scores, persistence/graduation indicators, linked responses to post-secondary surveys, and post-education employment records and wages. These data enable examination of inter-relationships between in-school achievement and out-of-school STEM experiences through comparison of program participants to similar non-participant peers. This project is supported by NSF's EHR Core Research (ECR) program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field.