The SciGirls in Space: Exploring the Moon, Mars and NASA Careers Implementation Evaluation Report focuses on the STEM outreach component of the project for 15 girl-serving organizations who used research-based gender equitable and culturally responsive instructional strategies,NASA-aligned media and STEM activities with a focus on integrating of NASA women role models.
Kera Collective explored teachers’ and students’ experiences in Green-Wood Cemetery’s new Urban GreenSpace program focusing on environmental education.
Overview
In 2022, Kera Collective partnered with Green-Wood Cemetery to evaluate their new Urban GreenSpace program, which focused on environmental education programs for local middle school students.
As a new pilot program, we focused on exploring which aspects of the program were successful at supporting and expanding students’ interest and learning in environmental science as well as which aspects of the program might need to be
The NSF-funded project titled An Informal Learning Model of Genetic and Genomic Education for Adult Bilingual Learners, was led by Joanne Sandberg, PhD. The project included three phases:
Phase I: Investigation of knowledge and beliefs about transmission of traits, genetic and genomic concepts, gene-environment interactions, and environmental exposures in Latinx adults born in Mexico or Central America and who have limited literacy.
Phase II: Development of two educational interventions in Spanish that address:
Information about environmental exposures that can be detrimental to
This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
This Innovations in Development project supports racially and ethnically diverse youth in learning about climate resilience in informal settings, including community centers, afterschool programs, and museums. The project aims to: (1) build the capacity of community organizations to implement youth programming on climate resilience; (2) increase youth knowledge, skills, and self-efficacy associated with climate resilience (also referred to as environmental health literacy for climate resilience); and (3) explore how collaborating research universities and community organizations engage diverse youth in informal STEM learning. Project partners include the UNC Institute for the Environment, the University of Washington-Interdisciplinary Center for Exposures, Diseases, Genomics and Environment, the North Carolina Museum of Natural Sciences, Juntos NC, and the Duwamish River Community Coalition (DRCC). Juntos NC and DRCC actively engage Latino and Indigenous youth in their programming and seek to implement resilience-focused programming that supports youth science learning and leadership development.
Together, informal educators and participating youth will develop locally relevant solutions to climate impacts in their communities. Youth will interact with university-based climate scientists and educators to collect and analyze data and will participate in resilience-focused dialogue, planning, and actions in their communities. Youth will share what they learn with their families and peers through family events and teen summits. The project will engage dozens of educators in community organizations and at least 250 youth, who will share what they learn with their families and communities, reaching hundreds more people through communications and local action projects. Mixed-methods assessment will provide insight into the extent participating youth (a) develop environmental health literacy for climate resilience, and (b) take action to address resilience in their home communities. The team will assess how these outcomes vary by location, and the implications of any variation on potential for project replication. A participatory evaluation, led by an external evaluator, will provide insight into empowerment outcomes. Findings will be disseminated to professional audiences at local and national conferences; and curricular materials from this project will be disseminated through the project website.
To advance justice, equity, diversity, and inclusion in science, we must first understand and improve the dominant-culture frameworks that impede progress and, second, we must intentionally create more equitable models. The present authors call ourselves the ICBOs and Allies Workgroup (ICBOs stands for independent community-based organizations), and we represent communities historically excluded from the sciences. Together with institutional allies and advisors, we began our research because we wanted our voices to be heard, and we hoped to bring a different perspective to doing science with
DATE:
TEAM MEMBERS:
María Cecilia Alvarez RicaldeJuan Flores ValadezCatherine CrumJohn AnnoniRick BonneyMateo Luna CastelliMarilú López FrettsBrigid LuceyKaren PurcellJ. Marcelo BontaPatricia CampbellMakeda CheatomBerenice RodriguezYao Augustine FoliJosé GonzálezJosé Miguel Hernández HurtadoSister Sharon HoraceKaren KitchenPepe Marcos-IgaTanya SchuhPhyllis Edwards TurnerBobby WilsonFanny Villarreal
This Pilot and Feasibility project will investigate: a) the kinds of learning outcomes that occur in an informal STEM project utilizing a Critical Environmental Justice-informed Participatory Action Research framework, co-created between researchers and homeless communities, and b) the challenges and opportunities that arise in evaluating such collaborative projects. To address these questions, a team of university and community researchers will work with two self-organized homeless communities, in Portland, OR and Baltimore, MD, to systematically examine air quality at their sites and further develop a multimedia environmental justice toolkit. The toolkit is aimed at equipping homeless communities with STEM-based information and approaches to learn about and address various environmental hazards. Homeless people are disproportionately vulnerable to the impacts of air and soil pollution, rodents, extreme weather, floods, fires, and other hazards. This collaboration will study STEM learning outcomes related to the broader historical socio-political context in which people are living. The project also anticipates finding ways to adapt evaluation processes to better suit the needs of marginalized groups participating in informal STEM projects.
Guided by this integrated framework, the team will undertake participant observation, interviews, focus groups, and document analysis to assess learning. It also anticipates gaining insights into how evaluation processes may be adapted to better suit the needs of marginalized groups participating in informal STEM learning. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Chris HawnMelanie MaloneErin GoodlingDillon MahmoudiAnthony Levenda
This program will derive knowledge on extreme weather and its concepts to be shared with youth in the Boston and Kansas City areas. Subsequently, the youth will share this knowledge by displaying it as art work on the rapid transit systems. The art projects will culminate in broad-based exhibition at the end of each group's sessions. The project will involve 200 youth per region resulting in an impact of 1000 youth per year, 80 adult mentors and 20,000 adult transportation riders in learning about extreme weather concepts. Participant organizations are the University of Mass-Boston, University of Mass-Lowell, The Massachusetts College of Art, the University of Kansas Center for Research Inc., and the Goodman Research Group Inc.
The goals of this project are to bring the topic of extreme weather to the foreground by educating youth and in turn having them educate a selected group of adults that use the rapid transit system. Groups of youths will learn about the topic through a series of meetings with mentors who are experts on the issues around extreme weather. The youth will derive their own art-works with their interpretation. These art-works will be displayed on the rapid transit systems in New England (Merrimack Valley and Worcester regions) and the Mid-West (Topeka and Kansas City areas). Using a quasi-experimental mixed methodology (demographics, bus ridership, initial level of science awareness, and interest) the goal is to understand science learning outcomes associated with the creation and public display of youth art. Research questions of importance in this regard are 1. In what ways does blending art with the science enhance youth learning about extreme weather concepts? 2. To what extent does youth art support adult learning of science? and 3. How does regional context affect learning about extreme weather?
Broader impacts will result from the youth diversity as well as the diversity of riders of the rapid transit systems where the art of extreme weather is displayed.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert ChenLois HetlandJill LohmeierStephen MisholSteven SchrockClaudia Bode
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop and test a model for audience assessment that STEM professionals can use during their public engagement efforts. These on-the-spot assessments will allow scientists to monitor audience understanding and use this to make immediate improvements to their activity. This project fills a critical gap in the field of public science communication as expressed by outreach scientists and by the professional and academic organizations that train them. Project partners include The Astronomical Society of the Pacific, Oregon State University, Pacific Science Center, and the National Radio Astronomy Observatory. Research questions include: (1) How and under what conditions can scientists, regardless of discipline, learn to build assessment into outreach activities? (2) To what degree are scientists willing and able to change their outreach activities to include assessment to ascertain audience attentiveness or understanding? (3) To what degree will scientists be able to adjust their outreach and engagement efforts based on audience feedback, and what support do they need to do so? (4) With constraints on their time and resources, how can the model help scientists conduct audience assessment on their own? (5) Are audience members finding events more enjoyable and fruitful that use assessment techniques? Several iterative rounds of R&D will be used in the spiral design-based approach. A group of Design Testers will start each of the iterative cycles for the initial development and testing techniques, associated training, and support. Later phases will use Field Testers using a rubric for usability, validity, and reliability of various strategies. The summative evaluation of the project will begin early and add data over the life of the project. A mixed methods approach will be used including surveys of scientists once each year after they have participated in the Prototype training. Descriptive and inferential statistics will be used to document the extent to which the project has achieved its intended outcomes. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will build and test a new model for co-created public engagement with science activities in partnership with civic, community, and scientist partners. The innovation to be tested is deliberative dialogues in science museums that help reduce the polarization about socio-scientific issues, giving people a greater voice in science, and addressing barriers that disconnect scientists from the public. The project will engage four target audiences (informal science education/ISE professionals, civic, community and scientist partners). Science museum partners include Museum of Science (MOS) Boston, Oregon Museum of Science, the Michigan Science Center, and the North Carolina Museum of Life and Science. The project is designed to have a strategic impact on how ISE institutions choose topics of STEM engagement and build public Forum programs.
There will be two evaluation teams for the project. MOS Research and Evaluation will act as formative evaluation mentors for the four partner sites as they co-create their forums. They will provide evaluation capacity building for the sites using team-based inquiry as they create and understand the potential impacts and outcomes of the model. Data collection will include panel surveys and focus groups. The evaluation will explore how the forums can decrease 1) public polarization around STEM topics and (2) the disconnect between scientists, civic organization, and the public. The external summative evaluation will be conducted by Rockman et al (REA). They will conduct a study of the project's process to help the team identify challenges and strategies for overcoming them as they work through the phases of public engagement. The summative study will focus on the project goals taking a qualitative approach. Early interviews with partner participants will explore their strengths and weaknesses in taking on this type of public engagement model including the extent of their previous work with civic partners. Later interviews will investigate what factors have enabled or hindered this project. Summative evaluation questions will also address changes in attitudes toward public engagement with science. REA will collect feedback from summit attendees through intercept interviews and post-surveys administered within a week at the event's conclusion to explore the any changes in knowledge or confidence in undertaking this type of model. REA will present findings from the external evaluation during the annual meeting of the Association of Science-Technology Centers and publish reports to Informalscience.org. Once the model has been developed and tested it will be disseminated to an initial group of 25-30 science museums and eventually to the entire ISE museum field.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.