In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This study collected data from seven planetarium email lists (one per planetarium regional organization in the United States), as well as online survey panel data from residents in each area, to describe and compare those who do and do not visit planetariums.
This white paper examined the process of evaluating a new Growth Mindset youth program developed for youth in Grades 3-5 in the Northwest suburb communities in Dundee Township, IL.
DATE:
TEAM MEMBERS:
Luci HanstedtDrew Glassford Mike LoPrestiMallory NamoffRobert Tai
Informal STEM learning experiences (ISLEs), such as participating in science, computing, and engineering clubs and camps, have been associated with the development of youth’s science, technology, engineering, and mathematics interests and career aspirations. However, research on ISLEs predominantly focuses on institutional settings such as museums and science centers, which are often discursively inaccessible to youth who identify with minoritized demographic groups. Using latent class analysis, we identify five general profiles (i.e., classes) of childhood participation in ISLEs from data
DATE:
TEAM MEMBERS:
Remy DouHeidi CianZahra HazariPhilip SadlerGerhard Sonnert
Milwaukee has established itself as a leader in water management and technology, hosting a widely recognized cluster of industrial, governmental, nonprofit, and academic activity focused on freshwater. At the same time, Milwaukee faces a wide range of challenges with freshwater, some unique to the region and others common to cities throughout the country. These challenges include vulnerability to flooding and combined sewer overflows after heavy rainfall, biological and pharmaceutical contamination in surface water, lead in drinking water infrastructure, and inequity in access to beaches and other recreational water amenities. Like other cities, Milwaukee grapples with the challenges global climate change imposes on urban water systems, including changing patterns of precipitation and drought.
These problems are further complicated by Milwaukee's acute racial and economic residential segregation. With a population of approximately 595,000, embedded within a metropolitan area of over 1.5 million, Milwaukee remains one of the country's most segregated cities. There is increasing urgency to engage the public--and especially those who are most vulnerable to environmental impacts--more deeply in the stewardship of urban water and in the task of creating sustainable urban futures. The primary goal of this four-year project is to foster community-engaged learning and environmental stewardship by developing a framework that integrates art with Science, Technology, Engineering, and Mathematics (STEM) experiences along with geography, water management, and social science. Synergies between STEM learning and the arts suggest that collaborations among artists, scientists, and communities can open ways to bring informal learning about the science of sustainability to communities.
WaterMarks provides an artist generated conceptual framework developed by Mary Miss / City as Living Laboratory (CALL) to help people better understand their relationship to the water systems and infrastructure that support their lives. Project activities include artist/scientist/community member-led Walks, which are designed to engage intergenerational participants both from the neighborhoods and from across the city, in considering the conditions, characteristics, histories, and ecosystems of neighborhoods. Walks are expanded upon in Workshops with residents, local scientists/experts, and other stakeholders, and include exploring current water-related environmental challenges and proposing solutions. The Workshops draw on diverse perspectives, including lived experience, scientific knowledge, and policy expertise. Art projects created by local artists amplify community engagement with the topics, including programming for teens and young adults. Free Wi-Fi will be integrated into various Marker sites around the city providing access to online, self-guided learning opportunities exploring the water systems and issues facing surrounding neighborhoods. Current programming focuses primarily on Milwaukee's predominantly African American near North Side and the predominantly Latinx/Hispanic near South Side. Many neighborhoods in these sections are vulnerable to such problems as frequent flooding, lead contamination in drinking water, inequities in safety and maintenance of green space, and less access to Lake Michigan, the city's primary natural resource and recreational amenity.
The WaterMarks project advances informal STEM learning in at least two ways. First, while the WaterMarks project is designed to fit Milwaukee, the project includes the development of an Adaptable Model Guide. The Guide is designed so that other cities can modify and employ its inclusive structure, programming, and process of collaboration among artists, scientists, partner organizations, and residents to promote citywide civic engagement in urban sustainability through the combination of informal STEM learning and public art. The Guide will be developed by a Community-University Working Group (CULab) hosted by UW-Milwaukee's Center for Community-Based Learning, Leadership, and Research and made up of diverse community and campus-wide stakeholders. In addition to overseeing the Guide’s creation, CULab will conceptualize onboarding and mentorship strategies for new participants as well as a framework for the program’s expansion and sustainability.
Second, through evaluation and research, the project will build a theoretical model for the relationships among science learning, engagement with the arts, and the distinctive contexts of different neighborhoods within an urban social-ecological system. The evaluation team, COSI’s Center for Research and Evaluation, and led by Co-PI Donnelly Hayde, aims to conduct formative, summative, and process evaluation of the Watermarks project, with the additional goal of producing evaluative research findings that can contribute to the broader field of informal learning. Evaluation foci include: How does the implementation of WaterMarks support positive outcomes for the project’s communities and the development of an adaptable model for city-scale informal science learning about urban environments? 2. To what extent do the type and degree of outcome-related change experienced by participating community residents vary across and/or between project sites? What factors, if any, appear to be linked to these changes? 3. To what extent and in what ways do the activities of the WaterMarks projects appear to have in situ effects related to the experience of place at project sites?
The project’s research team led by PI Ryan Holifield and Co-PI Woonsup Choi, will investigate how visual artistic activities introduced by the programming team as part of the Walks (and potentially other engagement activities) interact with personal, sociocultural, and physical contexts to produce distinctive experiences and outcomes of informal science learning about urban water systems. The aim of the research will be to synthesize the results from the different WaterMarks sites into an analysis generalizable beyond specific neighborhoods and applicable to other cities. The project's research questions include: 1. How does participation in Walks focused on visual artistic activities affect outcomes and experiences of informal STEM learning about urban water systems? 2. How do outcomes and experiences of informal STEM learning vary across different urban water topics, participants from different demographic groups, and contrasting sociocultural and biophysical contexts?
This Innovations in Development project is led by the University of Wisconsin-Milwaukee (UWM), in collaboration with City as Living Laboratory (CALL) and the COSI Center for Research and Evaluation.
The New Jersey Historical Commission (NJHC) initiated the Understanding Communities Study with the goal to better understand how New Jersey history and history organizations can be more inclusive for all. NJHC contracted RK&A for the first phase of the study to conduct focus groups with members of Hispanic and Latino communities in New Jersey. NJHC plans to expand the study to other communities in the future. The New Jersey Center for Hispanic Policy, Research and Development served as advisors in the project.
With support from NJHC partners, RK&A conducted three focus groups with
This project supports the Broader Impacts and Outreach Network for Institutional Collaboration (BIONIC), a national Research Coordination Network of Broader Impacts to support professionals who assist researchers to design, implement, and evaluate the Broader Impacts activities for NSF proposals and awards. All NSF proposals are evaluated not only on the Intellectual Merit of the proposed research, but also on the Broader Impacts of the proposed work, such as societal relevance, educational outreach, and community engagement. Many institutions have begun employing Broader Impacts support professionals, but in most cases, these individuals have not worked as a group to identify and share best practices. As a consequence, there has been much duplication of effort. Through coordination, BIONIC is expected to improve efficiency, reduce redundancy, and have significant impact in several areas: 1) Researchers will benefit from an increased understanding of the Broader Impacts merit review criterion and increased access to collaborators who can help them design, implement, and evaluate their Broader Impacts activities; 2) Institutions and research centers will increase their capacity to support Broader Impacts via mentoring for Broader Impacts professionals and consulting on how to build Broader Impacts support infrastructure, with attention to inclusion of non-research-intensive universities, Historically Black Colleges and Universities, and Hispanic- and Minority-Serving Institutions that may not have the resources to support an institutional Broader Impacts office; and 3) NSF, itself, will benefit from a systematic and consistent approach to Broader Impacts that will lead to better fulfillment of the Broader Impacts criterion by researchers, better evaluation of Broader Impacts activities by reviewers and program officers, and a system for evaluating the effectiveness of Broader Impacts activities in the aggregate, as mandated by Congress and the National Science Board. Through its many planned activities, BIONIC will ultimately help advance the societal aims that the Broader Impacts merit review criterion was meant to achieve.
The main goals of the project will be accomplished through the four specific objectives: 1) Identify and curate promising models, practices, and evaluation methods for the Broader Impacts community; 2) Expand engagement in, and support the development of, high-quality Broader Impacts activities by educating current and future faculty and researchers on effective practices; 3) Develop the human resources necessary for sustained growth and increased diversity of the Broader Impacts community; and 4) Promote cross-institutional collaboration and dissemination for Broader Impacts programs, practices, models, materials, and resources. BIONIC will facilitate collaborative Broader Impacts work across institutions, help leverage previously developed resources, support professional development, and train new colleagues to enter into the Broader Impacts field. This project will improve the quality and sustainability of Broader Impacts investments, as researchers continue to create unique and effective activities that are curated and broadly disseminated. BIONIC will create a network designed to assist NSF-funded researchers at their institutions in achieving the goals of the Broader Impacts Review Criterion. In so doing, BIONIC will promote Broader Impacts activities locally, nationally, and internationally and help to advance the Broader Impacts field.
This award is co-funded by the Divisions of Molecular and Cellular Biosciences and Emerging Frontiers in the Directorate for Biological Sciences and by the Division of Chemistry in the Directorate for Mathematics and Physical Sciences.
In June of 2017, the Exploratorium hosted the GENIAL Summit which brought together approximately 91 practitioners, community leaders, diversity-focused organization staff, researchers, and media/marketing specialists from across the country and Puerto Rico for a one and a half day gathering. The National Science Foundation (NSF) funded Summit focused on increasing Latino participation in Informal STEM Learning (ISL) environments by examining these five content strands identified by the GENIAL team:
1. Latino Audiences
2. Marketing, Communicating, and Media
3. Community Collaboration and
The purpose of this study is to thoroughly describe a program designed to strengthen the pipeline of Latino students into post-secondary science, technology, engineering, and mathematics (STEM) education, and present evaluation data to assess multiyear effectiveness. The program includes a suite of interventions aimed at students and families, and was implemented in a low-income school cluster with a high Latino population in metro Atlanta. Our intervention includes a high school and middle school mentoring program, STEM-focused extracurricular activities (summer camps, research and community
DATE:
TEAM MEMBERS:
Diley HernandezMarion UsselmanShaheen RanaMeltem AlemdarAnalia Rao
resourceresearchProfessional Development, Conferences, and Networks
In our efforts to sustain U.S. productivity and economic strength, underrepresented minorities (URM) (for the purpose of this paper defined as persons of African American, Hispanic American, and Native American racial/ethnic descent), provide an untapped reservoir of talent that could be used to fill technical jobs. Over the past 25 years, educational diversity programs have encouraged and supported URM pursuing STEM degrees. Yet, their representation in STEM still lags far behind that of White, non-Hispanic men.
To understand the reasons why this is occurring, the American Association for
DATE:
TEAM MEMBERS:
Yolanda S. GeorgeVirginia Van HorneShirley M. Malcom