As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop and test a model for audience assessment that STEM professionals can use during their public engagement efforts. These on-the-spot assessments will allow scientists to monitor audience understanding and use this to make immediate improvements to their activity. This project fills a critical gap in the field of public science communication as expressed by outreach scientists and by the professional and academic organizations that train them. Project partners include The Astronomical Society of the Pacific, Oregon State University, Pacific Science Center, and the National Radio Astronomy Observatory. Research questions include: (1) How and under what conditions can scientists, regardless of discipline, learn to build assessment into outreach activities? (2) To what degree are scientists willing and able to change their outreach activities to include assessment to ascertain audience attentiveness or understanding? (3) To what degree will scientists be able to adjust their outreach and engagement efforts based on audience feedback, and what support do they need to do so? (4) With constraints on their time and resources, how can the model help scientists conduct audience assessment on their own? (5) Are audience members finding events more enjoyable and fruitful that use assessment techniques? Several iterative rounds of R&D will be used in the spiral design-based approach. A group of Design Testers will start each of the iterative cycles for the initial development and testing techniques, associated training, and support. Later phases will use Field Testers using a rubric for usability, validity, and reliability of various strategies. The summative evaluation of the project will begin early and add data over the life of the project. A mixed methods approach will be used including surveys of scientists once each year after they have participated in the Prototype training. Descriptive and inferential statistics will be used to document the extent to which the project has achieved its intended outcomes. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop a collaborative program to connect and prepare researchers from divergent disciplines to communicate science to publics of all ages in three distinct informal environments: pop-ups at community events, experiential learning with problem solving events for youth, and presentations at a science museum. It will study the effects of this program on the identity and motivations of STEM researchers and evaluate the short and medium-term outcomes for public audiences. Project partners include, The STEAM Factory, OHI/O Informal Learning in Tech Program, and the Center of Science and Industry (COSI) all located in Columbus, Ohio.
The primary goals of this project are as follows. 1) Develop a collaborative program that connects and prepares researchers from divergent disciplines to creatively and effectively communicate science to people of all ages. 2) Evaluate the short and medium-term learning outcomes across different informal learning settings. 3) Study the effect of this collaborative program on the motivations and identify of the researchers. The specific research question is: In what ways do researchers motivations and identities further develop because of these collaborative experiences with divergent perspectives? A mixed method approach will be used. Data will be collected and analyzed from 3 cohorts of researchers who implement programs in different informal learning settings. A series of pre- and post interviews with scientists will be designed to answer the research question above. Interviews will be grounded in self-determination theory. Later reflective surveys will serve as triangulation for the data.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Sathya GopalakrishnanJustin MeyerRachel KajfezArnab Nandi
In June of 2017, the Exploratorium hosted the GENIAL Summit which brought together approximately 91 practitioners, community leaders, diversity-focused organization staff, researchers, and media/marketing specialists from across the country and Puerto Rico for a one and a half day gathering. The National Science Foundation (NSF) funded Summit focused on increasing Latino participation in Informal STEM Learning (ISL) environments by examining these five content strands identified by the GENIAL team:
1. Latino Audiences
2. Marketing, Communicating, and Media
3. Community Collaboration and
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will build and test a new model for co-created public engagement with science activities in partnership with civic, community, and scientist partners. The innovation to be tested is deliberative dialogues in science museums that help reduce the polarization about socio-scientific issues, giving people a greater voice in science, and addressing barriers that disconnect scientists from the public. The project will engage four target audiences (informal science education/ISE professionals, civic, community and scientist partners). Science museum partners include Museum of Science (MOS) Boston, Oregon Museum of Science, the Michigan Science Center, and the North Carolina Museum of Life and Science. The project is designed to have a strategic impact on how ISE institutions choose topics of STEM engagement and build public Forum programs.
There will be two evaluation teams for the project. MOS Research and Evaluation will act as formative evaluation mentors for the four partner sites as they co-create their forums. They will provide evaluation capacity building for the sites using team-based inquiry as they create and understand the potential impacts and outcomes of the model. Data collection will include panel surveys and focus groups. The evaluation will explore how the forums can decrease 1) public polarization around STEM topics and (2) the disconnect between scientists, civic organization, and the public. The external summative evaluation will be conducted by Rockman et al (REA). They will conduct a study of the project's process to help the team identify challenges and strategies for overcoming them as they work through the phases of public engagement. The summative study will focus on the project goals taking a qualitative approach. Early interviews with partner participants will explore their strengths and weaknesses in taking on this type of public engagement model including the extent of their previous work with civic partners. Later interviews will investigate what factors have enabled or hindered this project. Summative evaluation questions will also address changes in attitudes toward public engagement with science. REA will collect feedback from summit attendees through intercept interviews and post-surveys administered within a week at the event's conclusion to explore the any changes in knowledge or confidence in undertaking this type of model. REA will present findings from the external evaluation during the annual meeting of the Association of Science-Technology Centers and publish reports to Informalscience.org. Once the model has been developed and tested it will be disseminated to an initial group of 25-30 science museums and eventually to the entire ISE museum field.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Public engagement with science (PES) is about dialogue between scientific and technological experts and public audiences about societal questions that science can inform but not answer. In making decisions about these kinds of societal questions, social values and personal experience play roles equal to or greater than the one played by science. Rather than focusing exclusively on science itself, PES focuses on discussing problems that communities view as worth solving; the information society needs and wants from scientists; the potential risks, benefits, and consequences of new technologies
This position paper, co-authored Center for Childhood Creativity's Director Elizabeth Rood and Director of Research Helen Hadani, details the importance of exposing children ages 0-8 to science, technology, engineering, and math (STEM) experiences. The review of more than 150 empirical studies led Rood and Hadani to conclude that, despite what has been previously thought, modern research supports the understanding that children are capable of abstract thinking and STEM-learning from infancy, beginning before their first birthday.
The Roots of STEM Success, authored in support of classroom
DATE:
TEAM MEMBERS:
Helen Shwe HadaniElizabeth RoodAmy EisenmannRuthe FousheeGarrett JaegerGina JaegerJoanna KauffmannKatie KennedyLisa Regalla
This report presents the findings from the summative evaluation of the Multi-Site Public Engagement with Science project (MSPES), funded by an NSF AISL award. MSPES aimed to bring together public audiences and professional scientists through “Building with Biology” programming - public events and forums centered on the topic of synthetic biology. The goal was to promote meaningful, two-way dialogs around this area of science, which is rapidly advancing and raising interesting social and ethical questions. The project team sought to move beyond a traditional "public understanding of science"
This 4-year project addresses fundamental equity issues in informal Science, Technology, Engineering and Mathematics (STEM) learning. Access to, and opportunities within informal STEM learning (ISL) remain limited for youth from historically underrepresented backgrounds in both the United States and the United Kingdom. However, there is evidence that ISL experiences can expand opportunities for youth learning and development in STEM, for instance, increase positive attitudes towards educational aspirations and future careers/pursuits, improve grades and test scores in school settings, and decrease disciplinary action and dropout rates. Through research and development, this project brings together researchers and practitioners to focus on the experiences, practices and tools that will support equitable youth pathways into STEM. Working across conceptual frameworks and ISL settings (e.g. science centers, community groups, zoos) and universities in four urban contexts in two different nations, the partnership will produce a coherent knowledge base that strengthens and expands research plus practice partnerships, builds capacity towards transformative research and development, and develops new models and tools in support of equitable pathways into STEM at a global level. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments and to broaden access to and engagement in STEM learning experiences.
This Equity Pathways project responds to three challenges at the intersections of ISL research and practice in the United States and the United Kingdom: 1) lack of shared understanding of how youth from historically underrepresented backgrounds perceive and experience ISL opportunities across national contexts, and the practices and tools needed to support empowered movement through ISL; 2) limited shared understanding and evidence of core high-leverage practices that support such youth in progressing within and across ISL, and 3) limited understanding of how ISL might be equitable and transformative for such youth seeking to develop their own pathways into STEM. The major goal of this Partnership is for practitioners and researchers, working with youth through design-based implementation research, survey and critical ethnography, to develop new understandings of how and under what conditions they participate in ISL over time and across settings, and how they may connect these experiences towards pathways into STEM. The project will result in: 1) New understandings of ISL pathways that are equitable and transformative for youth from historically underrepresented backgrounds; 2) A set of high leverage practices and tools that support equitable and transformative informal science learning pathways (and the agency youth need to make their way through them); and 3) Strengthened and increased professional capacity to broaden participation among youth from historically underrepresented backgrounds in STEM through informal science learning. The project will be carried out by research + practice partnerships in 4 cities: London & Bristol, UK and Lansing, MI & Portland, OR, US, involving university researchers (University College London, Michigan State University, Oregon State University/Institute for Learning Innovation) practitioners in science museums (@Bristol Science Centre, Brent Lodge Park Animal Centre, Impressions 5, Oregon Museum of Science & Industry) and community-based centers (STEMettes, Knowle West Media Centre, Boys & Girls Clubs of Lansing, and Girls, Inc. of the Pacific Northwest).
By engaging diverse publics in immersive and deliberative learning forums, this three-year project will use NOAA data and expertise to strengthen community resilience and decision-making around a variety of climate and weather-related hazards across the United States. Led by Arizona State University’s Consortium for Science, Policy & Outcomes and the Museum of Science Boston, the project will develop citizen forums hosted by regional science centers to create a new, replicable model for learning and engagement. These forums, to be hosted initially in Boston and Phoenix and then expanded to an additional six sites around the U.S., will facilitate public deliberation on real-world issues of concern to local communities, including rising sea levels, extreme precipitation, heat waves, and drought. The forums will identify and clarify citizen values and perspectives while creating stakeholder networks in support of local resilience measures. The forum materials developed in collaboration with NOAA will foster better understanding of environmental changes and best practices for improving community resiliency, and will create a suite of materials and case studies adaptable for use by science centers, teachers, and students. With regional science centers bringing together the public, scientific experts, and local officials, the project will create resilience-centered partnerships and a framework for learning and engagement that can be replicated nationwide.
Over three years beginning in January 2016, the Science Museum of Virginia will launch a new suite of public programming entitled “Learn, Prepare, Act – Resilient Citizens Make Resilient Communities.” This project will leverage federally funded investments at the Museum, including a NOAA-funded Science On a Sphere® platform, National Fish and Wildlife-funded Rainkeepers exhibition, and the Department of Energy-funded EcoLab, to develop public programming and digital media messaging to help the general public understand climate change and its impacts on Virginia’s communities and give them tools to become resilient to its effects. Home to both the delicate Chesapeake Bay ecosystem and a highly vulnerable national shoreline, Virginia is extremely susceptible to the effects of climate change and extreme weather events. It is vital that citizens across the Commonwealth understand and recognize the current and future impacts that climate variability will have on Virginia’s economy, natural environment, and human health so that they will be better prepared to respond. In collaboration with NOAA Chesapeake Bay Office, George Mason University’s Center for Climate Change Communication, Virginia Institute for Marine Science, Public Broadcasting Service/National Public Radio affiliates, and Resilient Virginia, the Museum will use data from the National Climatic Data Center and Virginia Coastal Geospatial and Educational Mapping System to develop and deliver new resiliency-themed programming. This will include presentations for Science On a Sphere® and large format digital Dome theaters, 36 audio and video digital media broadcast pieces, two lecture series, community preparedness events, and a Resiliency Checklist and Certification program. This project supports NOAA’s mission goals to advance environmental literacy and share its vast knowledge and data with others.
The Museum of Science and Industry, Chicago (MSI) will develop museum-based education resources to engage high school age youth in the exploration of climate literacy and Earth systems science through its Teen ACES (Teen Advocates for Community and Environmental Sustainability) project. As the future leaders who will make decisions about the issues they face in their communities, youth participants will be positioned to act as advocates for establishing resilient communities in the Midwest. The project will utilize a variety of resources, including NOAA Science On a Sphere® (SOS) technology and datasets, Great Lakes and local climate assets from the Midwest Regional Climate Center and Illinois-Indiana Sea Grant, and existing local planning guides to develop museum-based youth programming. Teens will explore environmental hazards including severe weather events and temperature extremes, and consider the impact of the Great Lakes on regional climate. The Chicago Metropolitan Agency for Planning, Resilient Chicago, the Institute of Environmental Sustainability at Loyola University Chicago, and the South Metropolitan Higher Education Consortium will advise on the project to support the integration of municipal resiliency plans and their related adaptation and mitigation measures into the program. Teen participants will share their learning with the Chicago community through interactions with public visitors in the Museum, programs at Chicago Public Library branches, and MSI’s teen science program broadcast on Chicago’s public access TV station. Teen facilitated experiences will be tailored for SOS® experiences at MSI. The project will revise content for use in 100 after-school science clubs for students from diverse communities across the Chicago area. Further dissemination to three regional science center partners equipped with SOS® technology (Boonshoft Museum of Discovery in Dayton, Ohio; Science Central in Fort Wayne, Indiana; and Hawthorn Hollow in Kenosha, Wisconsin) will build a foundation of knowledge and resources to adapt materials to meet the needs of their communities and consider how their vulnerabilities and resiliency plans may differ from Chicago.
Co-led by the University of Washington and Science Gallery Dublin, this project aims to drive and transform the next generation of broadening participation efforts targeting teen-aged youth from communities historically underrepresented in STEM fields. This project investigates how out-of-school time (OST) programs that integrate epistemic practices of the arts, sciences, computer science, and other disciplines, in the context of consequential activities (such as creating radio segments, designing museum exhibitions, or building online games), can more broadly appeal to and engage youth who do not already identify as STEM learners. STEM-related skills and capacities (such as computational thinking, design, data visualizations, and digital storytelling) are key to productive and creative participation in many future civic and workplace activities, and are driving the 30 fastest-growing occupations in the US. But many new jobs will entail a hybrid blend of skills, such as programming and design skills that many students who have disengaged with academic STEM pathways may already have and would be eager to develop further. There is not currently a strong foundation of research-based evidence to guide the design, implementation, and evaluation transdisciplinary programs - in which STEM skills are embedded as tools for meaningful participation - or how such approaches relate to long-term outcomes. Hypothesizing that OST programs which effectively engage youth during their high-leverage teenage years can significantly impact youths' longer-term STEM learning trajectories, this project will involve: 1) Five 3-year studies documenting learning in different technology-rich contexts: Making Afterschool, Media Production, Museum Exhibition Design, Digital Arts Programs, and Pop-Up/Street Science Programs; 2) A 4-year longitudinal study, involving 100 youth from the above programs; 3) The creation of a number of practical measurement tools that can be used to monitor how programs are leveraging the intersections of the arts and sciences to support student engagement and learning; and 4) A Professional Development program conducted at informal science education conferences in the EU and US to engage the informal STEM field with emerging findings. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences to better understand, strengthen, and coordinate STEM engagement and learning. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments.
Transdisciplinary, equity-oriented OST programs can provide supportive social contexts in which STEM concepts and practices are taken up as the means for meaningful participation in valued activities, building students' STEM skills in ways that can propel their future academic, career, and lifelong learning choices. This project will build the knowledge base about these emerging 21st century transdisciplinary approaches to broadening participation investigating: 1) The epistemic intersections across a range of disciplines (art, science, computation, design) that operate to broaden appeal and meaningful participation for underrepresented youth; 2) How transdisciplinary activities undertaken in the context of consequential learning (e.g., producing a radio segment, designing an exhibition for the general public) can illuminate the relevance of STEM to young people's lives, concerns, and futures; and 3) How participation in such programs can propel students' longer-term life choices and STEM learning trajectories. The project is a collaboration of the University of Washington, Science Gallery Dublin, Indiana University, Youth Radio in Oakland California, Guerilla Science in New York and London, and the London School of Economics.