Skip to main content

Community Repository Search Results

resource evaluation Public Programs
In June of 2017, the Exploratorium hosted the GENIAL Summit which brought together approximately 91 practitioners, community leaders, diversity-focused organization staff, researchers, and media/marketing specialists from across the country and Puerto Rico for a one and a half day gathering. The National Science Foundation (NSF) funded Summit focused on increasing Latino participation in Informal STEM Learning (ISL) environments by examining these five content strands identified by the GENIAL team: 1. Latino Audiences 2. Marketing, Communicating, and Media 3. Community Collaboration and
DATE:
TEAM MEMBERS: Wendy Meluch
resource project Public Programs
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This exploratory Pilot study project brings together a diverse set of partners that include the Watertown Children's Theatre (WCT) which is west of Boston, and, from Boston College a team of science educators, learning science researchers, and positive youth development experts. The goal is to design and develop a project for middle school-aged youth. The pilot project, which integrates hands-on science learning experiences, experiments, and field trips with the student-led production of short plays, will engage youth in expressing their beliefs, passions, and their own identities about STEM by examining how the intersection of skills and practices used in both domains (science and theatre) can enable them to learn about science concepts, principles and methods as well as to develop science-focused identities. Middle-school youth will be engaged in a three-week summer program where they will be led by science teachers, playwrights, and high school students to conduct hands-on investigations in science in conjunction with developing original, ten-minute plays around a specific scientific theme relevant to their life experience, for example, the potential impact on their lives of heavy metals in water and poor air quality. After a science theme is chosen, the principal investigators will identify the big ideas that are important for youth to understand and be able to explain. Upon identification of the key science ideas, youth will then engage in pertinent science activities, visits to local sites, reading current news articles and then in identifying the local impacts and how the underlying science relates to those local impacts. The youth will perform their ten-minute plays at the end of the summer program. Following this showcase event, they will engage in additional science learning experiences and also revise their productions throughout the academic year in preparation for a youth science festival, where their creations will be performed by professional adult actors as a part of the Cambridge Science Festival taking place in the spring. The broader impact of the work focuses on broadening participation in STEM, specifically, the engagement of youth from under-represented populations in the sciences, such as African-Americans, Latinxs, and women with partner Boston Public Schools. The Pilot study will investigate the student learning and organizational dimensions of the model being developed.

The Boston College researchers will study youth's sense of purpose and identity toward science, particularly how youth's identity discrepancy changes through participation in the project. The work places youth voice at the center of the creation of STEM-based theatre plays. The theoretical foundation of the work is grounded in part in the concept of "path to purpose." The major research questions are: How do youth perceptions (interest, science anxiety, identity) toward science shift as they participate in the project? What is the residual impact on parents (family members) and youth on their discussions about science, and how does participation in the project impact those discussions? Research methods include surveys, interviews and observations. The external evaluation study will focus on understanding project implementation and progress toward meeting the project goals, in particular, how well the initiative works to establish a model for the informal STEM learning field that the team and others can apply beyond the Pilot study.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Meghan Hill
resource project Professional Development, Conferences, and Networks
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is a two-day conference, along with pre- and post-conference activities, with the goal of furthering the informal science learning field's review of the research and development that has been conducted on data visualizations that have been used to help the public better understand and become more engaged in science. The project will address an urgent need in informal science education, providing a critical first step towards a synthesis of research and technology development in visualization and, thus, to inform and accelerate work in the field in this significant and rapidly changing domain.

The project will start with a Delphi study by the project evaluator prior to the conference to provide an Emerging Field Assessment on data visualization work to date. Then, a two-day conference at the Exploratorium in San Francisco and related activities will bring together AISL-funded PIs, computer scientists, cognitive scientists, designers, and technology developers to (a) synthesize work to date, (b) bring in relevant research from fields outside of informal learning, and (c) identify remaining knowledge gaps for further research and development. The project team will also develop a website with videos of all presentations, conference documentation, resources, and links to social media communities; and a post-conference publication mapping the state of the field, key findings, and promising technologies.

The initiative also has a goal to broaden participation, as the attendees will include a diverse cadre of professionals in the field who contribute to data visualization work.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
resource project Public Programs
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for STEM learning in a variety of settings. Many military veterans who seek to transition to higher education or workforce pathways find it challenging to translate the skills they acquired during service to civilian STEM settings and the modern day workforce. Yet many returning veterans have significant experience with STEM fields, including mapping and geospatial technologies, because of their unique functions and service assignments. Such geospatial skills are useful for location-aware industries, citizen science and public services. At the same time, military and veteran families have been largely overlooked as an important public audience for focused informal STEM learning. Informal learning events called "mapathons" which enlists participants to mapping exercises and create geospatial data on open platforms that address authentic needs in their communities and the broader society at large. When seeking to further their education upon returning from service, veterans' typical options have included some form of formal higher education. Mapathons may be a feasible bridging activity that (a) recognizes veterans' unique, valuable, and in-demand STEM skills and (b) supports lifelong learning.

This pilot research seeks to understand how informal learning experiences such as mapathons are viable pathways for veterans to transition to the civilian workforce. The conceptual approach pays attention to the realities of the life course of military and veteran families, especially building upon theories of change related to transitions to include a spatial component. The foundation of the project's intellectual merit is its explicit inclusion and sensitivity to place, scale, and spatial behavior, building directly from findings of prior NSF-funded projects and the evidence base for informal learning pathways. The research will contribute to knowledge about workforce development by addressing the questions: (1) To what extent do veterans recognize that their extant skills acquired, in military settings, are translatable to civilian STEM settings?; (2) How can informal learning experiences help a diverse veteran population increase awareness of the translatability of geospatial workforce competencies, build confidence in technology skills, and motivate interest to pursue formal studies in STEM fields in general?; and (3) What pathways do which veterans favor when they could pursue formal STEM higher education learning among an array of choices online or at regional sites, and why? The study will engage 320 participants at 8 sites across Texas; employ in-depth surveys and interviews; and use spatial analysis to elicit insights about the research questions.

Military and veteran families include a significant number of people from group typically underrepresented in STEM fields. Supporting more veterans to transition successfully to higher education pathways or careers in STEM is a vital service to the nation. This study on informal to formal pathways for veterans will include an innovative understanding of the importance of place in meaning-making and in the reality of choices they consider during the transitions of their life course.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Patricia Solis Melanie Hart Dennis Patterson
resource project Exhibitions
With snow providing water for about 2 billion people worldwide and playing a major role in the Earth's climate through its high albedo and insulation properties, on-going alterations in global snow resources pose real and extremely expensive societal adaptation/mitigation problems. The project goals are to:


Create opportunities for the public to learn about the vital role that snow plays in climate, water resources, and human lives.
Produce a better understanding of how culture affects informal Science, Technology, Engineering, Mathematics (STEM) learning.


The deliverables include:


An outreach program in Alaska that will visit 33 remote native villages;
A 2,000 square foot traveling exhibition on snow produced by the Oregon Museum of Science and Industry (OMSI) and exhibited at two additional museums during the life of the award;
Learning research, which will examine how the wide variation of cultural relationships to snow impacts learning in museum exhibitions. Each of these components will be evaluated over the course of the project. The travelling exhibition will tour to three museums per year for eight years, with an anticipated cumulative audience of over one million.


The focus on snow will highlight a fascinating yet under-appreciated part of the Earth system. The project aims to educate the public about snow and to produce a more informed and thoughtful public in the face of potential expensive and difficult snow-related societal decisions. Through informative displays, graphics, models, and other material, the project will engage traditionally under-served communities (at Native/remote villages) in Alaska, where a strong cultural connection to snow exists, as well as communities across the U.S. where the connection to snow can range from strong to weak. Across this cultural gradient, the project will explore through oral interviews and surveys the public response to various types and designs of informal science learning (ISL) displays, attempting to isolate and control for the effect of cultural vs. individual response to the materials. Informal learning theory specifies using front-end exploration of individual visitor-content relationships to guide exhibit design. This project's research goal expands that approach to include the effects of cultural engagement with a topic to develop more general tools to guide and improve the design process. The project is led by the University of Alaska Fairbanks (UAF) in collaboration with OMSI researchers from the COSI (Center of Science and Industry), Center for Research and Evaluation (CRE), and evaluators at the Goldstream Group. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project has co-funding support from the Office of Polar Programs.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Victoria Coats Matthew Sturm Deborah Wasserman
resource research Informal/Formal Connections
Scientists (and engineers) wishing to conduct public engagement do so in the context of established disciplinary norms and complex institutional systems that may support or limit their success. This report seeks to convey the known complexity, unique challenges, and opportunities for universities to better support for scientists in their public engagement work. The report is intended to drive discussion towards deeper exploration and development of actionable next steps. This is the executive summary of report from Workshop III: Academic Institutions, part of the Support Systems for
DATE:
TEAM MEMBERS: Julie Risien Roberta Nilson
resource project Media and Technology
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This RAPID project was submitted in response to the NSF Dear Colleague letter (NSF 17-128) related to Hurricane Harvey along the Gulf Coast. The PBS NewsHour team will produce 9 stories for national distribution using multiple broadcast and online channels that will engage the public and increase their understanding of the science and engineering research being conducted to better predict and mitigate the impact of future storms. Hurricane Harvey was the first of several storms in 2017 that hit first Texas then Florida and the Caribbean creating unprecedented devastation. This project aims to help the public better understand the science behind storms, and how scientists and engineers are actively collecting data, developing new models, using new technologies, and studying the environmental recovery. The PBS NewsHour team has in place experienced science journalists, production facilities, and a distribution network that can quickly develop media stories based on the work of scientists and engineers in the field, many of whom are funded by NSF. The NewsHour has a strong track record of telling stories that are scientifically accurate yet highly engaging and understandable to a diverse audience. Researchers from several universities including Texas A&M, Rice University, and Norfolk State University are advising the NewsHour team and may also be featured in some of the media. The team will also use their existing collaboration with education researchers at New Knowledge, Inc. to seek audience feedback on proposed/produced media.

The potential audience reach of these stories is extensive. Stories that are broadcast on the nightly PBS NewsHour reach 1.6 million people. The NewsHour's website currently reaches 6 million while their YouTube channel has 40 million views. They have a growing audience of younger viewers who mainly get their news on social media channels such as ScienceScope and Apple News. EXTRA is another service offered just for teachers.
DATE: -
TEAM MEMBERS: Patti Parson
resource evaluation Public Programs
This set of appendices represent all research instruments related to study presented in the I/CaLL Art Experiences and Advancing Science Literacy report (NewKnowledge Publication #NSF.097.115.07). Appendix A: Installation Site Intercept Interview Instrument Appendix B: Artists-Scientists Walk & Talks Instrument Appendix C: Post-Performance Event Survey Instrument Note that researchers did not use an instrument for the fourth aspect of the study, the post-performance event reflection sessions. Instead, they allowed the discussions to be directed by the reflection participants.
DATE:
TEAM MEMBERS: John Fraser Rebecca Joy Norlander Sophie Swanson Nezam Ardalan Kate Flinner Joanna Laursen Brucker Nicole LaMarca
resource project Exhibitions
Engagement is the cornerstone of learning in informal science education. During free-choice learning in museums and science centers, visitor engagement shapes how learners interact with exhibits, navigate through exhibit spaces, and form attitudes, interests, and understanding of science. Recent advances in multimodal learning analytics are creating novel opportunities for expanding the range and richness of measures of visitor engagement in free-choice settings. In particular, multimodal learning analytics offer significant potential for integrating multiple data sources to devise a composite picture of visitors' cognitive, affective, and behavioral engagement. The project will center on providing a rich empirical account of meaningful visitor engagement with interactive tabletop science exhibits among individual visitors and small groups, as well as uncovering broader tidal patterns in visitor engagement that unfold across exhibit spaces. A key objective of the project is creating models and practitioner-focused learning analytic tools that will inform the best practices of exhibit designers and museum educators. This project is funded by the Advancing Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, AISL funds research and innovative approaches and resources for use in a variety of settings. The research team will conduct data-rich investigations of visitors' learning experiences with multimodal learning analytics that fuse the rich multichannel data streams produced by fully-instrumented exhibit spaces with the data-driven modeling functionalities afforded by recent advances in machine learning and educational data mining. The research team will conduct a series of visitor studies of naturalistic engagement in solo, dyad, and group interactions as visitors explore interactive tabletop science exhibits. The studies will utilize eye trackers to capture visitors' moment-to-moment attention, facial expression analysis and quantitative field observations to track visitors' emotional states, trace logs generated by exhibit software, as well as motion-tracking sensors and coded video recordings to capture visitors' behavioral interactions. The studies will also use conversation recordings and pre-post assessment measures to capture visitors' science understanding and inquiry processes. With these multimodal data streams as training data, the research team will use probabilistic and neural machine learning techniques to devise learning analytic models of visitor engagement. The project will be conducted by a partnership between North Carolina State University and the North Carolina Museum of Natural Sciences. The research team will 1) design a data-rich multimodal visitor study methodology, 2) create the Visitor Informatics Platform, a suite of open source software tools for multimodal visitor analytics, and 3) launch the Multimodal Visitor Data Warehouse, a curated visitor experience data archive. Together, the multimodal visitor study methodology, the Visitor Informatics Platform, and the Multimodal Visitor Data Warehouse will enable researchers and practitioners in the informal science education community to utilize multimodal learning analytics in their own informal learning environments. It is anticipated that the project will advance the field of informal STEM learning by extending and enriching measures of meaningful visitor engagement, expanding the evidence base for visitor experience design principles, and providing learning analytic tools to support museum educators. By enhancing understanding of the cognitive, affective, and behavioral dynamics underlying visitor experiences in science museums, informal science educators will be well-positioned to design learning experiences that are more effective and engaging. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: James Lester James Minogue Jonathan Rowe North Carolina Museum of Natural Sciences
resource research Public Programs
Scientists are increasingly being called upon to play a more prominent role in the interface of science and society by contributing to science literacy in ways that support two-way exchanges with the public. However, many remain reluctant to participate in public engagement activities in part because they feel they lack relevant skills and experience. We surveyed scientists trained on engagement through a nationwide program called Portal to the Public and examined how participation in the program may have influenced their self-efficacy, commitment and attitudes about outreach, and perceived
DATE:
resource research Media and Technology
This research brief highlights findings from the proof of concept pilot year of the Child Trends News Service project. It explores what we have learned regarding best practices for communicating with and engaging Latino parents through short messages on research-informed parenting practices. The findings are grounded in research that substantiates the need to amplify access to child development research, particularly among low-income Latino families; and in communication science research that demonstrates the value of the news media as an information source for child development research.
DATE:
TEAM MEMBERS: Alicia Torres Selma Caal Luz Guerra Angela Rojas
resource research Public Programs
European Researchers’ Night is an annual pan-European initiative of the European Commission held on the last Friday in September. In 2015, 1.1 million European citizens and 18,000 researchers took part in events organised in more than 300 cities within Europe and neighbouring countries. The objective of European Researchers’ Night is to encourage the wider public to visit research institutes, engage with researchers, and learn more about European research and potential career opportunities. In this paper, European Researchers’ Night in Ireland is considered through the lens of informal
DATE:
TEAM MEMBERS: Joseph Roche Nicola Davis Mark Chaikovsky Shaun O'Boyle Cliona O’Farrelly