IMPACT NC is a collaboration between the North Carolina science centers and museums and NC State University (NCSU) to build and foster a Community of Practice (CoP) for collective evaluation among the 54 partner organizations across the state of North Carolina. Funded by IMLS Museum Leadership Grant (MG-70-19-0019-19).
The goals of IMPACT NC are:
Identification of a set of shared goals for informal science education across the state.
Development of metrics to assess these goals.
Enhanced capacity of the Community of Practice of science museums to conduct evaluation centered on these collective evaluation goals and metrics.
Improved cohesion among science museums and other partners in NC (e.g. university collaborators, non-profit organizations) as they collectively work toward shared goals.
Development of a system for reporting program outcomes using shared metrics that is integrated into annual reporting or grant proposal processes across NC, thereby informing decision making.
NASA@ My Library is made possible through the support of the National Aeronautics and Space Administration (NASA) Science Mission Directorate as part of its Science Activation program. The project is led by the National Center for Interactive Learning (NCIL) at the Space Science Institute (SSI) in partnership with the American Library Association (ALA) Public Programs Office, Lunar and Planetary Institute (LPI), and Education Development Center (EDC). From 2016-2020, 78 public libraries (75 partner libraries and 3 pilot libraries), 18 State Library Agencies, 6 Portal to the Public Network sites, and 30 NASA-funded scientists participated in the project. More than 225,000 library patrons were reached through their efforts.
In 2021-2022, public libraries, universities, and state library agencies will participate in the project to increase and enhance STEAM learning opportunities in their communities, with an emphasis on reaching audiences underrepresented in STEM education and professions.
Across the United States, individuals, organizations, and communities are wrestling with a wide array of challenging and persistent science, technology, engineering, and mathematics (STEM)-related problems. A few examples include ensuring more equitable access to STEM careers; building capacity for rural libraries to support STEM learning; and supporting greater cyber literacy among youth. The good news is that thousands of individuals, organizations, and communities are coming up with great ideas for how to confront these problems; many of them supported by the NSF. Unfortunately, most will encounter significant roadblocks to success along the way, but not because of bad ideas. Most change agents falter along the lengthy and often convoluted pathway between idea and successful execution because they bump up against barriers they do not expect or know how to overcome. This Pilot and Feasibility Study will create Learning Solutions, a multi-platform program designed to support those people and entities engaged in work that cultivates the public's understanding of, engagement with, and interest in STEM fields and STEM-related information. First, the project will systematically identify the real, but often unspoken issues that individuals, organizations, and communities run into as they work to bring about significant and impactful STEM-related change. Then, the project will assemble, curate, and make digitally available a collection of tools, resources and strategies designed to help someone understand and resolve these kinds of issues if and when they arise. By better understanding the experiences of change agents, the challenges they face, and the creative learning solutions they enact, this project will ensure that more change agents successfully access the learning know-how they need, when they need it, in curated, easy-to-digest formats. This award is funded by the Advanced Informal STEM Learning program which contributes to STEM engagement and literacy, workforce development, and educational success via supporting new approaches to and evidence-based understanding of STEM learning in informal environments. Learning Solutions will build capacity and will help more professionals successfully bring more good ideas to fruition.
The target audience for this Pilot & Feasibility phase of Learning Solutions will be STEM professionals working at the intersection of STEM and society across diverse sectors. It will focus on change agents -- individuals who want to be or who already are engaged in community-based, action-oriented STEM-related change projects, whether acting on their own, within an organization, or as part of a broader community of organizations. To achieve the goal of making STEM-related change easier to accomplish, Learning Solutions will implement a multi-step process. With input from five Critical Advisors, 20 Key Informants, and ultimately hundreds of change agents, project staff will: 1) Utilize an iterative process of in-depth interviews and broadly disseminated surveys to identify the major understandings, skills and processes that current and past STEM-related change agents have experienced as impediments to their success; 2) Determine how best to describe and categorize these issues across diverse problem spaces; 3) Select twelve issues, based on which are the most frequently mentioned and/or perceived to be the most critical or challenging, and research and curate the best and most authoritative resources responsive to these dozen issues; and finally, 4) Use a variety of platforms (e.g., social media, traditional media, digital and in print publications, podcasts, panels, and group presentations) and utilization metrics to ensure effective digital delivery of potential solutions to the selected issues. By the project's end, we will have identified some of the key challenges the STEM-related change agents who work in communities across America regularly encounter, as well as the feasibility of developing a mechanism for helping those change agents discover preexisting and readily accessible resources to assist them in resolving those challenges.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
John H FalkElysa CorinStacey Sheehan
While museums strive to be as inclusive and welcoming as possible to all visitors, data from many institutions shows that audiences are still disproportionately white, well-educated, and more affluent than the average local population. One contributing factor to the lack of progress is that staff often create programs that work to create inclusivity from their own perspective, rather than grounding the work in a broader vision of the museum experience. This project will allow for a deeper exploration of how visitors, particularly those from groups that visit less frequently, experience a museum visit, and how their sense of belonging is supported or eroded during their visit. The team believes this sense is built up or taken away through specific moments of engagement or alienation and will explore these moments that matter through the work. Through intensive work at one museum, and additional work at three other museums, the project will look for themes and insights that can help all museums to create more positive moments that matter for all audiences. Specifically, the project will result in a) insights for museums in supporting a visitor-based sense of belonging, b) shared methods for working with visitors that could be applied by other researchers to explore specifics in a particular setting, and c) grounding work to develop survey questions for use across the field. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Building on existing work around exclusion and inclusion in everyday science learning, this project aims to formally define what a sense of belonging means in the science and natural history museum context as a construct for understanding inclusivity. The research team hypothesizes that the majority of experiences in an entire museum visit have a relatively neutral effect on visitor sense of belonging; however, at times, visitors may experience positive or negative moments, and these moments that matter may influence a visitor's STEM engagement, interest, and/or identity. This exploratory work will help to develop and ground the construct of sense of belonging within the museum visitor's experiences, to identify visitor moments that matter using an equity approach that intentionally centers the experiences of visitors from underrepresented groups, and to form the basis for future research that would support the development of a fieldwide measure of sense of belonging. The research study will focus on defining the construct of sense of belonging so it 1) aligns with the research literature and 2) is grounded in the experiences of science/natural history museum visitors. Photovoice data collection method and interviews will be used with visitors ages six and above to identify moments that matter for them during a visit to a science/natural history museum. This project will create new understanding of this construct for not only science/natural history museums and the larger informal science education (ISE) field, but fill a gap in the overall literature around the construct of sense of belonging. The project will also provide new learnings for the ISE field on how to adapt and use the photovoice method to study complex constructs, such as sense of belonging, in science/natural history museums.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The impacts of changes in the climate at local and global levels threaten how people live. Some frontline communities, especially in historically disenfranchised and under-resourced areas, are particularly vulnerable to the devastating effects of climatological events such as wildfires, flooding, and urban heat islands. As such, there is an urgent need for collective, evidence-based understanding and engagement to prevent and prepare for these potentially fatal events. Led by the Oregon Museum of Science and Industry (OMSI) in Portland, Oregon, in collaboration with local and national partners, Youth Lead the Way is an early-stage Innovations in Development project that offers a theory-based approach for youth in climatologically vulnerable communities to work in climate science research alongside field researchers, develop leadership skills, and engage in timely conversations that impact their own communities. The project will develop and evaluate a Youth Advisory Research Board model to equip and support youth and informal STEM education institutions to conduct evidence-based research on local climate impacts and communicate the findings of their research to their communities. Youth Lead the Way advances the work of several previous NSF-funded projects on climate education, youth advisory boards, and collaborative networks to engage the public in informal STEM learning. Findings from this project will support ongoing efforts in the informal STEM education field to meaningfully engage youth and to more effectively communicate science related to climate and its impacts to the public.
During this initial two-year early-stage project, youth predominantly from racial and ethnic groups underrepresented in STEM will engage in a year-long extended STEM experience. These youth will work collaboratively with scientists and museum professionals to enhance their skills as climate researchers, science communicators, and educational leaders, while reaching an estimated 4,000 or more public audience members through research and events at OMSI, in their schools, and in their communities. Using a cohort model, the youth will conduct scientifically based research studies on various local climate impact topics while concurrently serving in an advisory role at the Oregon Museum of Science and Industry, where they will participate in shaping relevant museum programs and practices. The youth will also develop and present climate stories, a communication approach based on storytelling, to raise public understanding and awareness about local climatological changes and impacts. In addition to the youth component, a companion workshop will be held at the Sciencenter in Ithaca, New York, a partner organization, to train staff and formatively assess the feasibility of scaling the model in other museums. At the program level, an exploratory qualitative research study will be conducted to identify the factors of the overall model that contribute to desired outcomes of youth engagement, climate impact education, and informal science education professional development. Interviews, surveys, focus groups, group chats among youth cohort members, and reviews of artifacts generated by the youth will inform this exploratory study. A theory-based guide outlining key findings, considerations, and recommendations will also be produced. The dissemination of this work will be multi-tiered, reaching thousands within the target communities through public programs, professional networks, at conferences, and a live virtual professional development event hosted by the Association for Science-Technology Centers. If successful, Youth Lead the Way will lay the groundwork for a model that promotes youth and public engagement in STEM through climate science research and identifies promising pathways for future research and similar efforts well beyond this project.
This early-stage Innovations in Development project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This three-year research and implementation project empowers middle school LatinX youth to employ their own assets and funds of knowledge to solve community problems through engineering. Only 7% of adults in the STEM job cluster are of Hispanic/Latino origin. There is a continuing need for filling engineering jobs in our current and future economy. This project will significantly broaden participation of LatinX youth in engineering activities at a critical point as they make career decisions. Design Squad Global LatinX expands on a tested model previously funded by NSF and shown to be successful. It will enable LatinX youth to view themselves as designers and engineers and to build from their strengths to expand their skills and participation in science and engineering. The project goals are to: 1) develop an innovative inclusive approach to informal engineering education for LatinX students that can broaden their engineering participation and that of other underrepresented groups, (2) to galvanize collaborations across diverse local, national, and international stakeholders to create a STEM learning ecosystem and (3) to advance knowledge about a STEM pedagogy that bridges personal-cultural identity and experience with engineering knowledge and skills. Project deliverables include a conceptual framework for a strength-based approach to engineering education for LatinX youth, a program model that is asset based, a collection of educational resources including a club guide for how to scaffold culturally responsive engineering challenge activities, an online training course for club leaders, and a mentoring strategy for university engineering students working with middle school youth. Project partners include the global education organization, iEARN, the Society of Women Engineers, and various University engineering programs.
The research study will employ an experimental study design to evaluate the impact on youth participating in the Design Squad LatinX programs. The key research questions are (1) Does participation increase students' positive perceptions of themselves and understanding of engineering and global perspectives? (2) To what extent do changes in understanding engineering vary by community (site) and by student characteristics (age, gender, ethnicity)? (3) Do educators and club leaders increase their positive perceptions of youths' funds of knowledge and their own understanding of engineering? and (4) Do university mentors increase their ability to lead informal engineering/STEM education with middle school youth? A sample from 72 local Design Squad LatinX clubs with an enrollment of 10-15 students will be drawn with half randomly assigned to the participant condition and half to the control condition. Methods used include pre and post surveys, implementation logs for checks on program implementation, site visits to carry out observations, focus groups with students and interviews with adult leaders. Data will be analyzed by estimating hierarchical linear models with observations. In addition, in-situ ethnographically-oriented observations as well as interviews at two sites will be used to develop qualitative case studies.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
A large body of research highlights the benefits of storybooks for children's learning. In the context of preschool classrooms, the use of storybooks to engage young children in STEM is a frequent topic of practitioner-oriented articles. There is also an increasing number of informal STEM education (ISE) projects exploring how to leverage storybooks to engage young children and their families in different STEM content domains. While there is universal excitement for the potential of storybooks in ISE, there is an acknowledgment of a critical need for more cross-project sharing, more research, and more efforts to synthesize and share findings. This award will catalyze new research studies and partnerships to advance efforts in ISE contexts, including the role of books in the overall learning experience or program, how books are selected or designed, and how the reading is facilitated by teachers and families. Participants will be educators and researchers working with or studying family learning for preschool-age children (three to five years) using early childhood fiction books as a tool for engaging families in STEM topics and skills.
Storybook STEM will be implemented in four phases: (1) pre-convening activities to plan, synthesize existing resources, engage a broader group of educators and researchers beyond convening attendees, and prepare convening participants to maximize the value of the in-person discussions; (2) in-person convening to catalyze cross-project discussions, outline promising practices, and identify questions and ideas for the future; (3) evaluation of the impact and value of the convening, from the perspective of participants and a project steering committee; and (4) dissemination of findings and recommendations to educators and researchers within and beyond the ISE field. Outcomes include: (1) documenting current and past work in ISE and other fields; (2) summarizing key recommendations and resources from the reading, literacy, and early childhood development fields; and (3) outlining promising directions for future work.
The findings from this project will provide a critical resource to help broadening participation efforts be more effective and inclusive for audiences across the country. Research studies motivated by the convening will address the lack of empirical work on storybooks as a tool for ISE programs and advance the ISE field's knowledge of how to integrate these books effectively. Because storybooks are a highly accessible and almost universally used family learning resource, the topic of the convening will be relevant to a wide range of audiences and will help educators broaden access to ISE for traditionally underserved and under-resourced communities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The project will develop and research the ways in which maker education activities can be leveraged to support intergenerational learning in hyper-vulnerable populations, such as families with an incarcerated parent. Maker education is often linked to STEM learning and uses hands-on and collaborative approaches to support activities and projects that foster creativity, interest, and skill development. Research has shown that maker education activities support STEM learning and creativity, the development of STEM identities and dispositions, and create pathways towards STEM careers. The project will develop a series of project activities including bringing Science, Technology, Engineering, and Mathematics (STEM) learning experts to a women's minimum-security facility for lectures on research and a set of workshops exploring maker activities for the incarcerated women and their children. By researching trauma-informed maker practices for families with an incarcerated parent, the project will develop research findings related to and practical resources for supporting these practices in other informal STEM learning contexts.
While evidence shows that maker pedagogy can be effective in supporting STEM learning for diverse populations, little is known about how it might support STEM learning for incarcerated women and their children. The project will investigate: (1) the everyday STEM practices of incarcerated women and their children and how these practices can be supported and extended through maker activities; (2) how incarcerated women and their children are perceived with respect to STEM and the impact these perceptions have on developing STEM identities; and (3) what design principles for developing STEM learning emerge through the project research. Program activities and related research will be designed and researched through the collaboration of incarcerated women, university researchers from the project university partners, the Saint Louis University Prison Program, and the Federal Correctional Institution-Camp (Greenville Women's Minimum Security Facility). The project will use Social Design Experimentation (SDE) as the primary research method, which is used to design and study education interventions on site. SDE is unique in that participants, researchers and other stakeholders collaborate to meet the goals of the project and related research. Project deliverables, which will be widely disseminated to researchers and educators, will include articles in peer-reviewed and educator publications, strategies and design principles for developing maker education opportunities for hyper-vulnerable populations, and practical recommendations for a maker kit to facilitate STEM maker education activities and family interaction.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Museums, science centers, zoos and other informal science education (ISE) institutions often focus on the idea of "authenticity" to engage the public. Authenticity includes providing something real, original, or even awe-inspiring to the visitor or learner--be it an object, a context, or an experience. While those educators, exhibit designers, and program developers who work in ISE settings often recognize authenticity as an important part of many informal learning experiences, this may be simply be an assumption driven by tradition in practice versus a strategy supported by evidence. This project seeks to better understand how and/or why "the real thing" may (or may not be) important for supporting informal science learning. By examining what is already known about authenticity and learning, the project will inform best practices in ISE as well as point to gaps in knowledge that might need further research. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This research synthesis takes a systematic approach to identify and compile both theoretical and empirical literature to better understand the role authenticity may play in supporting informal science learning. This project will gather ISE literature related to the effects of "authenticity" on learner outcomes, and will look to neighboring disciplines such as psychology, anthropology, media studies, linguistics, marketing and others to seek relevant theoretical perspectives and empirical work that might further understanding of the potential role of authenticity in ISE. The initial phase of the project will focus on gathering theoretical perspectives and positions that help explain the value or importance (or perhaps non-importance) of "realness" as it relates to learning, interest, and experience. A panel of experts from multiple disciplines will convene to help identify key perspectives and frameworks that may clarify the role or impacts of authenticity. A second phase focuses on gathering and assessing empirical studies that support (or refute) the relevant perspectives and theories identified from the initial multi-disciplinary foray into authenticity. To ensure breadth and depth of review, the PIs, research librarians, graduate students, and special topics classes will engage in identifying, evaluating, summarizing, and synthesizing the relevant research (including gray literature) to produce an initial synthesis report that will be reviewed by select experts from the earlier panel. A second convening of practitioners (exhibit developers, educators, program designers, etc.) will be used to further contextualize the findings in ways that may better inform current practices in providing effective ISE. The resulting products include a peer-reviewed research synthesis and a practitioner handbook.
The proposed project's Broader Impacts lie in the potential to inform ISE practice in exhibit and program design and in the delivery of ISE-related experiences. Although the importance of the authenticity of an object or experience may ultimately be determined by the individual, this study will be able to provide guidance to help practitioners and scholars in making sometimes difficult design choices. Such insights may also inform other learning environments (e.g. the classroom) as well as other disciplinary areas (e.g. history, anthropology, art).
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Familiarity with statistical and data literacy is important in many areas of modern life, but there is little research on how adults continue to build mathematical literacy beyond formal schooling. Mass media science news stories contain much data, assuming that adults will understand the content.This 4-year project will first map the landscape of adult statistical literacy in the US, particularly as it relates to news consumption. The second phase will build on results from the first phase through a longitudinal study. In the third phase, the project will develop a range of experiments to manipulate mathematical explainers embedded in STEM news stories and test techniques with adult audiences, with the goal of identifying the attributes and affordances that best improve confidence and competence in the underlying math principles and their meaning to news stories. in addition to the research, project components include 12 broadcast video and social media pieces each year that will form the basis for testing with audiences, a one-day symposium for professional science journalists, and a written best practice guide that summarizes key findings and implications for practitioners.
Critical research questions are: How do mathematical competence and confidence differ among different segments of the adult population? How can STEM journalists improve adult mathematical competence and confidence through their reporting techniques? Phase 1 of the research will be a landscape review of mathematical content in the news including a baseline study of adult statistical literacy. Phase 2 will be a longitudinal study with news audiences recruited to participate in a panel study. Phase 3 will be iterative testing of the digital content based on the findings from Phases 1 and 2 and will use both focus groups and online testing. External evaluation will be conducted by TERC including an evaluation of the symposium for professional journalists.
The broader impacts of this project are twofold: the science videos created will be broadcast and made available free to a national audience including those in rural areas; and the training of science journalists has the potential for multiple, long term impact by increasing their ability to communicate statistics meaningfully to their readers/viewers.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Museums in the US receive approximately 55 million visits each year from students in school groups. Field trip visits to an art museum have been found to positively impact critical thinking skills, empathy and tolerance - an increase that can be even more significant for youth from rural or high-poverty regions. While field trips are popular, especially at science museums, there have been no experimental studies about their impact on STEM career choices and interests, much less any which used a culturally sensitive and responsive approach. Given the resources put into field trips, this study investigates if causal links can be drawn between museum experiences and impact on youth. The Museum of Science & Industry uses a Learning Labs approach for engaging its visitors. These "Learning Labs" are facilitated experiences that run roughly an hour. Currently there are 12 lab topics. This study focuses on MedLab--one of the learning labs--as the setting for the research. MedLab is designed for on-site and online experience using ultra-sophisticated and highly versatile technology in challenges taken from research on the top healthcare issues that face adolescents in their communities.
This study is informed by research and theory on Social Cognitive Career Theory (SCCT) and Racial and Ethnic Identity. The former describes a process many follow when thinking about career options, broadly. The latter describes how people see themselves in the world through their membership with a racial and/or ethnic group. Both processes can collectively influence STEM career choices. This study follows an embedded mixed-method design. The quantitative portion includes an experimental, pre/post/delayed post-test design of both educators and their students using multiple measures taken mostly from previously published instruments. The qualitative portion includes observation rubrics of MedLab sessions along with interviews and focus groups with staff, educators, students and families that take place both within and outside of the museum. This is an experimental study of moderate size of both heterogeneous teacher and student populations in real world settings. It involves comparing youth and educators that participate in MedLab with those who do not. By conducting research that looks at each community through the lens of their unique experiences, the research will measure their impact more sensitively and authentically, addressing a gap in current literature on informal science, technology, engineering, or mathematics (STEM) career education with diverse students.
This study is funded by the Advancing Informal STEM Learning (AISL) program and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.