Skip to main content

Community Repository Search Results

resource project Media and Technology
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.

Increasing greater diversity, equity, and inclusion in science not only presents a social justice goal, but is also vital to the financial and social success of the nation. The stereotype of the older white male scientist has obscured the contributions of women and people of color. This project seeks to remedy these perceptions which are barriers to entry into STEM fields. The project will create a large-scale hub for STEM themed video content on YouTube and other social media platforms, featuring 100+ original STEM videos produced by PBS partners. This hub and accompanying research seeks to identify the characteristics of online STEM content that attract (or fail to attract) underrepresented groups, specifically Black and Hispanic communities as well as women of all races. The objectives of this project are to 1) provide a unified online science-themed hub, PBS Terra, on YouTube and other platforms for hosting, sharing, and distributing digital STEM series from diverse producers from across the PBS system; 2) conduct surveys and focus groups to examine and understand the needs and expectations of women, Black and Hispanic communities and their consumption of STEM video content online and 3) test hypotheses about the communicative strategies of STEM videos that feature Black and Hispanic female scientists. Project collaborators include PBS, researchers at the University of Utah and the University of Georgia, and consultants and advisors with expertise in broadening participation and inclusion in STEM.

Little is known about how or why adult Americans seek science content on YouTube, especially the motivations of adults from underrepresented minorities and females. The key research questions in this project are: 1) Why do Black and Hispanic audiences and women of all races seek science video content online? 2) How does showing Black and Hispanic female scientists in science video content on YouTube impact viewers’ identification with and sense of belonging in STEM? 3) How does the use of humor by Black and Hispanic scientists in YouTube science content affect viewers’ perceptions of the communicator and their engagement with STEM content? 4) How does the appearance and manner of dress of Black and Hispanic scientists in YouTube science content affect viewers’ perceptions in the aforementioned areas? A nationally representative baseline survey will be conducted. A probability sample of 2000 respondents will be obtained including oversampling of Black and Hispanic audiences. To complement findings from the survey, focus groups will be conducted in eight different regions of the country to learn why these targeted audiences do or do not seek science content on YouTube and what motivates them to share the content with their social media network. In addition, an experiment embedded in an online survey will test the hypothesis that greater on-screen representation of women and scientists of color will broaden existing perceptions about scientists. The experiment will consist of a 3 (scientist’s race: Black/Hispanic/White) × 2 (science issue: controversial/non-controversial) × 2 (style: casual/professional) between-subjects design. Survey participants will be randomly assigned to the experimental conditions. These factors (science issue and host appearance) can be altered by content producers to better reach and engage the targeted audiences. The project not only investigates theoretical questions at the intersection of STEM stereotypes and race, but findings related to these experimental conditions will offer practical insight into strategies that can be used by science communication practitioners.
DATE: -
TEAM MEMBERS: Adam Dylewski Sara Yeo Michael Cacciatore
resource project Public Programs
Black Girls Create (BGC) is a program that uses maker pedagogy, social history (i.e., Black women’s contributions in STEM), culturally responsive pedagogy, and mentoring to engage Black girls in STEM. For the project, culturally responsive making is operationally defined as the use of cultural knowledge and maker technologies to create, design, and produce artifacts that are related to a particular concept, theme, or person. The project will conduct a feasibility research study that investigates how engagement in BGC affects participants' STEM interest, STEM confidence, and racial and gender identities. In the project, participants will discover how Black women have made an impact in STEM fields and will learn how to digitally create cultural artifacts/wearable art related to their discoveries. Approximately 120 middle school girls in grades 6-8 (8 groups of 15 participants each) from underserved neighborhoods will be recruited for participation in this two-year study. Each group will meet for 3 hours per week over an 8-week period. Instructional materials from this research will be made freely available online so that they can be adapted and used at other formal and informal educational institutions that seek to garner interest and access to STEM learning for Black girls and women.

A pre- and post-test, quasi-experimental design will be used to research the program’s influence on participants’ self-efficacy, racial identity, and gender identity. Lagged regression models that control for students’ age, race/ethnicity, and pre-survey scores will be used to examine growth in each of the four outcomes. Once all of the participants in the groups have completed BGC, data from all groups will be combined to increase power and thereby detect statistically meaningful differences in pre- and post-survey scores. In addition, variables representing attendance and program engagement will be entered into the model to examine whether students who are highly engaged in BGC programming exhibit more growth in the four outcomes. Qualitative data will be derived from students' journal entries as well as focus group interviews. Weekly journals will be used to gather data about the context and experiences of participants as they unfold throughout the program. Semi-structured focus groups will center around the usefulness of skills and knowledge gained from the program activities, significant experiences with peers and program staff, the opportunity to learn about Black women STEM progenitors, and learning how to make digitally fabricated artifacts. NVIVO, a computer software program, will be used as a tool to support the analysis of the rich, text-based information resulting from the journals and focus group narratives.

This feasibilty research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE: -
TEAM MEMBERS: LaShawnda Lindsay-Dennis Kristin Searle Jaycee Holmes
resource project Exhibitions
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.

The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:


RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?

Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?


RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?

Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.




The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.

This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE: -
TEAM MEMBERS: Ronda Jenson Kelly Roberts
resource project Exhibitions
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.

Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
DATE: -
TEAM MEMBERS: Susan Letourneau
resource project Professional Development, Conferences, and Networks
The informal science education (ISE) sector has an important role to play in addressing current societal issues, including changes in environmental conditions, systemic poverty, and societal responses to natural and manmade disasters. These complex social problems require engaging all sectors of society in deep discussions around science, engineering, technology, and mathematics (STEM) and inclusion, diversity, equity, and access (IDEA). To do this, ISE professionals need training in how to bring in diverse perspectives, support inclusive learning, and provide equal access to institutional policymaking, practices and systems. People from different backgrounds within informal science institutions (ISIs) and local communities bring new perspectives, identify new needs, and foster innovation. This broadening of perspectives is critical to address the complex social problems of the 21st century. A key part of the needed transformations in informal science institutions is the preparation of change agents within the ISE sector capable of reimagining what just and equitable informal science institutions might look like. iPAGE 2.0 is an NSF Advancing Informal STEM Learning (AISL) Innovations in Development project conducted by the Science Museum of Minnesota and the Garibay Group in concert with 27 ISIs from across the US. The overarching goal of the project is to support transformative change toward IDEA in the ISE sector. The project is based on an extension service model of knowledge diffusion which seeks to bridge the knowledge-to-action gap by creating intermediaries that can translate research into practical innovations that can be used by practitioners in ISIs. The project brings together teams of strategically placed individuals within ISIs and prepares them to work with their colleagues to enact research-based practices and practical organizational changes toward greater equity and diversity. This project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This ISE professional development initiative will work with annual first-year cohorts consisting of leadership teams from 4-6 ISIs. Each new cohort will spend 11 days together in a 5-day institute and three 2-day colloquia either virtually or at the Science Museum of Minnesota. Individuals and teams will adapt, implement, and refine ideas, strategies, and tools from the iPAGE 2.0 framework for use within their specific ISI context and broader professional networks and engage in ongoing communication and consultation with the iPAGE 2.0 community. All individuals on the team will develop skills, such as communication and collaboration expertise, to function as change agents acting to transform their organizations with respect to inclusion, diversity, equity, and access (IDEA) in STEM. Participants from previous cohorts will continue their roles as change agents and enhance learning in the iPAGE 2.0 community by sharing what they have learned at iPAGE 2.0 colloquia. The iPAGE 2.0 framework focuses on developing participants' understanding of 1) how structural inequalities function to reproduce social advantage and disadvantage within ISIs and the ISE sector; 2) the barriers, supports, and transmission vectors that contribute to or inhibit a continued shift in the sector toward IDEA within a network of practitioners, organizations, evaluators and researchers; and 3) how to prepare and support diversity change agents within the network. The project will employ a creative evaluation approach that combines developmental, principles-focused, arts-based, and transformative evaluation and an interactive, mixed-methods research study grounded in culturally responsive methodologies to address central questions concerning individual, organizational, and sector change. The project's primary audience is ISE professionals, and the secondary audience is researchers and evaluators working within the ISE sector. The project will work directly with an estimated 122 individuals from 27 ISIs.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: E. Liesl Chatman Cecilia Garibay
resource project Public Programs
The Apsáalooke (Crow Indian) Nation in Montana, as well as other Indigenous communities across the United States, disproportionally experience negative consequences from water-related environmental hazards, such as contaminated water. In this project, fifth- and sixth-grade Apsáalooke youth will act as change agents through investigating water issues in their communities and presenting findings to their communities. They will conduct this water-related research in the context of an informal summer program designed to integrate Indigenous and Western perspectives on science. For example, youth will learn the cultural significance of water sites while also practicing methods for collecting and analyzing data relative to those sites, guided by Apsáalooke elders and science professionals. During the summer program, Indigenous high school students and tribal college students will mentor the youth. To develop this program, the project team will conduct interviews with elders and Apsáalooke community members in scientific fields to determine the desired features of a program that integrates Indigenous and Western science. They will use the findings from these interviews to develop a multimedia toolkit, which includes a set of comprehensive materials that will enable other researchers and informal educators to implement similar programs. This toolkit will include information about water science and water quality, lesson plans and related resources for the summer program, professional development materials to prepare the high school youth to act as mentors, handouts for family members to facilitate at-home engagement with their children, and more. The project team will research how the implementation of the toolkit influences the participants' water-related knowledge and attitudes toward science. The toolkit, and the associated empirical findings, will be disseminated widely through local, regional, and national professional networks that serve American Indians.

Montana State University, in partnership with Little Big Horn College, will implement and research an informal summer program for Apsáalooke youth in the fifth and sixth grades, as well as a mentorship program for Indigenous high school students and tribal college students. The older students will participate in a four-week internship program in which they learn about conducting water research and facilitating science activities that foreground Apsáalooke perspectives and cultural practices. The high school and tribal college students will partner with Apsáalooke elders and science professionals to facilitate and implement a two-week summer program for the fifth- and sixth-grade youth. This program will use the toolkit materials that were previously developed in consultation with elders and other community stakeholders. Regression analyses of validated pre- and post-surveys, as well as inductive analyses of interviews with stakeholders, will be used to study how the mentoring program affects the high school and tribal college students' attitudes toward science and career interests, and how the summer program affects the fifth- and sixth-graders' water-related knowledge. The research team will also study how youth participation in the program affects their family and community members' water-related knowledge. This project will result in a multimedia toolkit, freely available to the public and widely disseminated through professional networks, which specifies how other informal educators and researchers can implement similar mentorship programs and summer programs for Indigenous youth. Ultimately, this project will broaden participation through resulting in empirically-tested materials that advance practice in informal education for Indigenous youth and their communities. This project is funded by the Advanced Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, the AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (science, technology, engineering, and mathematics) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Vanessa Simonds
resource project Exhibitions
Museums and similar informal learning settings offer opportunities for children and families to learn together in an engaging way. Current exhibits rely mainly on parents, teachers, signage, and staff in science museums to provide support and guidance. Since it is not always feasible to have knowledgeable staff on hand and not all parents have the same knowledge and background, children receive varied support and people often miss the point of the learning experience or activity. This project will develop and research a new genre of Smart Science Exhibits that use artificial intelligence (AI) in an adaptive system to support children in learning science by doing science. The aim of the project is to incorporate AI adaptivity and personalization to maximize inquiry-based STEM learning and engagement in informal learning settings. This research builds on the project team's first Smart Science Exhibit (EarthShake), which uses AI vision to give interactive feedback to visitors based on their actions and guides them through scientific inquiry. In the project's preliminary work, the first smart exhibit demonstrated higher engagement and more learning gains than resulted from a traditional museum exhibit addressing the same scientific content. Smart exhibits can extend and enhance the limited support that staff and parents can provide. This project will develop and investigate adaptive approaches to mixing exploration and AI guidance, which will personalize feedback during constructive exploration. The project will build on learning science techniques and technology, proven in intelligent tutoring systems in formal settings, and apply this to different informal learning contexts. The goal is to provide just-in-time learning support, which will extend the time visitors spend with exhibits, thereby deepening inquiry-based science learning. The project is partnering with science museums and afterschool programs, which will enable thousands of children and families from a wide variety of backgrounds to use the project's smart exhibits each year. Smart Science Exhibits is funded by the Advancing Informal STEM Learning (AISL) program which supports innovative research, approaches, and resources as part of its overall strategy to enhance learning in informal environments.

Many informal learning settings are considering mixed-reality (MR) technologies to increase engagement and understanding of science. Using Smart Science Exhibits, the project will investigate how design choices in mixed-reality systems impact users' engagement and learning of STEM concepts. (Mixed reality is the blending of the physical world and the digital world, enabling interaction between human and artificial intelligence.) Project research will extend current research, which is largely descriptive, by investigating empirical results on learner outcomes. Key research questions are: What types of adaptivity and personalization can improve Smart Science Exhibits and MR systems generally? What balance of exploration and AI guidance is best to maximize enjoyment, engagement and learning? Do findings about the effective features of Smart Science Exhibits generalize to different content areas and informal learning settings? The project will employ user-centered design research, formative evaluation, and controlled experimentation to discover how mixed-reality systems should be designed to best meet visitor and staff needs in informal learning settings including multiple museums and afterschool providers. Data on learner behaviors in mixed-reality experiences in a variety of informal settings will inform the design of Smart Science Exhibits. The project will investigate whether adaptive approaches generalize across content and context to achieve better STEM learning, engagement, collaboration, and productive dialogue. The project will incorporate the team's prior technical research, which developed both vision techniques to track children's physical interactions and interactive pedagogical techniques to provide scaffolds for and reactive feedback on children's inquiry and construction behaviors. New technical research will develop AI techniques for adaptive task selection and personalized feedback that draws on a visitor's history of interaction. Project research and design resources will be widely shared with the science museum educators and designers through presentations at annual conferences and with researchers, developers and others through peer-reviewed journal publications and professional publications.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Nesra Yannier Scott Hudson Ken Koedinger
resource project Exhibitions
The Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. An ongoing challenge to the design of effective STEM learning exhibits for diverse young children is the absence of reliable and evidence-based resources that designers can apply to the design of STEM exhibits that draw upon play as a child's primary pedagogy, while simultaneously engaging children with STEM content and processes that support development of STEM skills such as observation. To address these challenges, the project team will use a collaborative process in which learning researchers and informal STEM practitioners iteratively develop, design, and test the STEM for Play Framework that could then be applied to the design of STEM-focused exhibits that support play and STEM skill use among early learners.

This Research in Service to Practice project will address these questions: 1) What is a framework for play in early STEM learning that is inclusive of children's cultural influences?; 2) To what extent do interactions between early learners (ages 3-8) and caregivers or peers at exhibits influence the structure and effectiveness of play for supporting STEM skill development?; 3) How do practitioners link play to STEM skill development, and to what extent does a framework for play in early STEM learning assist in identifying types of play that supports early STEM skill development?; and 4) What do practitioners identify as best practices in exhibit design that support the development of STEM skills for early childhood audiences, and conversely, to what extent do practitioners perceive specific aspects of the design as influential to play? The project team will address these questions across four phases of study that will include (a) development of a critical research synthesis to inform the initial STEM for Play framework; (b) the use of surveys, focus groups, and interviews to solicit feedback from practitioners; (c) testing and revising the framework by conducting structured observations of STEM exhibits at multiple museums. The project team will use multiple analytic approaches including qualitative thematic analyses as well as inferential statistics. Results will be disseminated to children?s museums, science centers, and research communities.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
resource project Public Programs
While there is increased interest in youth-centered maker programs in informal educational contexts, scarce research-informed professional development exist that focus on how informal educators do or should plan and handle ongoing, just-in-time support during moments of failure. Prior research supports the important role of failure in maker programming to increase learning, resilience and other noncognitive skills such as self-efficacy and independence. The objective of this project is to address this gap through adapting, implementing, and refining a professional development program for informal educators to productively attend, interpret, and respond to youths’ experiences with failure while engaged in maker programs in informal learning contexts. In the first two years of the project, the research team will work closely with six partners to implement and refine the professional development model: The Tech Museum of Innovation, The Bakken Museum, Montshire Museum of Science, The Minneapolis Institute of Art, Thinkery, and Amazeum Children’s Museum. In the last year of the project, the team will scale-up the professional development model through partnering with an additional nine institutions implementing maker programming for youth. The professional development consists of two models. In the first model, we support one to two lead facilitators at each partnering institution through an initial three-day workshop and ongoing support meetings. In the second model, the lead facilitators support other informal educators at their institution implementing making programs for youth. This project will enhance the infrastructure for research and education as collaborations and professional learning communities will be established among a variety of informal learning institutions. The project will also demonstrate a link between research and institutional and societal benefits through shifting the connotation and perceptions of failure to be valued for its educational potential and to empower informal educators to support discomfort and struggle throughout maker programs with youth.

The three goals of this collaborative project are to (a) advance the field of informal education through a research-based professional development program specific to youths’ failures during maker programs; (b) support shifts in informal educators’ facilitation practices and perspectives around youth’s failure experiences, and (c) investigate the effects of the professional development on youths’ resilience and failure mindset. The iterative nature of this project will be informed by the collection and analysis of video data of professional development sessions and informal educators facilitating maker programs, reflective journaling, surveys regarding the professional development, and pre-post surveys from youth engaged in the maker programs. Dissemination will address multiple stakeholders, including informal educators, program developers, evaluators, researchers, and public audiences.

This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE: -
resource project Public Programs
Over the past two decades the prevalence of Autism Spectrum Disorder (ASD) has nearly tripled and yet there is much to learn about serving this audience well. After high school exit, most are left to navigate the world without appropriate support or the requisite skills necessary for success. Educators working in informal science institutions (ISI) can better promote both social interaction and engagement in STEM education for individuals with ASD. A learning environment in which the learner chooses content aligned with their personal interests and where learning can be multifaceted (verbal, hands-on, fast or slow, social or solitary, directed or inquiry based, physical, etc.) is consistent with the central tenets of an evidence-based, outcome-driven approach for autism intervention. ISI educators have the desire but may not have sufficient and timely knowledge and skills to engage and support this audience. Currently, many are working at the local level to develop new programs and approaches for patrons with ASD, with little evaluation or research and not building on each other's work. The project will develop a rigorous customized professional learning experience designed to enhance capacity of ISIs broadly in ASD support techniques and strategies. The goal is to enable more inclusive opportunities for people with ASD based on current and emerging promising practices. The project's theory of action is that the ability of people with ASD to participate in traditional, mainstream experiences will improve their motivation to seek other similar opportunities, build interpersonal skills critical to successful interaction in society, formal education, and careers. This, in turn, will help individuals with ASD gain the skills and confidence needed to pursue STEM academically and professionally. The project is a collaboration between the Institute for Learning Innovation, the SciTech Institute, and the Southwest Autism Research & Resource Center (SARRC). This project is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.

The pilot's main research questions are: (1) To what degree does the professional learning program support the learning outcomes in knowledge, awareness, interest, skills, attitude, and behavior change in informal science education providers? and (2) What features of the program do educators consider most effective for improving their ability to serve this audience? Four Arizona ISIs will participate in a research-based design study; their staff will also comprise the founding members of a Community of Practice aimed at sharing promising practices and promoting broader engagement among the informal science education community. The professional development (PD) will be provided by SARRC. New formative evaluation skills will support ongoing innovation and build participant capacity. Leveraging this training, the ISIs will create and test new approaches and programs, apply new skills in formative evaluation, and develop internal workplace programs to create cultures of ASD understanding. A pilot research study will recruit 20 diverse individuals with ASD who will visit each institution prior to and after the PD for staff. The research will measure the degree to which the PD impacts attendee experience as well as assess the science learning that occurred because of their visit. This project will advance collaboration between ASD experts and ISI educators to iteratively develop effective museum learning strategies. Other goals of this work are to provide important insights into (a) the current state of accessibility programs in ISI venues nationally, (b) how PD can be leveraged to help institutions reach true inclusion, and (c) initial evidenced-based approaches for inclusion of individuals on the Autism spectrum in mainstream informal environments. In addition to the research findings, deliverables include an ASD PD model, national inventory of current practices and programs that support ASD learning and participation, and the establishment of a Community of Practice.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Judith Koke Jeremy Babendure Christopher Smith
resource project Professional Development, Conferences, and Networks
In the 1990s, Science Cafes emerged that brought together people from all walks of life with scientists in conversation over science, technology, engineering, and mathematics (STEM) topics. The cafes were popular as conversations were informal in casual settings and engendered deep discussions. In 2007, Science Education Solutions received a grant from NSF and began an experiment to see if the adult science café model could be adapted to appeal to high school teens. The program, Café Scientifique New Mexico, became very popular with teens in towns across northern New Mexico. The blend of conversing with scientists about interesting science topics in an out-of-school social setting and digging deeper with hands on activities proved successful. The teen model was refined through trial and error and formal evaluation over several years. Today it continues to provide teens with a new perspective on the nature of science and a picture of scientists as real people leading interesting lives. The Teen Science Café Network (TSCN) was formed in 2012 with NSF funding to allow other individuals and organizations to start their own versions of the Teen Science Café, adapted to their local institutions and demographics. Five founding member organizations around the United States formed the initial Network and each began creating their own Teen Science Café programs. Today the TSCN is a dynamic, growing community of practice spread across the country with the mission of connecting high school teenagers with STEM and STEM experts via the science café model. The network currently has approximately 133 member organizations in 46 states and Canada. This project will move the network to a much larger scale by creating organization and professional support structures to create a strategically growing social movement with distributed leadership, organizational infrastructure, and robust professional development for long-term stability with a goal to increase the number of member organizations to 500 over five years. Building on the literature on professional development for informal science educators and the literature on network capacity building, network sustainability, and scale, the project will also conduct research that will inform the field about successful model diffusion. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understanding of deeper learning by participants.

This Innovations in Development project has five objectives. The first is to re-structure the Teen Science Café Network (TSCN) to a more distributed leadership model that will move the network to long-term sustainability. The PI team will identify five experienced individuals already leading strong café programs to become Guides for new sites. These Guides will provide training, support, and mentorship to new network members. Each Guide will have responsibility over a given year for mentoring two cohorts of nine sites, allowing the network to increase in size over the next five years. The second objective is to implement an interactive program of professional development for new network members. The training will involve approximately 15 hours of adult leader training focused on building skills around teen engagement and café management. The third objective will be to strategically engage all members in the network community of practice through opportunities to participate in and lead ongoing learning with their peers. Through webinars, Birds of a Feather groups and annual workshops and a Science Events Summit, café leaders will actively hone professional skills and broaden their personal network. Objective four is to broaden the involvement of organizations and communities not currently in the network through strategic recruitment of STEM professional societies, military youth programs, library networks, and youth-serving organizations, among other organizations. Finally, objective five is to implement a research agenda to contribute to the informal learning knowledge base. The research will focus on how the project's approach to network growth and distributed leadership leads to effective scaling and sustainability.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Michelle Hall Michael Mayhew
resource project Public Programs
Makerspaces are learning environments that engage participants in authentic science and engineering practices, using hands-on and collaborative approaches to support activities and projects that foster creativity, interest, and skill development. Recently there has been a rapid growth of makerspaces in schools and in informal places like museums, libraries, and community centers. However, many of these spaces are not accessible to all members of society. This project will produce a model for a STEM makerspace that focuses on increasing access. The model has four critical components that operate together: affordable housing, informal STEM learning, maker education, and multi-generational learning. This project will develop and study the community-based, multigenerational makerspace model for Bayview Towers, a 200-unit affordable housing complex in Connecticut. The Multi-Gen STEM Makerspaces project brings together CAST, a non-profit education research organization, the NHP Foundation/Operation Pathways, a national affordable housing provider, and the Boston University Social Learning Lab, which researches the social context for STEM learning. The project will produce a Multi-Gen Maker Playbook comprised of an educational guide for a series of four-week workshops around different themes and modes of making. The Playbook will also serve as a program model that guides similar communities on how to create and run sustainable and thriving maker programs of their own. Families in the Bayview Towers community will build an understanding of science, technology, engineering, and mathematics (STEM) concepts through participation in an onsite makerspace. Families will relate what they are doing through making to longer-term goals connected to STEM learning, education, and careers. The project will also enable the engagement of individuals in the co-design (individuals provide creative contributions) of making that can be translated into community structures and values that support a sustainable makerspace. The affordable housing context will provide understanding of individual and other social factors that impact learners' sense of STEM identity. The project will support mobility from poverty by including STEM learning as part of the resident services.

The research will examine how low income communities access, engage, and learn in makerspaces, and relate their learning to relevant goals. The team will use design-based research (DBR) whereby participants and researchers work together to design interventions intended to explore theory through cycles of enactment, analysis, and revision. The DBR research will answer the following questions:


In what ways, if any, does the model support residents experiencing STEM learning as consequential?
What kind of making goals do residents set and how do they embed STEM in these goals?
If residents experience STEM learning as consequential through the workshops, do they also see the relationship between their making goals and longer term goals?
Do those residents that use the makerspace more frequently experience more positive outcomes in terms of consequential STEM learning?
How do the various makerspace structures - training of facilitators, dedicated space and equipment, Playbook - support the model?
Are groups of residents participating regularly in the makerspace and if so, who is in these groups? Do these groups start to identify as a maker community? Is the community finding the makerspace of value?
In what ways does the organization and operations of the makerspace support building a sustainable model for multigenerational and consequential learning?


Participants will include 90 youth and 90 adults from the resident community at Bayview Towers. Research data to be collected includes open-ended response measures for scoring residents' interpretation, analysis and understanding of each workshop elements. Also, interview protocols will be used to guide the refinement of the Multi-Gen Maker Playbook features and analyze usability, feasibility, engagement and user experience of the Multi-Gen Maker Playbook within the platform. The program will use semi-structured interview protocols on participants' goals and STEM identity and focus group protocols on community maker values and makerspace structures. Additionally, a Likert-style survey on STEM identity will also be adapted from the Science Identity Scale. Project evaluation will examine the overall achievement of program goals and objectives. Project results will be communicated by traditional means of dissemination to scholars and practitioners. The team will also create targeted digital media, including online articles, podcast interviews, and blog posts, to reach a broader audience.


This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Sam Catherine Johnston Kathleen Corriveau Jess Gropen Kim Ducharme Kenneth White