Skip to main content

Community Repository Search Results

resource project Public Programs
Creating science education that can contribute to cultivating just, culturally thriving, and sustainable worlds is an important issue of our time. Indigenous peoples have persistently been under-represented in science reproducing inequalities in a myriad of ways from educational attainment, participation in and contributing to innovations in foundational knowledge, to effective policy making that upholds and respects Indigenous sovereignty. The development of models of science education that attend to intersections of knowledge and development, socio-scientific decision-making and civic leadership, and the complexities and contradictions of these realities, is imperative. This five-year Innovations in Development project broadens participation and strengthens infrastructure and capacity for Indigenous learners to meet, adapt to, and lead change in relation to the socio-ecological challenges of the 21st century. The project engages multi-sited community-based design studies to develop and research the impacts of Indigenous informal field-based science education with three Indigenous leadership communities from the Pacific Northwest and the Great Lakes. This project will have broader impacts through model development, building infrastructure to transform the capacity of informal field-based science education, and will produce cutting edge foundational knowledge about pressing 21st century issues with a particular focus on Indigenous communities. The project increases Indigenous participation in research through 1) engagement of Indigenous community members as research assistants, 2) training of Indigenous graduate fellows, and post-doctoral fellows, and 3) supporting the careers of more junior Indigenous scholars.

This research seeks to identify key design features of an Indigenous field (land/water) based model of science education and to understand how learners’ and educators’ reasoning, deliberation, decision-making, and leadership about complex socio-ecological systems and community change evolve in such learning environments. The project also examines key aspects of co-design and partnership with Tribal communities and how these methods of co-production of new science enable new capacities for systems transformation. This multi-layered project is organized through 3 panels of studies including: Panel 1) community-based design experiments to develop and refine a model of Indigenous informal science education; Panel 2) co-design and implementation of professional learning programs for Indigenous informal science education; and Panel 3) foundational studies in cognition and learning with respect to socio-ecological systems thinking and the impact on learning and instructional practices. Of particular importance in this research is the rigorous development and articulation of effective pedagogical practices and orientations. More broadly, findings will have clear implications for theories of cognitive development, deliberation and environmental decision making and especially those pertaining to how knowledge is shaped by culture and experience.

This project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE: -
TEAM MEMBERS: Filiberto Barajas-Lopez Anna Lees Megan Bang Anna Lees Filiberto Barajas-Lopez
resource project Professional Development, Conferences, and Networks
Among scientists, science communication is an increasingly important area of practice, scholarship, and research, especially with early career scientists. The growing interest in combating widespread disinformation and inaccurate public perception of science has increased demand for training in science communication; however, there is a significant gap in both research and training for scientists from diverse racial and ethnic cultural backgrounds. The project will address this knowledge and research gap by applying intercultural communication theory to the design, development, and testing of a new curriculum that will provide evidence-based methods to make science communication trainings inclusive and intersectional. The curriculum will be designed and evaluated to build capacity among science communication trainers and practitioners. Sixty pre-tenure environmental science faculty of diverse racial and ethnic backgrounds will be trained in strategic science communication skills using cultural perspectives and academic goals in science communication. The project will gather research data in collaboration with the national SciComm Trainers Network. In addition to advancing science communication research, training, and practice, the project will implement a novel, peer-reviewed podcast for broader impact. The project Fellows will be prepared to engage in a wide range of science communication activities throughout their careers and lead related efforts at their home institutions. Following a final workshop to develop culturally responsive guidance for science communication trainers, the project team will share findings to the field to inform future practice and societal impacts from advancing culturally relevant science communication in training programs. This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.

The project will address two significant gaps in science communication and intercultural communication research. First, despite the recognition that more research about race and ethnicity is needed in science communication, few studies have been conducted. Second, while findings on intercultural communication research are consistent across fields, such as health communication and business communication, the research has yet to examine how well-established theories in this area of study apply to the unique norms and processes of science. Investigators will test a novel theoretical framework grounded in two intercultural communication theories: identity negotiation theory and communication accommodation theory. The project will test the extent to which the professional norms and processes of STEM and academia relate to cultural norms and communication styles of underrepresented racial and ethnic minority scientists, and how these factors influence their science communication efforts. The project will use a mixed methods approach including in-depth interviews and surveys. The results of the study will be used to develop and adapt culturally tailored science communication training for 60 pre-tenure environmental science faculty from underrepresented groups. The results of the project will provide evidence to make science communication training and practice more inclusive and effective. The collaboration with the national SciComm Trainers Network will ensure broad dissemination and professional application of project findings. The project will increase representation of racial and ethnic minority scientists as science communicators, including in environmental news coverage; provide a new peer-reviewed podcast series for public audiences that will introduce listeners to environmental research through a culturally responsive lens; provide tested methods for designing inclusive and effective science communication training curricula; and will inform faculty efforts to incorporate science communication activities as part of career advancement.
DATE: -
TEAM MEMBERS: Bruno Takahashi Sunshine Menezes
resource project Media and Technology
This project will scale up fully virtual or face-to-face STEM professional development to afterschool educators in both urban and rural settings. Given that many afterschool educators have little or no background in STEM education, there is demand for professional development that is effective, inexpensive, and accessible. This project will build national capacity in STEM education by developing the STEM skills of over 1,500 educators across multiple states and will ultimately impact over 31,000 under-represented youth in these areas. The project will also deliver robust materials through a free open-source mechanism, for use by educators anywhere and anytime. The project will broaden participation in STEM by engaging community educators in the rural parts of the nation, a critically under-represented group in STEM. It will also reach educators from low-income urban communities across three states and seven cities, targeted through strategic networks and partnerships, including organizations such as the YMCA, 4-H, and the National Afterschool Association.

This collaborative project is scaling the ACRES model (Afterschool Coaching for Reflective Educators in STEM). The model humanizes the virtual experience, making it social and engaging, and allows educators to learn, share, and practice essential STEM facilitation skills with a focus on making STEM relevant and introducing STEM careers to youth. In addition to enhancing the professional STEM skills of rural and urban educators, the project will create a national cohort of coaches with deep expertise in (i) converting in-person activities for youth into a highly engaging, choice-rich online format, (ii) engaging isolated informal educators in supportive professional learning communities, and (iii) coaching foundational research-based STEM facilitation skills that ensure these activities are pedagogically sound. A key part of this broad implementation project involves studying how to integrate an effective professional development program into afterschool organizations, including the ways afterschool programs adapt the materials to be culturally responsive to their local communities. The researchers will also study factors contributing to the longer-term sustainability of the program. The research will use surveys, interviews, direct observations, and case studies of participants to provide the field with valuable insights into scaling a program in the afterschool world.

This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for extending access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE: -
resource project Media and Technology
Black girls display high interest, confidence and ability in STEM but face multiple barriers including racial, ethnic and gender stereotypes, low exposure to STEM role models, low awareness of diverse STEM fields and financial obstacles to STEM education. It is critical to infuse STEM education with specific and intentional culturally responsive and anti-racist strategies to attract and retain Black girls in STEM. Through this combination of media, role modeling and outreach, Black SciGirls will help increase access to STEM education for Black girls, preparing them for future workforce participation. This project will study the impacts on elementary/middle school Black girls’ exposure to early career Black female STEM professionals as role models. Deliverables include 1) professional development for STEM educators and Black STEM professional women to prepare them to lead STEM programs for girls 2) a PBS series of role model videos of early-career Black STEM professionals and 3) a research study that examines how/if in person and media-based STEM role models increase Black girls’ interest and confidence in STEM, motivation to pursue future STEM studies, and STEM identity. While women make up 47% of the U.S. workforce, they are underrepresented in STEM and only 1.6% are Black women.

The research study will examine how educators’ use of role models addresses a critical barrier for Black girls, seeing women in STEM who look like them. The research study questions are: How and in what ways do Black STEM women role models influence Black girls’ interest in STEM? How and to what extent do role models report changes in their confidence and ability to engage girls in STEM as a result of training in best practices in role modelling? and, How and to what extent are parents engaged in supporting girls’ involvement in STEM, as a result of the participation of role models? The research team will visit participating local SciGirls programs to collect qualitative data, including observations of program activities, interviews, and focus groups. To ensure reliable outcomes and utilize robust theoretical underpinnings, the research will combine pre/post survey data and an in-depth cross-case studies employing qualitative and quantitative data collection. This mixed-methods approach will enable gathering data that comprehensively offers insight into Black girls’ STEM experiences and those of the Black STEM professional women role models and parents who support them. Qualitative data that centers girls’, role models’, and parents’ perspectives will contribute to this identity-centered study. A culturally responsive evaluation will determine the extent to which the project builds educators’ ability to integrate equitable and anti-racist practices to build Black girls’ interest and confidence in STEM studies.

This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE: -
TEAM MEMBERS: Rita Karl Angel Miles Nash Ronda Bullock Adrienne Stephenson Lataisia Jones
resource project Professional Development, Conferences, and Networks
Millions of Latinx youth, aged 14 to 18, work formal or informal jobs to provide income for themselves or their families. In the context of these workplaces, Latinx youth demonstrate numerous skills that are essential to industrial engineering, such as minimizing workplace injuries or optimizing processes to maximize efficiency. However, their workplace ingenuity and skills are often underrecognized by educational systems. To counter this lack of recognition, the purpose of this project is to iteratively develop and research an out-of-school engineering program for working Latinx youth. This program is designed to recognize and build from youths’ workplace experiences by connecting them with industrial engineering concepts and practices, such as those used to promote worker safety. This program is also designed for youth to articulate transformational visions of industrial engineering, which expand current goals, values, and methods commonly embraced within this discipline. This year-long program will be facilitated by educators of existing out-of-school programs (e.g., Mathematics, Engineering, and Science Achievement), in partnership with undergraduate mentors from the Society for Professional Hispanic Engineers and other local organizations that serve Latinx youth (e.g., Latinos in Action). Approximately 220 youth are expected to participate in the programming. Researchers will explore whether and how youth participants develop identities in engineering, as well as how the educators and mentors understand and enact assets-based, out-of-school engineering education grounded in youths’ experiences. Researchers will also identify the individual, institutional, and systemic factors that support or inhibit sustained implementation of the program over time in different sites and contexts. This project will result in a set of empirically tested, bilingual program materials that will be disseminated widely to professional organizations dedicated to out-of-school programming and to serving Latinx youth.

This project will result in a localizable, transferable, and sustainable model for an out-of-school time program that recognizes and amplifies Latinx youths’ workplace funds of knowledge and leverages them toward youth-driven visions and applications of engineering. This program, which will connect with other people and sites in youths’ learning ecosystems, is grounded in principles of translanguaging, transformational mentorship, and educational dignity and recognition. In partnership with youth participants, researchers will use a social design experiment to explore the following research questions: What are the engineering identity trajectories of working high school youth, and how do specific moments of identity negotiation and recognition relate to broader patterns across program sessions and identity trajectories for individual participants over time? To answer these questions, a pre-, mid- and post-program Engineering Identity Scale; recordings of program implementations; interviews; and youth artifacts will be analyzed using various methods such as critical multimodal discourse analysis. After implementations of the program across multiple sites, researchers will use design-based implementation research to answer the following questions: How do educators and mentors understand and enact assets-based pedagogies designed to foster recognition across sites? What institutional and systemic features (designed or naturalistic) support or inhibit productive adaptations and implementations of the program? These questions will be answered using constant comparative analyses of data sources such as interviews with the program educators and mentors, observations of program implementations, observations of professional development sessions, and public documents. Culturally responsive, educative evaluation will be used to iteratively improve the program. The resulting research and program materials will be disseminated widely through professional organizations dedicated to Latinx youth, engineering education, and out-of-school learning.

This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE: -
TEAM MEMBERS: Amy Wilson-Lopez Alfonso Torres-Rua Marisela Martinez-Cola Colby Tofel-Grehl Alfonso Torres-Rua
resource project Exhibitions
Informal STEM learning environments, programs, and policies can be designed to support and promote neurodiversity through inclusive practices. This project will explore the benefits of informal STEM learning for K-12 neurodiverse learners through a systematic review and meta-analysis of extant literature and research grounded in the theory of social model of ability. This framework is an asset-based approach and aims to promote social, cognitive, and physical inclusion, leading to positive outcomes. Using various quantitative and qualitative methodologies, this project endeavors to collect and synthesize the evidence for supporting and enhancing accessibility and inclusiveness in informal STEM learning for K-12 neurodiverse learners. It will explore key features of informal STEM learning and effective, evidence-based strategies to effectively engage children and youth with neurological conditions such as autism spectrum disorder, attention deficit hyperactivity disorder (ADHD), dyslexia, and dyspraxia, in informal STEM learning environments. The findings of this complex synthesis will provide a timely contribution to deeper understanding of supports for neurodiversity while also highlighting areas that inform further research, shifts in practice, and policy.

The systematic review will occur over a two-year period. It will focus on identifying program elements that promote inclusion of children and youth with neurodevelopmental disabilities in informal STEM learning contexts. Specifically, the review will explore two overarching research questions and several sub-research questions:


RQ1. What program elements (teaching and learning variables) in informal STEM learning settings facilitate inclusion of K-12 neurodiverse STEM learners? Sub-RQ1a: What are the overlapping and discrete characteristics of the program elements that facilitate social, cognitive, and physical inclusion?

Sub-RQ1b: In what ways do the program elements that facilitate inclusion vary by informal STEM learning setting?


RQ2: What program elements (teaching and learning variables) in informal STEM learning settings are correlated with benefits for K-12 neurodiverse STEM learners? Sub-RQ2a: What are the overlapping and discrete characteristics of the program elements that correlate with increased STEM identity, self- efficacy, interest in STEM, or STEM learning?

Sub-RQ2b: In what ways do the program elements that correlate with positive results for students vary by informal STEM learning setting? The research synthesis will consider several different types of studies, including research and evaluation; experimental and quasi-experimental designs; quantitative, qualitative, and mixed methods; and implementation studies.




The research team will (a) review all analyses and organize findings to illustrate patterns, factors, and relationships, (b) identify key distinctions and nuances derived from the contexts represented in the literature, and (c) revisit and confirm the strength of evidence for making overall assertions of what works, why, and with whom. The findings will be disseminated in practice briefs, journal articles, the AISL resource center, as well as presentations and materials for researchers, practitioners, and informal STEM leaders. Ultimately, this work will result in a comprehensive synthesis of effective informal STEM learning practices for neurodiverse K-12 learners and identify opportunities for further research and development.

This literature review and meta-analysis project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE: -
TEAM MEMBERS: Ronda Jenson Kelly Roberts
resource project Media and Technology
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.

BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.

A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.

This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
resource project Professional Development, Conferences, and Networks
The informal science education (ISE) sector has an important role to play in addressing current societal issues, including changes in environmental conditions, systemic poverty, and societal responses to natural and manmade disasters. These complex social problems require engaging all sectors of society in deep discussions around science, engineering, technology, and mathematics (STEM) and inclusion, diversity, equity, and access (IDEA). To do this, ISE professionals need training in how to bring in diverse perspectives, support inclusive learning, and provide equal access to institutional policymaking, practices and systems. People from different backgrounds within informal science institutions (ISIs) and local communities bring new perspectives, identify new needs, and foster innovation. This broadening of perspectives is critical to address the complex social problems of the 21st century. A key part of the needed transformations in informal science institutions is the preparation of change agents within the ISE sector capable of reimagining what just and equitable informal science institutions might look like. iPAGE 2.0 is an NSF Advancing Informal STEM Learning (AISL) Innovations in Development project conducted by the Science Museum of Minnesota and the Garibay Group in concert with 27 ISIs from across the US. The overarching goal of the project is to support transformative change toward IDEA in the ISE sector. The project is based on an extension service model of knowledge diffusion which seeks to bridge the knowledge-to-action gap by creating intermediaries that can translate research into practical innovations that can be used by practitioners in ISIs. The project brings together teams of strategically placed individuals within ISIs and prepares them to work with their colleagues to enact research-based practices and practical organizational changes toward greater equity and diversity. This project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This ISE professional development initiative will work with annual first-year cohorts consisting of leadership teams from 4-6 ISIs. Each new cohort will spend 11 days together in a 5-day institute and three 2-day colloquia either virtually or at the Science Museum of Minnesota. Individuals and teams will adapt, implement, and refine ideas, strategies, and tools from the iPAGE 2.0 framework for use within their specific ISI context and broader professional networks and engage in ongoing communication and consultation with the iPAGE 2.0 community. All individuals on the team will develop skills, such as communication and collaboration expertise, to function as change agents acting to transform their organizations with respect to inclusion, diversity, equity, and access (IDEA) in STEM. Participants from previous cohorts will continue their roles as change agents and enhance learning in the iPAGE 2.0 community by sharing what they have learned at iPAGE 2.0 colloquia. The iPAGE 2.0 framework focuses on developing participants' understanding of 1) how structural inequalities function to reproduce social advantage and disadvantage within ISIs and the ISE sector; 2) the barriers, supports, and transmission vectors that contribute to or inhibit a continued shift in the sector toward IDEA within a network of practitioners, organizations, evaluators and researchers; and 3) how to prepare and support diversity change agents within the network. The project will employ a creative evaluation approach that combines developmental, principles-focused, arts-based, and transformative evaluation and an interactive, mixed-methods research study grounded in culturally responsive methodologies to address central questions concerning individual, organizational, and sector change. The project's primary audience is ISE professionals, and the secondary audience is researchers and evaluators working within the ISE sector. The project will work directly with an estimated 122 individuals from 27 ISIs.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: E. Liesl Chatman Cecilia Garibay
resource project Public Programs
The U.S. Fish and Wildlife Service estimates that over 41 million people connect to nature through birding. Learning about birds in their natural environments offers opportunities for informal engagement in STEM by a broad range of individuals and groups. Birders often engage in scientific data gathering and analyses, geolocation and remote sensing, and phenology. They also become aware of ecological changes in bird habitats and migratory patterns due to rising temperatures and climate-related events like sea level rise, droughts, fires, and extreme weather. As such, the birding community is an ideal network to better understand and communicate the impacts of climatological changes on bird populations to the public. With this Innovations in Development project, the National Audubon Society will develop a new avian-focused, conservation and climate science community science curriculum for its Nature Centers, and test the effectiveness of the curriculum in educating the public about avian-focused conservation and climatological changes through guided nature experiences. Birding can serve as a pivotal entrée for young people into STEM fields and careers. Through its programs and partnerships, Audubon will leverage its national network to ensure that through this project a more diverse group of voices, particularly young adults and young adults of color, become involved in asking critical questions and developing solutions to address important environmental issues of the future. If successful, the broader impacts of this project on capacity building and public engagement could be far-reaching and long-lasting.

Over the three-year project duration, Audubon will bring educators from its nationwide network of thirty-four Nature Centers (including urban, suburban, and rural sites), together with over 510 young adults (ages 18-25) from its network of college campus chapters. An evidence-based curriculum and community science activities will be created and tested, relying heavily on a team of experts in ornithology, climate science research, STEM curriculum design, diversity, and informal science education. College students will advise on the design of content and activities to effectively interest and engage young adults. These students will be recruited from the new Audubon Campus Chapters Program, which includes 111 college and university campuses, among them, 19 Historically Black Colleges and Universities (HBCUs) and other Minority Serving Institutions (MSIs). The target population will be surveyed to also understand their current and likely participation in guided nature experiences and knowledge base in climate science. Current best practices in guided nature experiences will be gathered from across the Audubon network. The implementation efforts will result in a national STEM model, with train-the-trainer guides and workshops for informal science educators and public engagement opportunities focused on improving the state and condition of avian habitats and communities through climate science research. An external evaluation will be conducted and will include data collection methods such as retrospective pre and post surveys, semi-structured interviews, focus groups, and an embedded assessment to determine impact. The findings will be used to iteratively refine the evidence-based curriculum and measure STEM learning outcomes for the guided nature experience participants. The evaluation will address four areas: (1) fidelity of program implementation to promote accountability; (2) formative evaluation to understand needs and interests of young adults (ages 18-25), and subsequently inform program design; (3) outcomes for Center educators, to inform iterative improvement; and (4) outcomes for program participants, to contribute to the growing knowledge base on effective practices for STEM learning in informal settings.

This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Loren Smith Mark Scallion Heather Starck
resource project Media and Technology
This project will teach foundational computational thinking (CT) concepts to preschoolers by creating a series of mobile apps to guide families through sequenced sets of videos and hands-on activities. To support families at home it would also develop a new library model to build librarians' computational thinking content knowledge and self-efficacy so they can support parents' efforts with their children. Computational thinking is a an increasingly critical skill for learning and success in the workforce. It includes the ability to identify problems, brainstorm and generate solutions and processes that can be communicated and followed by computers or humans. There are few projects that introduce computational thinking to young children. Very little research has been done on the ways that parents can facilitate children's engagement in CT skills. And developing a model that trains and supports librarians to become virtual coaches of parents as they engage with their children in CT, will leverage and build the expertise of librarians. The project's target audience includes parents and children living in rural areas where access to CT learning may be very limited. Project partners include the EDC, a major research organization, the American Library Association, and BUILD, a national association that promotes collaborations across library, kindergarten readiness, and public media programming.

The formative research study asks: 1) What supports do parents of preschoolers in rural communities need in order to effectively engage in CT with their children at home? and 2) How can libraries in rural communities support joint CT exploration in family homes? The summative research study asks: 3) how can an intervention that combines media resources, mobile technology, and library supports foster sustained joint parent/child engagement and positive attitudes around CT? Researchers will develop a parent survey, adapting several scales from previously developed instruments that ask parents to report on children's use of CT-related vocabulary and CT-related attitudes and dispositions. Survey scales will assess librarians' attitudes towards CT, as well as their self-efficacy in supporting parents in CT in a virtual environment. During the formative study, EDC will pilot-test survey scales with 30 parents and 6 librarians in rural MS and KY. Analyses will be primarily qualitative and will be geared toward producing rapid feedback for the development team. Quantitative analyses will be used on parent app use, using both time query and back-end data, exploring factors associated with time spent using apps. The summative study will evaluate how the new media resources and mobile technology, in combination with the library virtual implementation model, support families' joint engagement with CT, and positive attitudes around CT. The researchers will recruit 125 low-income families with 4- to 5-year-old children in rural MS and KY to participate in the study. They will randomly assign families within each library to the full intervention condition, including media resources, mobile technology, and library support delivered through the virtual implementation model, or the media and mobile-technology-only condition. This design will allow researchers to understand more fully the additional benefit of library support for rural families' sustained engagement, and conversely, see the comparative impact of a media- and mobile-technology only intervention, given that some families might not be able to access virtual or physical library support.

As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Marisa Wolsky Heather Lavigne Jessica Andrews Janna Kook
resource project Public Programs
While there is increased interest in youth-centered maker programs in informal educational contexts, scarce research-informed professional development exist that focus on how informal educators do or should plan and handle ongoing, just-in-time support during moments of failure. Prior research supports the important role of failure in maker programming to increase learning, resilience and other noncognitive skills such as self-efficacy and independence. The objective of this project is to address this gap through adapting, implementing, and refining a professional development program for informal educators to productively attend, interpret, and respond to youths’ experiences with failure while engaged in maker programs in informal learning contexts. In the first two years of the project, the research team will work closely with six partners to implement and refine the professional development model: The Tech Museum of Innovation, The Bakken Museum, Montshire Museum of Science, The Minneapolis Institute of Art, Thinkery, and Amazeum Children’s Museum. In the last year of the project, the team will scale-up the professional development model through partnering with an additional nine institutions implementing maker programming for youth. The professional development consists of two models. In the first model, we support one to two lead facilitators at each partnering institution through an initial three-day workshop and ongoing support meetings. In the second model, the lead facilitators support other informal educators at their institution implementing making programs for youth. This project will enhance the infrastructure for research and education as collaborations and professional learning communities will be established among a variety of informal learning institutions. The project will also demonstrate a link between research and institutional and societal benefits through shifting the connotation and perceptions of failure to be valued for its educational potential and to empower informal educators to support discomfort and struggle throughout maker programs with youth.

The three goals of this collaborative project are to (a) advance the field of informal education through a research-based professional development program specific to youths’ failures during maker programs; (b) support shifts in informal educators’ facilitation practices and perspectives around youth’s failure experiences, and (c) investigate the effects of the professional development on youths’ resilience and failure mindset. The iterative nature of this project will be informed by the collection and analysis of video data of professional development sessions and informal educators facilitating maker programs, reflective journaling, surveys regarding the professional development, and pre-post surveys from youth engaged in the maker programs. Dissemination will address multiple stakeholders, including informal educators, program developers, evaluators, researchers, and public audiences.

This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE: -
resource project Public Programs
Over the past two decades the prevalence of Autism Spectrum Disorder (ASD) has nearly tripled and yet there is much to learn about serving this audience well. After high school exit, most are left to navigate the world without appropriate support or the requisite skills necessary for success. Educators working in informal science institutions (ISI) can better promote both social interaction and engagement in STEM education for individuals with ASD. A learning environment in which the learner chooses content aligned with their personal interests and where learning can be multifaceted (verbal, hands-on, fast or slow, social or solitary, directed or inquiry based, physical, etc.) is consistent with the central tenets of an evidence-based, outcome-driven approach for autism intervention. ISI educators have the desire but may not have sufficient and timely knowledge and skills to engage and support this audience. Currently, many are working at the local level to develop new programs and approaches for patrons with ASD, with little evaluation or research and not building on each other's work. The project will develop a rigorous customized professional learning experience designed to enhance capacity of ISIs broadly in ASD support techniques and strategies. The goal is to enable more inclusive opportunities for people with ASD based on current and emerging promising practices. The project's theory of action is that the ability of people with ASD to participate in traditional, mainstream experiences will improve their motivation to seek other similar opportunities, build interpersonal skills critical to successful interaction in society, formal education, and careers. This, in turn, will help individuals with ASD gain the skills and confidence needed to pursue STEM academically and professionally. The project is a collaboration between the Institute for Learning Innovation, the SciTech Institute, and the Southwest Autism Research & Resource Center (SARRC). This project is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.

The pilot's main research questions are: (1) To what degree does the professional learning program support the learning outcomes in knowledge, awareness, interest, skills, attitude, and behavior change in informal science education providers? and (2) What features of the program do educators consider most effective for improving their ability to serve this audience? Four Arizona ISIs will participate in a research-based design study; their staff will also comprise the founding members of a Community of Practice aimed at sharing promising practices and promoting broader engagement among the informal science education community. The professional development (PD) will be provided by SARRC. New formative evaluation skills will support ongoing innovation and build participant capacity. Leveraging this training, the ISIs will create and test new approaches and programs, apply new skills in formative evaluation, and develop internal workplace programs to create cultures of ASD understanding. A pilot research study will recruit 20 diverse individuals with ASD who will visit each institution prior to and after the PD for staff. The research will measure the degree to which the PD impacts attendee experience as well as assess the science learning that occurred because of their visit. This project will advance collaboration between ASD experts and ISI educators to iteratively develop effective museum learning strategies. Other goals of this work are to provide important insights into (a) the current state of accessibility programs in ISI venues nationally, (b) how PD can be leveraged to help institutions reach true inclusion, and (c) initial evidenced-based approaches for inclusion of individuals on the Autism spectrum in mainstream informal environments. In addition to the research findings, deliverables include an ASD PD model, national inventory of current practices and programs that support ASD learning and participation, and the establishment of a Community of Practice.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Judith Koke Jeremy Babendure Christopher Smith