Skip to main content

Community Repository Search Results

resource project Media and Technology
Three-dimensional digital models are increasingly prevalent in preserving tangible and intangible aspects of Indigenous material heritage. Yet, there are no comprehensive, clearly laid-out best practices that can guide researchers, Indigenous communities, and museum personnel in designing ethically sound and socially engaged 3D heritage preservation projects. The use of 3D technologies for heritage preservation and providing public access to digital 3D collections is well-established in the European context. While there have been several robust efforts on digitizing European national heritage, in the U.S. context, the focus often involves work with Indigenous heritage, instantly placing 3D projects into a post-colonial research paradigm with a complex set of ethical ramifications. This research examines emerging thoughts from the European context and connects them with best practices in digital Indigenous data management to identify practices that contribute to cultures of academic integrity that are inclusive of all stakeholder voices. This work fosters ethical cultures of STEM through the development of a comprehensive Responsible Conduct of Research guiding document that can be adapted to address culture-specific Indigenous perspectives as well as project-specific challenges in future 3D heritage preservation endeavors.

Project goals are accomplished through workshops and virtual collaborations that bring together researchers, Indigenous community members, and heritage preservation professionals with previous experience in the responsible management, protection, and sharing of Indigenous digital data and the use of 3D technology for heritage preservation. The collaboratively produced guidelines outline ethical considerations that can be used in developing: 1) partnerships with origin/descendant communities, 2) institution- and collection-specific museum policies on using 3D technology, 3) Tribal policies for culturally appropriate use of 3D technologies, and 4) training material and curriculum that integrates with other research compliance regulations pertaining to heritage preservation. The project explores the questions that have emerged through previous experiences using 3D technologies to preserve Indigenous ancestral heritage. These questions include the factors contributing to developing ethically sound 3D heritage preservation projects; the practices useful in 3D projects to foster a culture of integrity that equally engages academic and Indigenous perspectives; consideration for what constitutes Responsible Conduct of Research in using 3D technologies to preserve Indigenous cultural heritage; and addressing practice-based questions that contribute to understanding ethical challenges in digitally preserving and presenting Indigenous heritage. The project situates 3D modeling and heritage representation as part of the larger discourse on decolonizing core methodologies in museum management and anthropological collection practices. Results from this work can be adapted to training future researchers and digital heritage management professionals and creating meaningful partnerships in heritage documentation. This research cultivates cultures of academic integrity by informing heritage management policy on the critical importance of heritage ethics for the creation and management of 3D digitization projects involving Indigenous collections. This award is funded by the Directorate of Geosciences and the Directorate of Education and Human Resources.
DATE: -
TEAM MEMBERS: Medea Csoba-DeHass Lori Collins
resource project Media and Technology
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.

BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.

A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.

This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
resource project Professional Development, Conferences, and Networks
The informal science education (ISE) sector has an important role to play in addressing current societal issues, including changes in environmental conditions, systemic poverty, and societal responses to natural and manmade disasters. These complex social problems require engaging all sectors of society in deep discussions around science, engineering, technology, and mathematics (STEM) and inclusion, diversity, equity, and access (IDEA). To do this, ISE professionals need training in how to bring in diverse perspectives, support inclusive learning, and provide equal access to institutional policymaking, practices and systems. People from different backgrounds within informal science institutions (ISIs) and local communities bring new perspectives, identify new needs, and foster innovation. This broadening of perspectives is critical to address the complex social problems of the 21st century. A key part of the needed transformations in informal science institutions is the preparation of change agents within the ISE sector capable of reimagining what just and equitable informal science institutions might look like. iPAGE 2.0 is an NSF Advancing Informal STEM Learning (AISL) Innovations in Development project conducted by the Science Museum of Minnesota and the Garibay Group in concert with 27 ISIs from across the US. The overarching goal of the project is to support transformative change toward IDEA in the ISE sector. The project is based on an extension service model of knowledge diffusion which seeks to bridge the knowledge-to-action gap by creating intermediaries that can translate research into practical innovations that can be used by practitioners in ISIs. The project brings together teams of strategically placed individuals within ISIs and prepares them to work with their colleagues to enact research-based practices and practical organizational changes toward greater equity and diversity. This project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This ISE professional development initiative will work with annual first-year cohorts consisting of leadership teams from 4-6 ISIs. Each new cohort will spend 11 days together in a 5-day institute and three 2-day colloquia either virtually or at the Science Museum of Minnesota. Individuals and teams will adapt, implement, and refine ideas, strategies, and tools from the iPAGE 2.0 framework for use within their specific ISI context and broader professional networks and engage in ongoing communication and consultation with the iPAGE 2.0 community. All individuals on the team will develop skills, such as communication and collaboration expertise, to function as change agents acting to transform their organizations with respect to inclusion, diversity, equity, and access (IDEA) in STEM. Participants from previous cohorts will continue their roles as change agents and enhance learning in the iPAGE 2.0 community by sharing what they have learned at iPAGE 2.0 colloquia. The iPAGE 2.0 framework focuses on developing participants' understanding of 1) how structural inequalities function to reproduce social advantage and disadvantage within ISIs and the ISE sector; 2) the barriers, supports, and transmission vectors that contribute to or inhibit a continued shift in the sector toward IDEA within a network of practitioners, organizations, evaluators and researchers; and 3) how to prepare and support diversity change agents within the network. The project will employ a creative evaluation approach that combines developmental, principles-focused, arts-based, and transformative evaluation and an interactive, mixed-methods research study grounded in culturally responsive methodologies to address central questions concerning individual, organizational, and sector change. The project's primary audience is ISE professionals, and the secondary audience is researchers and evaluators working within the ISE sector. The project will work directly with an estimated 122 individuals from 27 ISIs.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: E. Liesl Chatman Cecilia Garibay
resource project Informal/Formal Connections
Mentoring is a widely accepted strategy for helping youth see how their interests and abilities fit with education and career pathways; however, more research is needed to better understand how different approaches to mentoring impact youth participants. Near-peer mentoring can be a particularly impactful approach, particularly when youth can identify with their mentors. This project investigates three approaches to near-peer mentoring of high-school-aged Hispanic youth by Hispanic undergraduate mathematics majors. Mentoring approaches include undergraduates' visits to high school classrooms, mathematics social media, and a summer math research camp. These three components of the intervention are aimed at facilitating enjoyment of advanced mathematics through dynamic, experiential learning and helping high school aged youth to align themselves with other doers of mathematics on the academic stage just beyond them, i.e., college.

Using a Design-Based Research approach that involves mixed methods, the research investigates how the three different near-peer mentoring approaches impact youth participants' attitudes and interests related to studying mathematics and pursuing a career in mathematics, the youth's sense of whether they themselves are doers of mathematics, and the youth's academic progress in mathematics. The project design and research study focus on the development of mathematical identity, where a mathematics identity encompasses a person's self-understanding of himself or herself in the context of doing mathematics, and is grounded in Anderson (2007)'s four faces of identity: Engage, Imagine, Achieve, and Nature. The study findings have the potential to uncover associations between informal interactions involving the near-peer groups of high school aged youth and undergraduates seen to impact attitudes, achievement, course selection choices, and identities relative to mathematics. It also responds to an important gap in current understandings regarding effective communication of mathematics through social media outlets, and results will describe the value of in-person mathematical interactions as well as online interactions through social media. The study will result in a model for using informal near-peer mentoring and social media applications for attracting young people to study and pursue careers in STEM. This project will also result in a body of scripted MathShow presentations and materials and Math Social Media content that will be publicly available to audiences internationally via YouTube and Instagram.

This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Aaron Wilson Sergey Grigorian Xiaohui Wang Mayra Ortiz
resource project Public Programs
The Apsáalooke (Crow Indian) Nation in Montana, as well as other Indigenous communities across the United States, disproportionally experience negative consequences from water-related environmental hazards, such as contaminated water. In this project, fifth- and sixth-grade Apsáalooke youth will act as change agents through investigating water issues in their communities and presenting findings to their communities. They will conduct this water-related research in the context of an informal summer program designed to integrate Indigenous and Western perspectives on science. For example, youth will learn the cultural significance of water sites while also practicing methods for collecting and analyzing data relative to those sites, guided by Apsáalooke elders and science professionals. During the summer program, Indigenous high school students and tribal college students will mentor the youth. To develop this program, the project team will conduct interviews with elders and Apsáalooke community members in scientific fields to determine the desired features of a program that integrates Indigenous and Western science. They will use the findings from these interviews to develop a multimedia toolkit, which includes a set of comprehensive materials that will enable other researchers and informal educators to implement similar programs. This toolkit will include information about water science and water quality, lesson plans and related resources for the summer program, professional development materials to prepare the high school youth to act as mentors, handouts for family members to facilitate at-home engagement with their children, and more. The project team will research how the implementation of the toolkit influences the participants' water-related knowledge and attitudes toward science. The toolkit, and the associated empirical findings, will be disseminated widely through local, regional, and national professional networks that serve American Indians.

Montana State University, in partnership with Little Big Horn College, will implement and research an informal summer program for Apsáalooke youth in the fifth and sixth grades, as well as a mentorship program for Indigenous high school students and tribal college students. The older students will participate in a four-week internship program in which they learn about conducting water research and facilitating science activities that foreground Apsáalooke perspectives and cultural practices. The high school and tribal college students will partner with Apsáalooke elders and science professionals to facilitate and implement a two-week summer program for the fifth- and sixth-grade youth. This program will use the toolkit materials that were previously developed in consultation with elders and other community stakeholders. Regression analyses of validated pre- and post-surveys, as well as inductive analyses of interviews with stakeholders, will be used to study how the mentoring program affects the high school and tribal college students' attitudes toward science and career interests, and how the summer program affects the fifth- and sixth-graders' water-related knowledge. The research team will also study how youth participation in the program affects their family and community members' water-related knowledge. This project will result in a multimedia toolkit, freely available to the public and widely disseminated through professional networks, which specifies how other informal educators and researchers can implement similar mentorship programs and summer programs for Indigenous youth. Ultimately, this project will broaden participation through resulting in empirically-tested materials that advance practice in informal education for Indigenous youth and their communities. This project is funded by the Advanced Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, the AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (science, technology, engineering, and mathematics) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Vanessa Simonds
resource project Public Programs
The U.S. Fish and Wildlife Service estimates that over 41 million people connect to nature through birding. Learning about birds in their natural environments offers opportunities for informal engagement in STEM by a broad range of individuals and groups. Birders often engage in scientific data gathering and analyses, geolocation and remote sensing, and phenology. They also become aware of ecological changes in bird habitats and migratory patterns due to rising temperatures and climate-related events like sea level rise, droughts, fires, and extreme weather. As such, the birding community is an ideal network to better understand and communicate the impacts of climatological changes on bird populations to the public. With this Innovations in Development project, the National Audubon Society will develop a new avian-focused, conservation and climate science community science curriculum for its Nature Centers, and test the effectiveness of the curriculum in educating the public about avian-focused conservation and climatological changes through guided nature experiences. Birding can serve as a pivotal entrée for young people into STEM fields and careers. Through its programs and partnerships, Audubon will leverage its national network to ensure that through this project a more diverse group of voices, particularly young adults and young adults of color, become involved in asking critical questions and developing solutions to address important environmental issues of the future. If successful, the broader impacts of this project on capacity building and public engagement could be far-reaching and long-lasting.

Over the three-year project duration, Audubon will bring educators from its nationwide network of thirty-four Nature Centers (including urban, suburban, and rural sites), together with over 510 young adults (ages 18-25) from its network of college campus chapters. An evidence-based curriculum and community science activities will be created and tested, relying heavily on a team of experts in ornithology, climate science research, STEM curriculum design, diversity, and informal science education. College students will advise on the design of content and activities to effectively interest and engage young adults. These students will be recruited from the new Audubon Campus Chapters Program, which includes 111 college and university campuses, among them, 19 Historically Black Colleges and Universities (HBCUs) and other Minority Serving Institutions (MSIs). The target population will be surveyed to also understand their current and likely participation in guided nature experiences and knowledge base in climate science. Current best practices in guided nature experiences will be gathered from across the Audubon network. The implementation efforts will result in a national STEM model, with train-the-trainer guides and workshops for informal science educators and public engagement opportunities focused on improving the state and condition of avian habitats and communities through climate science research. An external evaluation will be conducted and will include data collection methods such as retrospective pre and post surveys, semi-structured interviews, focus groups, and an embedded assessment to determine impact. The findings will be used to iteratively refine the evidence-based curriculum and measure STEM learning outcomes for the guided nature experience participants. The evaluation will address four areas: (1) fidelity of program implementation to promote accountability; (2) formative evaluation to understand needs and interests of young adults (ages 18-25), and subsequently inform program design; (3) outcomes for Center educators, to inform iterative improvement; and (4) outcomes for program participants, to contribute to the growing knowledge base on effective practices for STEM learning in informal settings.

This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Loren Smith Mark Scallion Heather Starck
resource project Media and Technology
This project will teach foundational computational thinking (CT) concepts to preschoolers by creating a series of mobile apps to guide families through sequenced sets of videos and hands-on activities. To support families at home it would also develop a new library model to build librarians' computational thinking content knowledge and self-efficacy so they can support parents' efforts with their children. Computational thinking is a an increasingly critical skill for learning and success in the workforce. It includes the ability to identify problems, brainstorm and generate solutions and processes that can be communicated and followed by computers or humans. There are few projects that introduce computational thinking to young children. Very little research has been done on the ways that parents can facilitate children's engagement in CT skills. And developing a model that trains and supports librarians to become virtual coaches of parents as they engage with their children in CT, will leverage and build the expertise of librarians. The project's target audience includes parents and children living in rural areas where access to CT learning may be very limited. Project partners include the EDC, a major research organization, the American Library Association, and BUILD, a national association that promotes collaborations across library, kindergarten readiness, and public media programming.

The formative research study asks: 1) What supports do parents of preschoolers in rural communities need in order to effectively engage in CT with their children at home? and 2) How can libraries in rural communities support joint CT exploration in family homes? The summative research study asks: 3) how can an intervention that combines media resources, mobile technology, and library supports foster sustained joint parent/child engagement and positive attitudes around CT? Researchers will develop a parent survey, adapting several scales from previously developed instruments that ask parents to report on children's use of CT-related vocabulary and CT-related attitudes and dispositions. Survey scales will assess librarians' attitudes towards CT, as well as their self-efficacy in supporting parents in CT in a virtual environment. During the formative study, EDC will pilot-test survey scales with 30 parents and 6 librarians in rural MS and KY. Analyses will be primarily qualitative and will be geared toward producing rapid feedback for the development team. Quantitative analyses will be used on parent app use, using both time query and back-end data, exploring factors associated with time spent using apps. The summative study will evaluate how the new media resources and mobile technology, in combination with the library virtual implementation model, support families' joint engagement with CT, and positive attitudes around CT. The researchers will recruit 125 low-income families with 4- to 5-year-old children in rural MS and KY to participate in the study. They will randomly assign families within each library to the full intervention condition, including media resources, mobile technology, and library support delivered through the virtual implementation model, or the media and mobile-technology-only condition. This design will allow researchers to understand more fully the additional benefit of library support for rural families' sustained engagement, and conversely, see the comparative impact of a media- and mobile-technology only intervention, given that some families might not be able to access virtual or physical library support.

As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Marisa Wolsky Heather Lavigne Jessica Andrews Janna Kook
resource project Media and Technology
Refugee youth are particularly vulnerable to STEM disenfranchisement due to factors including limited or interrupted schooling following displacement; restricted exposure to STEM education; and linguistic, cultural, ethnic, socioeconomic, and racial minority status. Refugee youth may experience a gap in STEM skills and knowledge, and a conflict between the identities necessary for participation in their families and communities, and those expected for success in STEM settings. To conduct research to better understand these challenges, an interrelated set of activities will be developed. First, youth will learn principles of physics and computing by participating in cosmic ray research with physicists using an instructional approach that builds from their home languages and cultures. Then youth periodically share what they are learning in the cosmic ray research with their parents, siblings, and science teachers at family and community science events. Finally, youth conduct reflective research on their own STEM identity development over the course of the project. Research on learning will be conducted within and across these three strands to better understand how refugee youth develop STEM-positive identities. This project will benefit society by improving equity and diversity in STEM through (1) creating opportunities for refugee youth to participate in physics research and to develop computing skills and (2) producing knowledge on STEM identity development that may be applied more broadly to improve STEM education. Deliverables from this project include: (a) research publications on STEM identity and learning; (b) curriculum resources for teaching physics and computing to multilingual youth; (c) an online digital storytelling exhibit offering narratives about belonging in STEM research which can be shared with STEM stakeholders (policy makers, scientists, educators, etc.); and (d) an online database of cosmic ray data which will be available to physicists worldwide for research purposes. This Innovations in Development proposal is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This program is designed to provide multiple contexts, relationships, and modes across and within which the identity work of individual students can be studied to look for convergence or divergence. To achieve this goal, the research applies a linguistic anthropological framework embedding discourse analysis in a larger ethnography. Data collected in this study include field notes, audio and video recordings of naturalistic interactions in the cosmic ray research and other program activities, multimodal artifacts (e.g., students' digital stories), student work products, interviews, and surveys. Critically, this methodology combines the analysis of identity formation as it unfolds in moment-to-moment conversations (during STEM learning, and in conversations about STEM and STEM learning) with reflective tasks and the production of personal narratives (e.g., in digital stories and interviews). Documenting convergence and divergence of STEM identities across these sources of data offers both methodological and theoretical contributions to the field. The research will offer thick description of the discursive practices of refugee youth to reveal how they construct identities related to STEM and STEM disciplines across settings (e.g., during cosmic ray research, while creating digital stories), relationships (e.g., peer, parent, teacher), and the languages they speak (e.g., English, Swahili). The findings will be of potential value to instructional designers of informal learning experiences including those working with afterschool, museums, science centers and the like, educators, and scholars of learning and identity.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Tino Nyawelo John Matthews Jordan Gerton Sarah Braden
resource project Exhibitions
Museums and similar informal learning settings offer opportunities for children and families to learn together in an engaging way. Current exhibits rely mainly on parents, teachers, signage, and staff in science museums to provide support and guidance. Since it is not always feasible to have knowledgeable staff on hand and not all parents have the same knowledge and background, children receive varied support and people often miss the point of the learning experience or activity. This project will develop and research a new genre of Smart Science Exhibits that use artificial intelligence (AI) in an adaptive system to support children in learning science by doing science. The aim of the project is to incorporate AI adaptivity and personalization to maximize inquiry-based STEM learning and engagement in informal learning settings. This research builds on the project team's first Smart Science Exhibit (EarthShake), which uses AI vision to give interactive feedback to visitors based on their actions and guides them through scientific inquiry. In the project's preliminary work, the first smart exhibit demonstrated higher engagement and more learning gains than resulted from a traditional museum exhibit addressing the same scientific content. Smart exhibits can extend and enhance the limited support that staff and parents can provide. This project will develop and investigate adaptive approaches to mixing exploration and AI guidance, which will personalize feedback during constructive exploration. The project will build on learning science techniques and technology, proven in intelligent tutoring systems in formal settings, and apply this to different informal learning contexts. The goal is to provide just-in-time learning support, which will extend the time visitors spend with exhibits, thereby deepening inquiry-based science learning. The project is partnering with science museums and afterschool programs, which will enable thousands of children and families from a wide variety of backgrounds to use the project's smart exhibits each year. Smart Science Exhibits is funded by the Advancing Informal STEM Learning (AISL) program which supports innovative research, approaches, and resources as part of its overall strategy to enhance learning in informal environments.

Many informal learning settings are considering mixed-reality (MR) technologies to increase engagement and understanding of science. Using Smart Science Exhibits, the project will investigate how design choices in mixed-reality systems impact users' engagement and learning of STEM concepts. (Mixed reality is the blending of the physical world and the digital world, enabling interaction between human and artificial intelligence.) Project research will extend current research, which is largely descriptive, by investigating empirical results on learner outcomes. Key research questions are: What types of adaptivity and personalization can improve Smart Science Exhibits and MR systems generally? What balance of exploration and AI guidance is best to maximize enjoyment, engagement and learning? Do findings about the effective features of Smart Science Exhibits generalize to different content areas and informal learning settings? The project will employ user-centered design research, formative evaluation, and controlled experimentation to discover how mixed-reality systems should be designed to best meet visitor and staff needs in informal learning settings including multiple museums and afterschool providers. Data on learner behaviors in mixed-reality experiences in a variety of informal settings will inform the design of Smart Science Exhibits. The project will investigate whether adaptive approaches generalize across content and context to achieve better STEM learning, engagement, collaboration, and productive dialogue. The project will incorporate the team's prior technical research, which developed both vision techniques to track children's physical interactions and interactive pedagogical techniques to provide scaffolds for and reactive feedback on children's inquiry and construction behaviors. New technical research will develop AI techniques for adaptive task selection and personalized feedback that draws on a visitor's history of interaction. Project research and design resources will be widely shared with the science museum educators and designers through presentations at annual conferences and with researchers, developers and others through peer-reviewed journal publications and professional publications.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Nesra Yannier Scott Hudson Ken Koedinger
resource project Exhibitions
The Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. An ongoing challenge to the design of effective STEM learning exhibits for diverse young children is the absence of reliable and evidence-based resources that designers can apply to the design of STEM exhibits that draw upon play as a child's primary pedagogy, while simultaneously engaging children with STEM content and processes that support development of STEM skills such as observation. To address these challenges, the project team will use a collaborative process in which learning researchers and informal STEM practitioners iteratively develop, design, and test the STEM for Play Framework that could then be applied to the design of STEM-focused exhibits that support play and STEM skill use among early learners.

This Research in Service to Practice project will address these questions: 1) What is a framework for play in early STEM learning that is inclusive of children's cultural influences?; 2) To what extent do interactions between early learners (ages 3-8) and caregivers or peers at exhibits influence the structure and effectiveness of play for supporting STEM skill development?; 3) How do practitioners link play to STEM skill development, and to what extent does a framework for play in early STEM learning assist in identifying types of play that supports early STEM skill development?; and 4) What do practitioners identify as best practices in exhibit design that support the development of STEM skills for early childhood audiences, and conversely, to what extent do practitioners perceive specific aspects of the design as influential to play? The project team will address these questions across four phases of study that will include (a) development of a critical research synthesis to inform the initial STEM for Play framework; (b) the use of surveys, focus groups, and interviews to solicit feedback from practitioners; (c) testing and revising the framework by conducting structured observations of STEM exhibits at multiple museums. The project team will use multiple analytic approaches including qualitative thematic analyses as well as inferential statistics. Results will be disseminated to children?s museums, science centers, and research communities.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
resource project Public Programs
Over the past two decades the prevalence of Autism Spectrum Disorder (ASD) has nearly tripled and yet there is much to learn about serving this audience well. After high school exit, most are left to navigate the world without appropriate support or the requisite skills necessary for success. Educators working in informal science institutions (ISI) can better promote both social interaction and engagement in STEM education for individuals with ASD. A learning environment in which the learner chooses content aligned with their personal interests and where learning can be multifaceted (verbal, hands-on, fast or slow, social or solitary, directed or inquiry based, physical, etc.) is consistent with the central tenets of an evidence-based, outcome-driven approach for autism intervention. ISI educators have the desire but may not have sufficient and timely knowledge and skills to engage and support this audience. Currently, many are working at the local level to develop new programs and approaches for patrons with ASD, with little evaluation or research and not building on each other's work. The project will develop a rigorous customized professional learning experience designed to enhance capacity of ISIs broadly in ASD support techniques and strategies. The goal is to enable more inclusive opportunities for people with ASD based on current and emerging promising practices. The project's theory of action is that the ability of people with ASD to participate in traditional, mainstream experiences will improve their motivation to seek other similar opportunities, build interpersonal skills critical to successful interaction in society, formal education, and careers. This, in turn, will help individuals with ASD gain the skills and confidence needed to pursue STEM academically and professionally. The project is a collaboration between the Institute for Learning Innovation, the SciTech Institute, and the Southwest Autism Research & Resource Center (SARRC). This project is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.

The pilot's main research questions are: (1) To what degree does the professional learning program support the learning outcomes in knowledge, awareness, interest, skills, attitude, and behavior change in informal science education providers? and (2) What features of the program do educators consider most effective for improving their ability to serve this audience? Four Arizona ISIs will participate in a research-based design study; their staff will also comprise the founding members of a Community of Practice aimed at sharing promising practices and promoting broader engagement among the informal science education community. The professional development (PD) will be provided by SARRC. New formative evaluation skills will support ongoing innovation and build participant capacity. Leveraging this training, the ISIs will create and test new approaches and programs, apply new skills in formative evaluation, and develop internal workplace programs to create cultures of ASD understanding. A pilot research study will recruit 20 diverse individuals with ASD who will visit each institution prior to and after the PD for staff. The research will measure the degree to which the PD impacts attendee experience as well as assess the science learning that occurred because of their visit. This project will advance collaboration between ASD experts and ISI educators to iteratively develop effective museum learning strategies. Other goals of this work are to provide important insights into (a) the current state of accessibility programs in ISI venues nationally, (b) how PD can be leveraged to help institutions reach true inclusion, and (c) initial evidenced-based approaches for inclusion of individuals on the Autism spectrum in mainstream informal environments. In addition to the research findings, deliverables include an ASD PD model, national inventory of current practices and programs that support ASD learning and participation, and the establishment of a Community of Practice.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Judith Koke Jeremy Babendure Christopher Smith
resource project Exhibitions
The science museum field is only starting to look at ways of providing visitors with opportunities for the authentic observation of complex, real-time biological phenomenon. The project will develop and research a microscope-based exhibit with pedagogical scaffolding (i.e., helpful prompts) that responds to visitors' changing views as they explore live samples and biological processes. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. Scientific observation is a systematic, complex practice, critical in the biological sciences where investigation is heavily reliant on visual data. Using techniques and equipment similar to what scientists themselves use, the exhibit will enable visitors to see and explore the complex, dynamic visual evidence that scientists themselves see. The exhibit will use new and more affordable high-resolution imaging technology and image analysis software to make microscopic images of living organisms visible. Armed with "smart" (i.e., computer-assisted) pedagogical scaffolding that supports inquiry, the project will develop exhibits that help informal learners bridge the gap between everyday observation and authentic scientific observation. The platform will incorporate strategies grounded in prior work on learning through observation that will be applicable to a range of biological content and live specimens. The project platform will be designed for use to a variety of informal science learning environments, including nature centers and mobile laboratories as well as interactive science centers. The project platform itself, including the microscope, related imaging, and learning technologies will be relatively inexpensive, bring it within reach of small science museum and schools. The exhibit will directly engage thousands of learners who visit the Exploratorium and will reach underserved audiences through partnerships with BioBus, a mobile unit that serves the New York City area, and the Noyo Center of Marine Science, a science museum that serves rural areas in Northern California.

The project will move beyond simulation and modeling of complex visual phenomena and provide learners with experiences using real visual evidence that can deeply engage them with the content and practice of biological science. By grounding the work in prior theoretical and empirical findings, project research will refine and broaden understanding of scaffolding strategies and their effect on informal science learning at exhibits. Project research will investigate how the project supports learners (1) asking productive questions (i.e., those answerable through observations) that are meaningful to them, (2) interpreting what they see, and (3) connecting their observations to biological concepts to build a more coherent understanding of the content and practice of biological disciplines. A series of comparative studies across and within venues, specimens, and content will assess engagement and scaffolding strategies, with a particular focus on appropriately integrating computational imaging techniques in a way that is responsive to the interests and needs of different venues' audiences. Project research will contribute important knowledge on ways to support informal learners who are engaged in authentic observation of biological phenomenon. Project research findings and technology resources will be widely shared with informal STEM researchers and practitioners concerned with engaging the public in current research in biology, as well as those interested in supporting observation in other disciplines (e.g., meteorology, ocean science, environmental science) that rely on an evidence base of live, dynamic, complex imagery.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Kristina Yu Daniel Fletcher Joyce Ma