Skip to main content

Community Repository Search Results

resource project Public Programs
Many people with autism are unemployed and isolated because they do not have access to educational opportunities that support them in finding jobs that match their potential. This research seeks to empower adolescents with autism to seek out careers that are well-matched with their strengths and interests. Many people with autism are interested in computing, a marketable skill. This project builds from this interest by developing strategies to effectively engage teenagers with autism. Although people with autism share a diagnosis, each person is unique and has the capacity to become a visionary and transformer in society in their own way. Teenagers with autism will be invited to participate in a game design workshop hosted by an award-winning, not-for-profit Tech Kids Unlimited. Teenagers often enjoy learning how to design games and can learn many useful skills through design. During each workshop, teenagers will rate different teaching strategies using a picture-based survey developed in collaboration with people with autism. It is expected that teenagers with autism who have difficulty focusing to be most engaged by strategies that include multiple types of information (for example, pictures, text, and speech). The team also expects those who are more focused to be most engaged by strategies with fewer sources of information. By developing clear guidelines to help educators match their teaching styles to how different students learn, the project will help them engage youth more effectively. Through an iterative process, the team will revise the game design workshop to make it more engaging for people with different types of autism. New groups of teenagers with autism will participate in improved game design workshops that include an internship in a technology company. An important outcome is to understand which strategies are engaging for young people with autism that help them develop the belief in their skills needed to seek out fulfilling careers. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.

This Research in Service to Practice project has the following aims: 1) Identify evidence-based strategies to engage youth with autism spectrum disorder (ASD) in informal STEM learning opportunities that are well matched to their attentional profiles, 2) Determine if engaging youth with ASD in informal STEM learning opportunities increases their STEM self-efficacy, and 3) Determine if engagement with STEM internship activities is associated with increased interest in STEM careers and career decision-making self-efficacy. Principles of Universal Design (UD) and Mayer's principles of effective multimedia instruction are frameworks employed to identify instructional strategies that are emotionally engaging for youth with diverse attentional profiles. The degree to which attentional differences contribute to different patterns of emotional engagement with informal STEM learning will be investigated. Guided by assessments of youth's engagement with different learning opportunities, 'diversity blueprints' or specific instructional strategies that help youth with diverse attentional profiles engage will be developed. After identifying strategies to engage neurodivergent (neurologically diverse) youth in informal STEM learning opportunities, the extent to which these strategies generalize to STEM internship sites will be explored. The team will study potential specificity of the types of contexts that promote different types of self-efficacy, with engagement with extracurricular STEM learning opportunities expected to preferentially target STEM self-efficacy while engagement with internships targets career decision-making self-efficacy. Although UD is often endorsed to promote STEM learning among students with disabilities, the proposed research would be the first iterative adaptation of instructional strategies designed to engage neurodivergent teens in informal STEM learning guided by a systematic analysis of how they engage with and feel about instructional strategies. Project deliverables include workshops for local after-school program providers, publications, a project website, and a multimodal guide of the process of developing 'diversity blueprints' and how to apply them for informal STEM educators and researchers.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Amy Hurst Katie Gillespie
resource project Professional Development, Conferences, and Networks
The impacts of changes in the climate at local and global levels threaten how people live. Some frontline communities, especially in historically disenfranchised and under-resourced areas, are particularly vulnerable to the devastating effects of climatological events such as wildfires, flooding, and urban heat islands. As such, there is an urgent need for collective, evidence-based understanding and engagement to prevent and prepare for these potentially fatal events. Led by the Oregon Museum of Science and Industry (OMSI) in Portland, Oregon, in collaboration with local and national partners, Youth Lead the Way is an early-stage Innovations in Development project that offers a theory-based approach for youth in climatologically vulnerable communities to work in climate science research alongside field researchers, develop leadership skills, and engage in timely conversations that impact their own communities. The project will develop and evaluate a Youth Advisory Research Board model to equip and support youth and informal STEM education institutions to conduct evidence-based research on local climate impacts and communicate the findings of their research to their communities. Youth Lead the Way advances the work of several previous NSF-funded projects on climate education, youth advisory boards, and collaborative networks to engage the public in informal STEM learning. Findings from this project will support ongoing efforts in the informal STEM education field to meaningfully engage youth and to more effectively communicate science related to climate and its impacts to the public.

During this initial two-year early-stage project, youth predominantly from racial and ethnic groups underrepresented in STEM will engage in a year-long extended STEM experience. These youth will work collaboratively with scientists and museum professionals to enhance their skills as climate researchers, science communicators, and educational leaders, while reaching an estimated 4,000 or more public audience members through research and events at OMSI, in their schools, and in their communities. Using a cohort model, the youth will conduct scientifically based research studies on various local climate impact topics while concurrently serving in an advisory role at the Oregon Museum of Science and Industry, where they will participate in shaping relevant museum programs and practices. The youth will also develop and present climate stories, a communication approach based on storytelling, to raise public understanding and awareness about local climatological changes and impacts. In addition to the youth component, a companion workshop will be held at the Sciencenter in Ithaca, New York, a partner organization, to train staff and formatively assess the feasibility of scaling the model in other museums. At the program level, an exploratory qualitative research study will be conducted to identify the factors of the overall model that contribute to desired outcomes of youth engagement, climate impact education, and informal science education professional development. Interviews, surveys, focus groups, group chats among youth cohort members, and reviews of artifacts generated by the youth will inform this exploratory study. A theory-based guide outlining key findings, considerations, and recommendations will also be produced. The dissemination of this work will be multi-tiered, reaching thousands within the target communities through public programs, professional networks, at conferences, and a live virtual professional development event hosted by the Association for Science-Technology Centers. If successful, Youth Lead the Way will lay the groundwork for a model that promotes youth and public engagement in STEM through climate science research and identifies promising pathways for future research and similar efforts well beyond this project.

This early-stage Innovations in Development project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Scott Randol Christopher Cardiel Rebecca Reilly Jennifer Schwade Imme Huttmann Carla Herran Marcie Benne Todd Shagott Maria Zybina
resource project Exhibitions
Very little is known about the experiences of people with learning disabilities in informal learning environments such as science centers and museums. This project will describe the ways in which engagement and intrinsic motivation for learning are and are not supported for visitors with learning disabilities, and build capacity for informal STEM education practitioners to apply this learning for the benefit of those with learning disabilities as well as any visitor who needs more support in the context of self-directed learning. Broadening participation science, technology, engineering and math (STEM) is a core goal of the National Science Foundation and its Advancing Informal STEM Learning (AISL) program. This project pursues this goal with a focus on young people with learning disabilities. As the largest group of individuals with disabilities in the United States, people with learning disabilities make up an estimated 20% of the U.S. population. Science professions offer many life- and work-related opportunities for individuals with learning disabilities, and the flexible experiences of informal learning spaces offer important opportunities to promote participation, engagement in and motivation for science. This work represents the next generation of accessible design to broaden participation in, and impacts of, informal STEM learning opportunities. This project will generate guidelines and resources to support inclusive design for this group of visitors. Resources will include a Toolkit of Visual Assets that can be shared digitally and in print with youth with learning disabilities, informal STEM practitioners, and the learning disability research and practice community.

The project will develop empirical knowledge to support informal STEM practitioners to better facilitate the inclusion of youth with learning disabilities. Using the lens of Self-Determination Theory as an explanatory framework, this research will be pursued in three phases. Self-Determination Theory describes the psychological needs that must be met, such as autonomy and feelings of efficacy, to create an environment that supports individuals' engagement in self-motivated behaviors. Phase 1 will be an exploratory study describing the engagement and motivation of adolescents (ages 10-17) with learning disabilities when experiencing varied STEM exhibits. This first phase will adapt validated scales, employ an existing observation protocol, and conduct stimulated recall interviews with youth. Phase 2 will explore, develop and investigate design strategies to improve the intrinsic motivation of youth with learning disabilities at educational STEM exhibits. This second phase will involve a set of experimental studies in which design strategies related to intrinsic motivation are manipulated to inform principles of inclusive design for visitors with learning disabilities. As in the previous phase, Phase 2 will adapt validated scales and employ an existing observation protocol. Phase 3 will focus on design charrettes in which researchers and practitioners work with high school students with learning disabilities in a co-design process. The charrettes will generate guidelines and case examples of exhibit components using Universal Design for Learning to balance varying design priorities and effectively, inclusively design exhibits for this population. This third phase will rely on qualitative coding of co-design charette artifacts, field notes and researcher reflections; member checking will play an important role in the coding process. Dissemination efforts for this project will target youth with learning disabilities, informal STEM education practitioners, and the broader field of learning disability researchers and practitioners. In addition to the exhibit design guidelines and Toolkit described above, the project will publish peer reviewed articles and develop manuscripts aimed at educational research and practice.

This Research in Service to Practice project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
resource project Media and Technology
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This pilot and feasibility project addresses the needs of youth (ages 10-19) who are deaf or hard of hearing and use either English or American Sign Language as their preferred method of communication. The project will develop and study video stories from members of the STEM workforce who are deaf or hard of hearing. Youth will view these videos on the web at home or at an afterschool program. These stories will help the youth become aware of the range of STEM careers that are available and their potential to pursue and succeed in these occupations. One of the biggest challenges young persons who are deaf or hard of hearing face is not having role models who are members of the STEM workforce. Without these role models they are not aware of the possibility that they could work in these fields. Several studies indicate that seeing other people with disabilities having success in STEM boosts self-confidence. Exposure to deaf role models allows deaf student to identify with successful deaf people and consequently believe they themselves could accomplish goals they previously thought out of their reach. Project collaborators include Gallaudet University Regional Center, Northeast Deaf & Hard of Hearing Service, Boys & Girls Club of Lynn, MA, and Bridge Multimedia.

The project will advance knowledge in the field of deaf education in informal settings. The research questions are: 1) How do adolescents who are deaf or hard of hearing integrate and use digital versions of firsthand stories from members of the STEM workforce? 2) How do parents and club leaders make use of the stories? 3) What kind of outcomes are made possible by using the stories such as interest in STEM careers 4) What modifications and additional would improve the stories to make them more useful and effective? 5) What dissemination strategies would maximize story use? The project will do a formative evaluation of the pilot videos using a sample of 30 family groups and 10 boys? and girls? participants. Families will meet with researchers at one of the collaborating institutions (Gallaudet University Regional Center East, Northeast Deaf & Hard of Hearing Service or TERC) depending on where they live. The researcher will work with one family or adolescent at a time. They will view the videos on a computer while the researchers observe and record data. After viewing the videos, researchers will ask them questions about what they learned, what might be added, changed, or improved. They will be asked to look at the videos later on their home computers and do things such as select a STEM career for further research. Additional data collection will involve completing a post-use online survey for adolescents and their parents.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Judy Vesel
resource project Public Programs
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.

Making, which supports interest-driven skill-development and learning, has been recognized as having the potential to engage underserved youth in STEM. Makerspaces are community spaces that allow participants to create items using tools, such as 3-D printers, computer-aided design, and digital fabrication technologies. Makerspaces and making-related programs are often inaccessible, unaffordable, or simply not available to underserved youth. Digital Harbor will partner with recreation centers, two in Pittsburgh and two in Baltimore, to research, refine and implement an equity-based approach to making that will engage underserved youth aged 12-16 in making. The project will prepare out-of-school time (OST) educators to collaboratively develop culturally sensitive curricula with underserved youth to engage them in maker-based technology and computer science experiences. The project will (1) design a professional development program that will prepare and support local educators to collaboratively design and deliver localized, maker-based, STEM curricula; (2) research the impact of these programs on both educators' and youth's self-efficacy, creativity, and attitudes towards STEM; and (3) develop and evaluate an online Localization Toolkit that will prepare educators in makerspaces across the nation in using an equity-based approach to create localized content. The project will result in four new maker sites (two in Baltimore and two in Pittsburgh directly impact 4 sites (10 educators and 240 youth). The project will result several resources that will support the development and educational programs of other community sites. The resources will include the Localization Toolkit, Case Studies, Best Practices, and Research Study. The Localization Toolkit has the potential to strengthen infrastructure and capacity building in OST maker-based programs, as well as other informal and formal education programs using similar pedagogies and design principles.

The project will use a mixed-methods approach in researching the challenges and processes involved in establishing the four maker sites in Baltimore and Pittsburgh, the approaches and effectiveness of the professional development program on OST educators, and the impacts of the project of participation on the self-efficacy, creativity, and attitudes on participating youth and educators. The research study will apply several instruments and data collection sources to develop quantitative data, including youth attendance logs, the Upper Elementary and Middle/High School Student Attitudes toward STEM survey, a retrospective technology self-efficacy survey and pre-post surveys. In addition to project document review, the researchers will collect qualitative data through educator interviews, educator focus groups, and youth focus groups. Project research and resources will reach key audiences of learning scientists and OST educators through articles in peer-reviewed and practitioner journals, public events and professional conferences. These audiences will also be reached through the project website, which will share project resources. The project will reach OST sites across the country directly through dissemination partners, including the National Recreation and Parks Association, Association of Science and Technology Centers, and statewide out-of-school networks.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Foad Hamidi Andrew Coy
resource project Media and Technology
Virtual Reality (VR) shows promise to broaden participation in STEM by engaging learners in authentic but otherwise inaccessible learning experiences. The immersion in authentic learner environments, along with social presence and learner agency, that is enabled by VR helps form memorable learning experiences. VR is emerging as a promising tool for children with autism. While there is wide variation in the way people with autism present, one common set of needs associated with autism that can be addressed with VR is sensory processing. This project will research and model how VR can be used to minimize barriers for learners with autism, while also incorporating complementary universal designs for learning (UDL) principles to promote broad participation in STEM learning. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will build on a prototype VR simulation, Mission to Europa Prime, that transports learners to a space station for exploration on Jupiter's moon Europa, a strong candidate for future discovery of extraterrestrial life and a location no human can currently experience in person. The prototype simulation will be expanded to create a full, immersive STEM-based experience that will enable learners who often encounter cognitive, social, and emotional barriers to STEM learning in public spaces, particularly learners with autism, to fully engage and benefit from this STEM-learning experience. The simulation will include a variety of STEM-learning puzzles, addressing science, mathematics, engineering, and computational thinking through authentic and interesting problem-solving tasks. The project team's learning designers and researchers will co-design puzzles and user interfaces with students at a post-secondary institute for learners with autism and other learning differences. The full VR STEM-learning simulation will be broadly disseminated to museums and other informal education programs, and distributed to other communities.

Project research is designed to advance knowledge about VR-based informal STEM learning and the affordances of VR to support learners with autism. To broaden STEM participation for all, the project brings together research at the intersection of STEM learning, cognitive and educational neuroscience, and the human-technology frontier. The simulation will be designed to provide agency for learners to adjust a STEM-learning VR experience for their unique sensory processing, attention, and social anxiety needs. The project will use a participatory design process will ensure the VR experience is designed to reduce barriers that currently exclude learners with autism and related conditions from many informal learning opportunities, broadening participation in informal STEM learning. Design research, usability, and efficacy studies will be conducted with teens and adults at the Pacific Science Center and Boston Museum of Science, which serve audiences with autism, along with the general public. Project research is grounded in prior NSF-funded research and leverages the team's expertise in STEM learning simulations, VR development, cognitive psychology, universal design, and informal science education, as well as the vital expertise of the end-user target audience, learners with autism. In addition to being shared at conferences, the research findings will be submitted for publication to peer-reviewed journals for researchers and to appropriate publications for VR developers and disseminators, museum programs, neurodiverse communities and other potentially interested parties.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Teon Edwards Jodi Asbell-Clarke Jamie Larsen Ibrahim Dahlstrom-Hakki
resource project Public Programs
The role of afterschool programs in the science, technology, engineering, and mathematics (STEM) learning ecosystem has grown over the past two decades, which has led to increasing efforts to support and improve program quality. These efforts include developing STEM programs and curricula, creating standards for facilitating informal STEM learning experiences, building networks of support, and developing tools for assessment and evaluation. However, such efforts may have limited impact in terms of ongoing quality improvement. STEM curricula vary in disciplinary focus, quality and may not apply to local contexts and needs. Many afterschool programs resort to using simple STEM kits or online activities rather than rigorous curricula with support for educators. The project will study how the California Department of Education's (CDE) efforts to change organizational culture to support continuous quality improvement (CQI) have affected the offerings and quality of afterschool STEM in the state's more than 4,500 publicly funded afterschool sites. The EPISTEMIC project will contribute new research findings on how CQI can increase access to higher quality STEM learning opportunities for underserved youth. Even more important, the project will provide new insights on how organizational culture affects participation in and implementation of afterschool CQI.

The team will use an organizational theory framework and a mixed methods approach to conduct three research activities: (1) Describe the organizational context through interviews, participant observations, and artifact analysis to map and describe the overall support system as a context for understanding organizational culture change; (2) Describe change over time in organizational culture, CQI processes, and STEM program offerings and quality through surveys/interviews of afterschool youth, staff, directors, and grantee representatives; and (3) Generate explanations about the relationships between organizational culture, CQI, and STEM quality in different contexts through in depth case studies. Bringing organizational culture, CQI, and STEM offerings and quality into shared focus is the most important intellectual contribution of this work. Organizational theory's sensemaking concept will guide analyses to describe, exemplify, and generate theoretical explanations for patterns in organizational culture, CQI, and STEM program changes, with attention to relevant contextual factors.

Continuous quality improvement provides tools for afterschool STEM staff to identify needs and ways to improve. The EPISTEMIC study will contribute recommendations on the systemic, organizational, and cultural aspects of improvement strategies relevant to policymakers, funders, support providers, and afterschool organizations in California, as well as other state or nongovernmental support systems around the country. The study will also produce CQI guidelines for reflecting on and incorporating changes to organizational culture as part of CQI for afterschool staff and site directors. These will be helpful for practitioners around the country. The study's focus on three organizational contexts -- school district, national afterschool, and local afterschool -- will extend the relevance of the findings and recommendations, which will be disseminated through forums, workshops, and articles in practice and policy-oriented publications. The study will also benefit the research community by providing a framework and methods for studying organizational culture and CQI. The findings on the relationships between organizational culture, CQI, and STEM offerings and outcomes will provide a foundation for further research on how these relate to STEM learning outcomes for youth. EPISTEMIC is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Patrik Lundh Andrea Beesley Timothy Podkul Carrie Allen
resource project Exhibitions
There is a dearth of prominent STEM role models for underrepresented populations. For example, according to a 2017 survey, only 3.1% of physicists in the United States are Black, only 2.1% are Hispanic, and only 0.5% are Native American. The project will help bridge these gaps by developing exhibits that include simulations of historical scientific experiments enacted by little-known scientists of color, virtual reality encounters that immerse participants in the scientists' discovery process, and other content that allows visitors to interact with the exhibits and explore the exhibits' themes. The project will develop transportable, interactive exhibits focusing on light: how we perceive light, sources of light from light bulbs to stars, uses of real and artificial light in human endeavors, and past and current STEM innovators whose work helps us understand, create, and harness light now. The exhibits will be developed in three stages, each exploring a characteristic of light (Color, Energy, or Time). Each theme will be explored via multiple deliveries: short documentary and animated films, virtual reality experiences, interactive "photobooths," and technology-based inquiry activities. The exhibit components will be copied at seven additional sites, which will host the exhibits for their audiences, and the project's digital assets will enable other STEM learning organizations to duplicate the exhibits. The exhibits will be designed to address common gaps in understanding, among adults as well as younger learners, about light. What light really is and does, in scientific terms, is one type of hidden story these exhibits will convey to general audiences. Two other types of science stories the exhibits will tell: how contemporary research related to light, particularly in astrophysics, is unveiling the hidden stories of our universe; and hidden stories of STEM innovators, past and present, women and men, from diverse backgrounds. These stories will provide needed role models for the adolescent learners, helping them learn complex STEM content while showing them how scientific research is conducted and the diverse community of people who can contribute to STEM innovations and discoveries.

The project deliverables will be designed to present complex physics content through coherent, immersive, and embodied learning experiences that have been demonstrated to promote engagement and deeper learning. The project will research whether participants, through interacting with these exhibits, can begin to integrate discrete ideas and make connections with complex scientific content that would be difficult without technology support. For example, students and other novices often lack the expertise necessary to make distinctions between what is needed and what is extra within scientific problems. The proposed study follows a Design-Based Research (DBR) approach characterized by iterative cycles of data collection, analysis, and reflection to inform the design of educational innovations and advance educational theory. Project research includes conceiving, building, and testing iterative phases, which will enable the project to capture the complexity of learning and engagement in informal learning settings. Research participants will complete a range of research activities, including focus group interviews, observation, and pre-post assessment of science content knowledge and dispositions.

By showcasing such role models and informing about related STEM content, this project will widen perspectives of audiences in informal learning settings, particularly adolescents from groups underrepresented in STEM fields. Research findings and methodologies will be shared widely in the informal STEM learning community, building the field's knowledge of effective ways to broaden participation in informal science learning, and thus increase broaden participation in and preparation for the STEM-based workforce.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Todd Boyette Jill Hamm Janice Anderson Crystal Harden
resource project Public Programs
This Research in Service to Practice project will bring together representatives from six long-standing youth programs, experts in the field of out-of-school-time youth programming, and education researchers to collaboratively explore the long-term (15-25 years) impact of STEM-focused, intensive (100+ hours/year), multi-year programming. The six partnering programs have maintained records with a combined total of over 3000 alums who participated between 1995 and 2005. This four-year research project uses an explanatory, sequential, mixed-method design to carry out four steps: (1) identify and describe the impact on the lives of program alums who are now ages 30 to 45; (2) identify causal pathways from program strategies to long-term outcomes; (3) develop an understanding of these pathways from the perspective of the people who experienced them; and (4) disseminate this knowledge broadly to those associated with STEM-focused programming. Research questions include: How did these programs affect youth's lives as they progressed toward and into adulthood? What program strategies and what participant attributes contributed most to the staying power of these effects? What life events and social structures supported and inhibited participant outcomes? This project describes the effects, identifies the causal pathways, and produces materials that programs can use for both strategic planning and generating support resources. Additionally, this project provides research methodology for organizations that want to conduct their own retrospective research and lays a foundation for a more comprehensive study that includes programs without historical documentation. The project aligns with NSF's Big Idea "NSF INCLUDES: Transforming education and career pathways to help broaden participation in science and engineering" by providing essential information about the long-term effect of interventions on educational and career pathways in STEM.

The project's approach involves three phases: (1) research preparation, (2) causal structural modeling of survey data from approximately 2,000 respondents, and (3) rich qualitative follow-up. Human ecological and self-determination theories inform data collection and analyses at every project phase. In the preparation phase, program staff complete program profiles from an historic perspective by identifying program strategies that may have included, for example, scientific research, robotics development, teaching science in informal settings, and working in scientific research labs. In the quantitative phase, the project will recruit alums who attended one of the 6 youth programs between 1995 and 2005 to submit a current resume and complete an online questionnaire, based on the following scaled variables: retrospective recall of basic psychological need satisfaction and frustration in relation to perceived program strategies; STEM identity (at three time periods: pre-program; post-program; and current); current well-being; career influences; and career barriers. The questionnaire also includes open-ended questions about life events related to the following categories: family and friends, school and work, and living conditions. Analysis of the questionnaire will lead to development of a causal structural model. In the qualitative phase, data will be collected from a purposefully selected sample of 30 alums based on findings from the quantitative phase. Methods include interviews, photo journals, and STEM pathways maps. Analysis of interviews, resumes, and photo journals take place within the structure of basic psychological need satisfaction and motivational quality across ecological systems over time. Qualitative analysis uses the constant comparative method, and findings are used to update and refine the final causal structural model and inform overall findings, conclusions, and recommendations of the project.

Since the 1990s, out-of-school time programs have engaged youth from underserved communities in STEM learning and in building interest in STEM careers, yet these programs often based on untested assumptions that participation has lasting effects on education, career, and life choices related to STEM. This Research in Service to Practice project has the potential to 1) guide practitioners in program improvement and improved program outcomes; 2) provide insight into achieving program goals, such as equity, increased well-being of participants, an informed citizenry, and a diversified STEM workforce; and 3) inform multi-stakeholder decision-making with respect to this type of programming. This research also builds a foundation of research data collection and analysis methods to guide and support future research on long term-impacts and youth STEM programming. Dissemination strategies include a website, webinars, video, infographics, conference presentations, and written reports to reach stakeholders including practitioners, researchers, administrators, and funders.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
resource project Informal/Formal Connections
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The three-year project, Montana Models: Connecting Local and Disciplinary Practices through University-Community Partnerships, focuses on creating, implementing, and studying several learning outcomes associated with youth engagement in mathematical modeling contexts. The project builds on existing partnerships between the state's two research universities and Montana 4-H to target outreach to rural youth and bring them into a network of people who can inspire, support, and sustain STEM learning. Middle school and high school students from rural communities will be invited to a university campus for a residential modeling-based summer program l focused on mathematics and mathematical modeling. Activities at the summer program are designed to engage them in problems relevant to their own backgrounds and experiences and to honor their local funds of knowledge. The primary goal of Montana Models is to use mathematical modeling as a mechanism for bringing everyday mathematical practices already present in rural communities into contact with disciplinary practices. The project focuses on the following research questions: (1) What are the everyday mathematical practices in Montana communities? (2) How can everyday mathematical practices be leveraged and brought into contact with disciplinary practices in service of mathematizing meaningful questions within the community? (3) How do youth identify and get identified with respect to mathematics and with respect to their role in the world? (4) How does participation in project activities affect participants' knowledge of mathematical practices and content? The project uses social design experimentation, a hybrid research methodology which combines the traditions of design-based research with forms of inquiry that involve collaboration among participants, researchers, and other stakeholders, such as critical ethnography. Data sources include field notes from ethnographic observations, interviews, videos of students engaging in modeling activities, artifacts that show their mathematical work, and results from the Attitudes Towards Mathematics Inventory. Through its collaboration with 4-H, Montana Models targets outreach to rural youth across the state, especially those from groups that are typically underrepresented in STEM fields. The project is poised to impact ways in which formal and informal educators understand the knowledge bases that are already present in rural communities and how those bases may inform, support, and sustain STEM learning. Findings and deliverables will be disseminated through a public-facing website and through the 4-H infrastructure. This infrastructure includes Montana 4-H's Clover Communication Contest that will allow participating youth to showcase their projects. Research findings will be shared through local and national conferences and peer-reviewed publications. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Mary Carlson Elizabeth Burroughs Frederick Peck Katharine Banner david thomas
resource project Exhibitions
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

The Designing Our Tomorrow project will develop a framework for creating exhibit-based engineering design challenges and expand an existing model of facilitation for use in engineering exhibits. The project seeks to broaden participation in engineering and build capacity within the informal science education (ISE) field while raising public awareness of the importance of sustainable engineering design practices. The project focuses on girls aged 9-14 and their families and is co-developed with culturally responsive strategies to ensure the inclusion and influence of families from Latino communities. The project will conduct research resulting in theory-based measures of engineering proficiencies within an exhibit context and an exhibit facilitation model for the topic area of engineering. Based on the research, the project will develop an engineering design challenge framework for developing design challenges within an exhibit context. As the context for research, the project will develop a bilingual English/Spanish 2,000-square foot traveling exhibition designed to engage youth and families in engineering design challenges that advance their engineering proficiencies from beginner to more informed, supported by professional development modules and a host-site training workshop introducing strategies for facilitating family engineering experiences within a traveling exhibition. The project is a collaboration of Oregon Museum of Science and Industry with the Biomimicry Institute, Adelante Mujeres, and the Fleet Science Center.

Designing Our Tomorrow builds on a theory-based engineering teaching framework and several previous NSF-funded informal education projects to engage families in compelling design challenges presented through the lens of sustainable design exemplified by biomimicry. Through culturally-responsive co-development and research strategies to include members of Latino communities and provide challenges that highlight the altruistic, creative, personally relevant, and collaborative aspects of engineering, the Designing Our Tomorrow exhibition showcases engineering as an appealing career option for women and helps families support each other's engineering proficiencies. To better understand and promote engineering learning in an ISE setting, the project will conduct two research studies to inform and iteratively develop effective strategies. In the first study, measurement development will build on prior research and practice to design credible and reliable measures of engineering proficiency, awareness, and collaboration, as well as protocols for use in exhibit development and the study of facilitation at engineering exhibits, and future research. The second study will explore the effects of facilitation on the experience outcomes.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Marcie Benne Verónika Núñez
resource project Professional Development and Workshops
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Blind youth are generally excluded from STEM learning and careers because materials for their education are often composed for sighted individuals. In this proposed Innovations in Development project, the PIs suggest that spatial acuity is an important element in order for blind persons to understand physical and mental structures. Thus, in this investigation, efforts will be made to educated blind youth in the discipline of engineering. A total of 200 blind students, ages 12-20 along with 30 informal STEM educators will participate in the program. This effort is shared with the National Federation of the Blind, Utah State University, the Science Museum of Minnesota, and the Lifelong Learning Group.

The National Federation of the Blind, in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota will develop a five-year Innovations in Development project in order to broaden the participation of blind students in STEM fields through the development of instruction and accessible tools that assess and improve the spatial ability of blind youth. The partnership with the Science Museum will facilitate the creation of informal science content for students and professional development opportunities for informal educators. Evaluation will be conducted by Lifelong Learning Group of the Columbus Center of Science and Industry. Activities will begin in year one with a week-long, engineering design program for thirty blind high-school students at the Federation of the blind headquarters in Baltimore. Year two will feature two similarly sized programs, taking place at the Science Museum. While spatial ability is linked to performance in science, research has not been pursued as to how that ability can be assessed, developed, and improved in blind youth. Further, educators are often unaware of ways to deliver science concepts to blind students in a spatially enhanced manner, and students do not know how to advocate for these accommodations, leading blind youth to abandon science directions. Literature on the influences of a community of practice on youth with disabilities, as well as nonvisual tools for experiencing engineering, is lacking. This project will advance understanding of how blind people can participate in science, and how spatial ability can be developed and bolstered through informal engineering activities and an existing community of practice.
DATE: -
TEAM MEMBERS: Anil Lewis Wade Goodridge