The Exploratorium will increase the museum community's understanding of the impact of a single science museum visit on "emerging adult" learners-young adults aged 18-29, who are not yet married and have no children. In particular, the study will attempt to understand how museum visits help young women build crucially important science self-confidence. The project will build on prior IMLS-funded research that found that a science museum visit mitigated a pre-existing gender gap in science confidence, or self-efficacy (SSE). The research team will replicate and investigate this effect further by observing male and female young adults during their visits, and over the course of the following three months. The study will gather data before, during, and after the visit through interviews, surveys, experience-sampling, and analysis of participants' social media posts. Results of this research will provide valuable information to the science museum community, as they seek to address the challenges of achieving gender equity in STEM education and the workforce.
Over a three-year period, the Lawrence Hall of Science will conduct research on the conversations of groups and families encountering an Augmented Reality (AR) experience in a museum environment. The research program will identify which design elements best facilitate conversations among groups of visitors, and determine if these conversations are both rich in scientific content and gender-balanced. The project will focus on four specific activities: understanding the learning associated with current AR activities, implementing design-based research to develop visitor conversation supports, designing and developing new AR programs with embedded conversation supports, and conducting iterative hypothesis-based research on how learning conversations happen in AR learning environments. The museum community will gain insights on design principles for supporting collaborative learning using AR. Project staff will disseminate results via conference workshops for museum professionals on designing AR to enhance family learning, and through publication in professional journals.
Sciencenter will develop a touring exhibition, Engineer.Design.Build, to spark interest and build confidence in STEM by providing learning opportunities about the broad impact engineers have on the environment and society. The museum will partner with Cornell University's College of Engineering to develop scientific content which will be reviewed by an advisory board of representatives from the academic, business, and informal science education sectors. Partners from informal learning institutions will provide expertise on the educational content to ensure that it is accessible and engaging for the target audience of 5-11 year olds. Through a combination of focus groups, youth/guest feedback during exhibition development, and experts in girls' engagement in STEM on the advisory board, the museum will ensure that the exhibition and programming are designed to appeal to girls, and accessible to all learners. The project will include front-end, formative, and summative evaluation through observations and mediated interviews, collecting data from youth, families, and school groups.
Free-choice and interest-driven learning activities are a highly significant source of STEM (science, technology, engineering, and mathematics) learning for adults through their lifespans. Gardening is one such activity that is widespread across communities with one in every fifty American adults reporting an interest in gardening/plants and who associate that interest/hobby with science. While the terms interest and hobby are related, the latter refers to something one actively does, not just thinks about doing. Adults who seek out learning and participation opportunities in highly visible community spaces (e.g., gardening clubs, science centers, botanical gardens) are likely to be White and well-educated. Further understanding is needed of when and how community members from other demographic groups access different resources (people, organizations, and places) for information and opportunities, and what influences them to do so. This Pilot and Feasibility Study will explore informal learning networks in Alameda County, California, specifically around gardeners and gardening. Researchers will use surveys, focus groups, and program observations to gather data on how those who pursue self-directed scientific learning about gardening access information. Of interest is how the differential access to and pursuit of information occurs among diverse community members, especially those outside of more established Master Gardener and other organized gardening programs. This research will: 1) contribute to understanding of the resources that interest-driven adult STEM learners access, describing the barriers they perceive and how/if the accessed resources differ by gender, race, or socioeconomics; 2) determine the feasibility of a sampling approach to gather data from individuals in demographic groups who may not have been reached in prior research efforts; and 3) generate insights for informal science education practitioners and researchers about how to better support diverse interest-driven STEM learners. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
It is hypothesized that there is a large percentage of individuals from non-dominant populations engaged in free-choice STEM learning; past efforts have likely under-counted the participation of individuals from these communities. To achieve the research aims the research team will utilize respondent-driven sampling, engaging gardening hobbyists' social contacts to recruit participants, and collect data from diverse (gender, race, socioeconomics) urban gardeners who may be differently connected to STEM learning ecosystem resources/organizations than their highly visible peers. This approach will be used to investigate the behaviors, perceptions, and outcomes related to STEM learning such as development of self-efficacy and science identity. Focus groups will provide context for themes that arise in the survey data and clarify hobbyists' participation preferences and experiences. In situ observations of learning environments comprise the third mechanism for collecting data. All three data sources will support triangulation of results and contribute to the findings. Key outcomes of this project will be to determine if the target population has been reached through the sampling approach, to identify methodological guidelines for sampling with an intent to reach those from populations under-represented in STEM-related free-choice activities, and to clarify which network variables are most useful to study. This research lays the foundation for future work. It is anticipated that the approach developed and tested in this research may be adapted by others in the future and will have the potential to serve as a model for community-based organizations and researchers interested in studying the learning ecosystems of previously hidden populations of participants, including how these individuals perceive and access resources to support their STEM learning.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This award takes an innovative approach to an ongoing, pervasive, and persistent societal issue: women are still drastically underrepresented in computing careers. This project targets middle school-aged girls because it is a time when many of them lose interest and confidence in pursuing technical education and computing careers. This project will design, develop, and deploy a one-week experience focused on middle school girls that targets this issue with a novel combination of teaching techniques and technology. The project will use wearable computing devices to support girls' social interactions as they learn computing and solve technical challenges together. The goals of the project are to raise interest, perceived competence, and involvement in the computational ability of girls. Additionally, the project aims to increase a sense of computational community for girls that makes pursuing computational skills more relevant to their identities and lives, and that helps continued participation in computing. The project will deploy a one-week experience four times per year with a socioeconomically diverse range of campers. The project will also develop a 'program in a box' kit that can be broadly used by others wishing to deliver a similar experience for girls.
The planned research will determine if a one-week experience that uses social wearable construction in the context of live-action role play can use the mediating process of computational community formation to positively impact middle school girls' engagement with and interest in computation. Computational community is defined as girls engaging together in the process of learning computation, trading resources and knowledge, and supporting growth. Research participants will include 100 6th to 9th-grade girls. At least 75% of the participants will be either low income, first-generation college-bound, or underrepresented in higher education. Students will be recruited through the longstanding partnerships with title one schools in the Salinas Valley, the Educational Partnership Center, and in the Pajaro Valley Unified School district, where 82% of the students are Hispanic/Latinx, 42% are English Learners, and 73% are eligible for free or reduced lunch. The research questions are: 1) Does the proposed experience increase girls' self-reported competence, self-efficacy, and interest in computational skills and careers? and 2) Will the proposed experience lead to activity-based evidence of learning and integration of computational skills at the group social level? The project will use a mixed-methods, design-based research approach which is an iterative design process to rapidly collect and analyze data, and regularly discuss the implications for practice with the design team. Data will be collected using observations, interviews, focus groups, surveys, and staff logs. Quantitative data will be analyzed using frequencies, means, and measures of dispersion will be applied to survey data from both time points. Pearson correlation coefficients will be used to describe the bivariate relationship between continuous factors. ANOVAs will assess whether there are significant differences in continuous measures across groups. Qualitative data will be analyzed using a constant comparison method.
This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Katherine Isbister
resourceprojectProfessional Development, Conferences, and Networks
The National Science Teachers Association will convene a conference that will bring together STEM researchers and practitioners to review the growing connected science learning movement. A connected science learning environment has been described as a robust science ecology containing a wide variety of programs, across a range of institutions and places, allowing youth different and multiple ways to engage with STEM. Such environments can include small partnerships, such as a science museum and K-12 schools, or a large, community-wide network of a variety of organizations such as K-12 schools, museums, universities, government agencies, and community organizations. The conference will bring together over forty participants, who will meet in a series of several online meetings. The conference will result in a series of papers, articles in the online Connected Science Learning journal and other publications, a series of webinars and online forums where participants can engage with themes identified in the conference, and conference presentations at the annual meetings of organizations including the National Science Teachers Association, the Association of Science-Technology Centers, and others. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The conference will: (1) document the research foundation that supports and demonstrates the impact and value of high-quality connected science learning experiences; (2) identify areas for which future research is recommended; and (3) provide effective, practitioner-focused resources that advance connected STEM learning. The conference will include participants that represent a wide range of researchers and practitioners in informal and formal STEM education, as well as representing gender, racial/ethnic and geographical diversity. The results and products of the conference will be instrumental in developing the understanding and appreciation for connecting STEM learning and ultimately improving connected STEM learning for K-12 youth. The importance of emphasizing diversity, equity, and accessibility will be strongly represented in the key evidence identified through the conference and will be reflected in the resources that will be disseminated to a broader audience.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Well-designed out-of-school time experiences can provide youth with rich opportunities to learn. However, to design effective out-of-school time experiences, it is critical to have a research basis that clarifies the features of programs that support increased youth engagement that then leads to better outcomes for youth. This project explores the features of programming that integrates sports, mathematics and science concepts, and growth mindset for 4th through 8th grade aged Latinx and African American youth. To accomplish this, the investigators refine curricular resources for out-of-school time programs and develop a model for professional learning experiences for informal educators and facilitators to support their implementation of integrated sports and STEM programming. To identify critical features of the programming, the researchers explore the ways that the program activities are implemented in two different contexts as well as the impact of the programming on youth participants' mindset, understanding of science and mathematics concepts, STEM interests, and self-perceived science and mathematics abilities. Additionally, researchers will explore the ways that the sports-themed programming supports (or could better support) girls' engagement.
The project builds on the University of Arizona researchers' existing partnerships with Major League Baseball (MLB) and Boys/Girls Club programs and an existing school-based MLB program for schools to (a) expand and refine Science of Baseball activities to enhance engagement among girls and incorporate growth mindset experiences that focus on the value of effort, determination, and learning from mistakes in both athletics and STEM; (b) study the enactment and outcomes of the program with 4th-8th grade aged youth in the two distinct informal learning settings; and (c) develop and refine a model for professional learning that includes in-person and on-line components for training informal STEM learning facilitators. The work will focus on two study contexts: afterschool programs of Boys and Girls Clubs in AZ, CA, and MO and summer programs of MLB in CA and MO. Participants will include 300 youth and up to 28 informal STEM learning facilitators split across the two contexts. Design-Based Implementation Research (DBIR) will be used to a) iteratively refine the activities and professional development model, and b) study the enactment and outcomes of the program. Research questions focus on outcomes for youth participants (i.e., impact on growth mindset, STEM dispositions, and understanding of science/math concepts), and the elements of effective professional development for informal STEM educators. Outcomes of the project include empirical evidence of what works and what doesn't work in the design, implementation, and professional development for STEM learning programs that integrate sports and growth mindset principles. In addition, outcomes of the project will advance knowledge of how different out-of-school program structures with similar sports-focused STEM programming can similarly (or differentially) support youth learning.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
National priorities recommend the U.S. fortify a culture of innovation by encouraging broader participation in invention and STEM. The Game Changers is an Innovations in Development exhibition project with embedded research that advances knowledge about how museum exhibits can activate STEM-related inventive identities among the public. The project is a collaboration between the Smithsonian's Lemelson Center for the Study of Invention and Innovation at the National Museum of American History (NMAH-LC), educational researchers, an exhibition design firm, and community based organizations. While the Game Changers exhibition theme of inventiveness in sports provides an initial spark for broad audience interest and engagement, its ultimate intent is to foster and enhance inventive identity among diverse audiences, particularly girls and young women ages 10-17, African American youth ages 10-17, and people of all ages with disabilities. Visitors will be met by a brief introductory display to launch their journey from passive learner to active inventor. A diverse array of athletes and inventors provide relevant motivational exemplars and ask visitors "How will YOU Change the Game?" Examples of invention challenges include, applying the principles of physics and materials science to aid in designing a safer helmet and exploring computational fluid dynamics to design a faster swimsuit. Throughout the exhibition experience, visitors will draw on an array of STEM skills and knowledge essential to sports, including physiology, kinesiology, and biomechanical engineering, physics, biomimicry, robotics, computer science, data analysis, and virtual and augmented reality. Throughout the project, the team will work with priority audiences, starting with front-end research and evaluation; progressing iteratively through stages of formative research, design, and evaluation; and conducting summative evaluation to ensure that the STEM-based content and design strategies are impacting inventive identity and meeting audiences' interests and needs. In coordination with the exhibition development and evaluation teams, educational researchers will iteratively explore and develop a model for innovative identity development in informal learning environments.
Educational psychologists from Old Dominion University and Temple University will collaborate closely with the NMAH-LC team, exhibition design-fabrication firm Roto, and evaluators from Randi Korn & Associates to adapt a theoretical model of identity from a formal education setting to an informal learning context. In the model, identity is conceptualized as a complex dynamic system, with interdependent internal and external elements (ontological/epistemological beliefs; self-perceptions; purpose and goals; perceived action possibilities) and reciprocal influences in a process of continuous emergence. Using design based research and a previously developed coding manual, the team will iteratively apply, test, and further advance the inventive identity development model, a set of inventive identity indicators for future research and development, and a list of exhibition design techniques for activating inventive, STEM-based identity development in informal learning environments. The research team will prioritize diverse audiences for iterative cycles and focus groups, including participants from the Girl Scouts of the Nation's Capital, Smithsonian Accessibility Program, Smithsonian's Anacostia Community Museum, and YMCA of Washington, DC. The exhibition's research, evaluation, and design outcomes will be disseminated widely across the AISL field and through project collaborators.
This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project aims to understand ways to empower Latinx families (adult caregivers) to feel confident in their ability to support their middle school-aged girls in science and engineering activities. The project involves seven weeks of family programming around rockets or urban farming, as well as separate conversation groups for adult family members and girls. The project is relevant for several reasons: females and Latinx individuals are both underrepresented in science, technology, engineering, and math (STEM) coursework and careers; girls tend to lose interest in STEM by middle school age; and adult family members may have an impact on their children's attitudes and interests. The project partners with school districts and nonprofit organizations in Arizona and California.
This multidisciplinary project's priority is broadening participation, with a focus on increasing Latina girls' science and engineering interests through Family Project-Based Learning Activities, Conversation Groups, and a cultivated Community of Learners. It is based on the frameworks of Social Cognitive Career Theory and Community Cultural Wealth. The project aims to empower families (adult caregivers) to feel confident in their ability to support their daughters in science and engineering activities, which is often low especially among Latinx parents. The project will develop and evaluate two out-of-school enrichment methods for aiding families in encouraging and supporting their daughters in science: Family Problem-Based Learning Activities, which focus on rockets and urban farming, and Conversation Groups, which provide information and discussion for separate groups of parents and girls. A series of pilot studies will be conducted with 80 families to iteratively evaluate and improve the materials and procedure prior to the main study with 180 families, featuring a factorial design with a control group.
The materials developed and research findings may inform similar projects, especially those for students from culturally and linguistically diverse backgrounds and projects seeking to enhance the role of families in learning. The hypothesis guiding the project is that the greatest gains will be produced with the synergistic combination of enrichment methods. Another component that can potentially have broad impact is working to create environments where Community Cultural Wealth is recognized and enhanced through interactions of different families, creating Communities of Learners. This can inform projects that recognize the importance of community and/or that seek to use culture as an asset. The proposed study will engage three geographically distributed universities and several community partners. It will also provide university students and community leaders opportunities for work on instructional design, implementation, and research. The team will disseminate their findings and methods through multiple avenues to reach researchers, parents, leaders, curators, and educators in informal and K-12 settings.
This Research in Service to Practice award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Katherine Short-MeyersonPeter RilleroPeter MeyersonMargarita Jimenez-SilvaChristopher Edwards
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This Innovations in Development project addresses the need to broaden girls' participation in STEM studies and career pathways. While women make up 47% of the U.S. workforce, they hold only 28.3% of STEM jobs and only 1 in 10 employed engineers and scientists are minority women. Girls of low socioeconomic status start losing interest and confidence in STEM during middle school, and this decline often continues as girls get older. Multiple sociocultural barriers contribute to girl's loss of confidence including gender and ethnic stereotypes; lack of culturally responsive programming; limited exposure to women role models; and few or no hands-on STEM experiences. This project builds upon the success of SciGirls, the PBS television show and national outreach program, which provides professional development on research-based gender equitable and culturally responsive teaching strategies designed to engage girls in STEM. It is a collaboration between Twin Cities Public Television, the Cornell Lab of Ornithology, and the National Park Service. The project's goal is to create media-rich citizen science experiences for girls, particularly girls of color and/or from rural areas, which broaden their STEM participation, build positive STEM identities and increase girls' understanding of scientific concepts, while leveraging citizen science engagement at national parks. Project deliverables include 1) creating five new PBS SciGirls episodes that feature real girls working with women mentors in 16 National Parks, 2) producing five new role model videos of women National Park Service STEM professionals, nationally disseminated on multiple PBS platforms, 3) providing professional development for educators and role models. This project will increase access to STEM education for girls of color and/or from rural areas, inspiring and preparing them for future STEM workforce participation. It will build the capacity of educators and National Park Service women role models to create educational and professional programs that are welcoming to girls of varying racial, ethnic, socioeconomic, and geographic backgrounds. SciGirls' massive reach to diverse audiences via PBS broadcast and multiple PBS digital platforms will amplify public scientific literacy, particularly for 21st- century audiences that connect, learn and live online.
The research study conducted by the Cornell Lab of Ornithology will address these questions: 1) To what extent does the use of culturally responsive and gender equitable multimedia in citizen science programming affect girls' learning outcomes, and contribute to the development of positive STEM identity' 2) how will their experiencing citizen science in the parks influence girls' connection to nature? At the beginning of the project all participating girls (n=160) will complete a survey on their interest in science, efficacy for doing science, and knowledge of citizen science and project-specific subject matter. Researchers will use the suite of DEVISE instruments most of which have been validated for youth to measure these constructs. To measure connection to nature, researchers will use the Connection to Nature Index, a scale developed for children. Interviews with the girls will be used to obtain qualitative data to supplement the survey data. Pre-post data will be analyzed to determine the influence of the culturally responsive media and experiences on girls' STEM identities. Researchers will share findings with the project evaluator to triangulate data between educators' implementation of the strategies and girls' learning outcome providing a more holistic picture of the overall program.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The NIH Science Education Partnership Award (SEPA) program of Emory University endeavors to use an over-arching theme of citizen science principles to:
develop an innovative curriculum based on citizen science and experiential learning to evaluate the efficacy of informal science education in after-school settings;
promote biomedical scientific careers in under-represented groups targeting females for Girls for Science summer research experiences;
train teachers in Title I schools to implement this citizen science based curriculum; and
disseminate the citizen science principles through outreach.
This novel, experiential science and engineering program, termed Experiential Citizen Science Training for the Next Generation (ExCiTNG), encompasses community-identified topics reflecting NIH research priorities. The curriculum is mapped to Next Generation Science Standards.
A comprehensive evaluation plan accompanies each program component, composed of short- and/or longer-term outcome measures. We will use our existing outreach program (Students for Science) along with scientific community partnerships (Atlanta Science Festival) to implement key aspects of the program throughout the state of Georgia. These efforts will be overseen by a central Steering Committee composed of leadership of the Community Education Research Program of the Emory/Morehouse/Georgia Institute of Technology Atlanta Clinical Translational Science Institute (NIH CTSA), the Principal Investigators, representatives of each program component, and an independent K–12 STEM evaluator from the Georgia Department of Education.
The Community Advisory Board, including educators, parents, and community members, will help guide the program’s implementation and monitor progress. A committee of NIH-funded investigators, representing multiple NIH institutes along with experienced science writers, will lead the effort for dissemination and assure that on-going and new NIH research priorities are integrated into the program’s curriculum over time.
This project aims to broaden participation in STEM education among underserved populations through innovative and inclusive approaches to technology education. The project is designed to enhance knowledge and comfort with technology and develop computational thinking among women who were formerly incarcerated and are now seeking to reenter the workforce or adjust to their lives outside the criminal justice system ("women in transition") in the Midwest. While women have become the fastest growing segment of the incarcerated population, prison education and reentry programs are not well prepared to respond to this influx. Women in transition are rarely exposed to STEM education and they are generally isolated from the digital world while in prison. Consequently, they face post-incarceration challenges in accessing and using rapidly changing digital technologies. Against this backdrop, this three-year technology education project will aim to help women in transition in Kansas and Missouri develop STEM skills relevant to job applications and post-incarceration adjustments. The project may serve as a template for building evidence-based workforce preparation efforts in informal settings, and the concurrent online peer networking and app development may also facilitate adaptation for and scaling to other regions and other similarly digitally disadvantaged populations. This project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project design is informed by the research team's past experiences offering technology education to women in transition and other underserved populations in the Midwest. The design includes three interrelated aspects: (1) technology education, (2) web/mobile app development, and (3) original empirical research. The research team will offer hybrid (online and offline) technology training programs to 300 women in transition in Kansas and Missouri. Learners will attend weekly face-to-face technology classes at different levels (introductory, intermediate, and advanced) at public libraries. A member-only online site and an accompanying mobile application for online tutorials and virtual meet-ups will enhance exposure to different types of technologies. Starting with interest-based technology topics including online resume building, information verification, and identity protection, the team will introduce women to deeper STEM topics including elementary coding skills and computational thinking. Empirical research will examine how different modalities of offering technology education are associated with learning outcomes for women participating in the program and the association of increasing knowledge and skills in digital technologies with self-efficacy, perceived social support, employment, and reduced recidivism.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Hyunjin SeoHannah BrittonMegha RamaswamyBaek-Young ChoiSejun Song