This Research in Service to Practice project will bring together representatives from six long-standing youth programs, experts in the field of out-of-school-time youth programming, and education researchers to collaboratively explore the long-term (15-25 years) impact of STEM-focused, intensive (100+ hours/year), multi-year programming. The six partnering programs have maintained records with a combined total of over 3000 alums who participated between 1995 and 2005. This four-year research project uses an explanatory, sequential, mixed-method design to carry out four steps: (1) identify and describe the impact on the lives of program alums who are now ages 30 to 45; (2) identify causal pathways from program strategies to long-term outcomes; (3) develop an understanding of these pathways from the perspective of the people who experienced them; and (4) disseminate this knowledge broadly to those associated with STEM-focused programming. Research questions include: How did these programs affect youth's lives as they progressed toward and into adulthood? What program strategies and what participant attributes contributed most to the staying power of these effects? What life events and social structures supported and inhibited participant outcomes? This project describes the effects, identifies the causal pathways, and produces materials that programs can use for both strategic planning and generating support resources. Additionally, this project provides research methodology for organizations that want to conduct their own retrospective research and lays a foundation for a more comprehensive study that includes programs without historical documentation. The project aligns with NSF's Big Idea "NSF INCLUDES: Transforming education and career pathways to help broaden participation in science and engineering" by providing essential information about the long-term effect of interventions on educational and career pathways in STEM.
The project's approach involves three phases: (1) research preparation, (2) causal structural modeling of survey data from approximately 2,000 respondents, and (3) rich qualitative follow-up. Human ecological and self-determination theories inform data collection and analyses at every project phase. In the preparation phase, program staff complete program profiles from an historic perspective by identifying program strategies that may have included, for example, scientific research, robotics development, teaching science in informal settings, and working in scientific research labs. In the quantitative phase, the project will recruit alums who attended one of the 6 youth programs between 1995 and 2005 to submit a current resume and complete an online questionnaire, based on the following scaled variables: retrospective recall of basic psychological need satisfaction and frustration in relation to perceived program strategies; STEM identity (at three time periods: pre-program; post-program; and current); current well-being; career influences; and career barriers. The questionnaire also includes open-ended questions about life events related to the following categories: family and friends, school and work, and living conditions. Analysis of the questionnaire will lead to development of a causal structural model. In the qualitative phase, data will be collected from a purposefully selected sample of 30 alums based on findings from the quantitative phase. Methods include interviews, photo journals, and STEM pathways maps. Analysis of interviews, resumes, and photo journals take place within the structure of basic psychological need satisfaction and motivational quality across ecological systems over time. Qualitative analysis uses the constant comparative method, and findings are used to update and refine the final causal structural model and inform overall findings, conclusions, and recommendations of the project.
Since the 1990s, out-of-school time programs have engaged youth from underserved communities in STEM learning and in building interest in STEM careers, yet these programs often based on untested assumptions that participation has lasting effects on education, career, and life choices related to STEM. This Research in Service to Practice project has the potential to 1) guide practitioners in program improvement and improved program outcomes; 2) provide insight into achieving program goals, such as equity, increased well-being of participants, an informed citizenry, and a diversified STEM workforce; and 3) inform multi-stakeholder decision-making with respect to this type of programming. This research also builds a foundation of research data collection and analysis methods to guide and support future research on long term-impacts and youth STEM programming. Dissemination strategies include a website, webinars, video, infographics, conference presentations, and written reports to reach stakeholders including practitioners, researchers, administrators, and funders.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This is the second of a 2-part series about the changes that have taken place in how public libraries adapted to COVID-19. Part 1 focused on what libraries were doing prior to pandemic, the challenges that they faced due to COVID-19, and how they pivoted to a “new normal”. Part 2 focuses on innovations in programming and professional development that have helped to strengthen the library profession during the pandemic.
An ecosystems model of learning suggests there are critical partners within and across a community that support learning across the lifespan. These school-community partnerships, developed with shared accountability and goals, are essential to rural students given the lack of economic and geographic access to such services. Youth in rural areas may have limited opportunities to engage with professionals. The team proposes to overcome this gap by capitalizing on the wide-spread interest in archaeology to teach critical thinking using STEM concepts and testing components of a partnership program. This project will advance knowledge on multidisciplinary STEM education by iteratively developing and researching an after-school program in which youth engage in multidisciplinary inquiry in the context of archeology. Mentored by archaeologists, rural youth and citizen scientists will use concepts and tools drawn from biology, ecology, geospatial science, mathematics, physics, and data science to identify and answer questions related to the history of their local region. An outcome of this project will be a road map for moving from a feasibility project to a larger implementation project locally and an understanding of community partnerships engaging more broadly.
Researchers at SUNY Binghamton will conduct a mixed-methods research study that examines the ways in which participation in a multidisciplinary after-school archaeology program supports the development of STEM identities among rural youth in sixth through eighth grades. The research team will use content analysis to analyze field notes from observations, as well as transcripts from focus groups and interviews with the youth. They will use inferential statistics to explore changes in the youths' STEM identity using an identity survey, which will be administered to the youth before and after participation in the program. Additionally, the research team will conduct qualitative research that explores shifts in the afterschool program providers' perceptions about supporting middle school youth as STEM learners. The program providers are comprised of graduate and undergraduate archaeology students, citizen scientists, and professional archaeologists. The course modules developed for the after-school program will be disseminated through professional networks and organizations dedicated to archaeologists and informal educators, and empirical findings will be shared widely via peer-reviewed publications. This project is funded by the Advanced Informal STEM Learning (AISL) program. As part of its overall strategy to enhance learning in informal environments, the AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This Pilots and Feasability Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This four-year research study will investigate families' joint media engagement (JME) and informal STEM learning while listening to the child-focused STEM podcast, Brains On! Prior research has shown that the setting where families most often listen to this podcast together is the family automobile as children are being driven to school, on road trips, or other activities. Brains On! is rooted in the mission-driven principle of public radio to educate and inspire. The target audience is children 5-12 years old and their parents or caregivers. Each episode ranges from 20-45 minutes in length and presents ideas from a variety of STEM disciplines such as physics, chemistry, biology and engineering featuring sound-rich explanations of concepts through fun skits, original songs and interviews with scientists. The episodes use a light-hearted, humorous approach to share oftentimes complex STEM information. To provide an interactive experience, hosts encourage the audience to participate with the show by sending in drawings, emailing photos of plants and animals, or posing questions to be answered in future episodes. Every episode is co-hosted by a different child who interviews top scientists about their work. The scientists are selected to be representative of the range of topics presented and are meant to serve as role models for the listeners and demonstrating a wide range of career options in the STEM field.
The research adds to the social learning theory of joint media engagement (JME) which has shown that interactions between people sharing a media experience can result in learning together. Recent work on Joint Media Engagement has focused on parent/child interactions with television/video in the home. But little is known about how families engage with children's STEM podcasts together and what learning interactions occur as a result. Even less is known about this engagement within an automobile setting. This research project will build new knowledge filling a gap in the informal STEM learning field. It will use a mixed-methods research design with three phases of research to answer these questions: 1) How does the Brains On! podcast mediate STEM-based joint media engagement and family learning in an automobile setting? 2) What does STEM based joint media engagement and family learning look and sound like in this setting? 3) How do "in-automobile" factors foster or impede STEM-based joint media engagement and family learning? Phase 1 is a listener experience video study of 30 families listening to the Brains On! episodes. Phase 2 is video-based case studies of the natural automobile-based listening behaviors of eight Phase 1 families. Phase 3 is an online survey of Brains On! listeners to understand how representative the findings from Phases 1 and 2 are to the larger Brains On! Research. Results will be shared widely with key audiences that can use the findings (media developers, ISE practitioners, ISE evaluators and researchers, and families). It will also make an important contribution to the Joint Media Engagement literature and the ISE field.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Research in Service to Practice project examines how informal place-based collaborative learning can support local communities' planning processes related to current environmental changes. As a part of this study workshops will be conducted in 8 communities that have a range of planning mandates based on recent extreme environmental changes such as drought/wildfires, flooding, invasive species, or loss of native wildlife. Place-based adaptation workshops will be designed to be locally relevant and empower people to learn and act on their newly acquired understandings. Local community collective actions may include a range of decisions (e.g., infrastructure changes such as building defenses against sea level rise in coastal communities or improving the quality of roads to withstand higher temperatures.) Collective action may also lead to community wide behavioral changes such as individuals using less water or farmers planting different crops. The study will focus on the efficacy of the methods used in 8 workshops in communities throughout the country. Research objectives include: 1) identifying experts' belief about the most critical components of successful workshops; 2) Understanding of prior workshop outcomes and 3) test hypothesized effective practices and understand how learning takes place and collective action does or does not take place. The project addresses key AISL solicitation priorities including strategic impact on the field of informal STEM learning, advancing collaboration, and building professional capacity. It engages both public and professional audiences as described in the solicitation. Public audiences include stakeholders in each of the 8 communities such as community environmental groups, NGOs, businesses, landowners, and local government planners. Professional audiences include the workshop scientists and facilitators who will be trained in the experimental workshop approach. The project builds upon and expands the existing AISL portfolio of science communication projects such as science cafes, science festivals, science media, and library based projects. This is a collaborative project of EcoAdapt and Virginia Tech with participants from the National Parks Conservation Association, the Desert Research Institute, and the Wildlife Conservation Society and others. The research will progress through two phases. Phase 1 is designed to identify consensus-based effective practices for promoting learning and action in adaptation workshops. It includes a Delphi study to synthesize beliefs about effective practices held by experienced workshop facilitators across the United States. Phase 2 includes iterative design and research of eight adaptation workshops in various communities with a range of planning mandates and recent extreme weather experience. By iteratively revising the workshop design, the study will elucidate how different workshop components influence participant learning, individual behavioral intentions, and subsequent efforts toward collective action. The overall research design will examine the relationships of pedagogical and collaborative techniques to learner outcomes and collective action. Many of these lessons are likely relevant to other collaborative informal science learning contexts. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The field of social and emotional learning (SEL) is rapidly expanding, as educators bring a sharper focus to helping children build skills beyond academic knowledge. School climate initiatives, anti-bullying work, positive behavior supports and other SEL efforts are now steering programs in schools and out-of-school-time (OST) settings across the country. Building children's SEL skills has taken on even more urgency in the wake of the COVID-19 pandemic.
This updated and expanded guide to evidence-based SEL programs offers detailed information on 33 pre-K through elementary school programs
DATE:
TEAM MEMBERS:
Stephanie JonesKatharine BrushThelma Ramirez
Museums in the US receive approximately 55 million visits each year from students in school groups. Field trip visits to an art museum have been found to positively impact critical thinking skills, empathy and tolerance - an increase that can be even more significant for youth from rural or high-poverty regions. While field trips are popular, especially at science museums, there have been no experimental studies about their impact on STEM career choices and interests, much less any which used a culturally sensitive and responsive approach. Given the resources put into field trips, this study investigates if causal links can be drawn between museum experiences and impact on youth. The Museum of Science & Industry uses a Learning Labs approach for engaging its visitors. These "Learning Labs" are facilitated experiences that run roughly an hour. Currently there are 12 lab topics. This study focuses on MedLab--one of the learning labs--as the setting for the research. MedLab is designed for on-site and online experience using ultra-sophisticated and highly versatile technology in challenges taken from research on the top healthcare issues that face adolescents in their communities.
This study is informed by research and theory on Social Cognitive Career Theory (SCCT) and Racial and Ethnic Identity. The former describes a process many follow when thinking about career options, broadly. The latter describes how people see themselves in the world through their membership with a racial and/or ethnic group. Both processes can collectively influence STEM career choices. This study follows an embedded mixed-method design. The quantitative portion includes an experimental, pre/post/delayed post-test design of both educators and their students using multiple measures taken mostly from previously published instruments. The qualitative portion includes observation rubrics of MedLab sessions along with interviews and focus groups with staff, educators, students and families that take place both within and outside of the museum. This is an experimental study of moderate size of both heterogeneous teacher and student populations in real world settings. It involves comparing youth and educators that participate in MedLab with those who do not. By conducting research that looks at each community through the lens of their unique experiences, the research will measure their impact more sensitively and authentically, addressing a gap in current literature on informal science, technology, engineering, or mathematics (STEM) career education with diverse students.
This study is funded by the Advancing Informal STEM Learning (AISL) program and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
This project is a retrospective study to explore the long-term impact of STEM programming. The study follows up with participants to ask questions like "Where are they now? What mattered? What difference did it make? and What’s next?"
This RAPID was submitted in response to the NSF Dear Colleague letter related to the COVID-19 pandemic. This award is made by the AISL program in the Division of Research on Learning, using funds from the Coronavirus Aid, Relief, and Economic Security (CARES) Act. The public must be made aware in a clear, responsible way about the role of science to help bring this pandemic under control and prevent future outbreaks. This project will allow the NewsHour to go beyond their daily reporting of the medical information about the pandemic, to inform the public about the difference scientific research/ research conducted by scientists and medical professionals can make in attacking such a dire threat. The PBS NewsHour has the capability to quickly mobilize its science journalists and national distribution infrastructure to produce at least six broadcast segments and additional digital materials reporting on this on-going scientific work. They will interview scientists, researchers and experts in genomic analysis, computer tracking, vaccine production, and social epidemiology showing what they are doing to test, treat, track and stop the spread of COVID-19, to create vaccines that may prevent further transmission, and to measure the social impact of the disease. These segments will be broadcast nationwide on local PBS stations and distributed on their website, YouTube, and social media channels. Viewership of the NewsHour is extensive reaching 2.5 million people nightly via broadcast and almost 33 million YouTube views per quarter. During a recent quarter, they reached 72.6 million on Facebook and garnered 86.8 million Twitter impressions.
The research team, Knology, will conduct a study to assess 1) where US adults are primarily getting information about COVID-19; 2) their perception of personal and public responsibility; 3) behaviors they have taken and/or plan to take, and when; 4) their social values. Knology will develop a survey instrument with adopted items and modules used in prior collaborations to develop a baseline understanding of the relationship between news consumption and attitudes about COVID-19 risk. The survey will be hosted using Qualtrics. Survey data will be gathered from a representative sample of US adults (N = 1000) recruited using the online software system, Prolific. A recent PBS NewsHour/NPR/Marist poll will be used as a baseline. Once potentially identifying information like demographics are aggregated, these formative data and topline results will be shared openly through the Knology website to support other researchers and journalists.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project focuses on environmental health literacy and will explore the extent to which diverse rural and urban youth in an out-of-school STEM enrichment program exhibit gains in environmental health literacy while engaged in learning and teaching others about community resilience in the face of changing climates. Science centers and museums provide unique opportunities for youth to learn about resilience, because they bring community members together to examine the ways that current science influences local decisions. In this project, teams of participating youth will progress through four learning modules that explore the impacts of changing climates on local communities, the local vulnerabilities and risks associated with those changes, possible mitigation and adaptation strategies, and building capacities for communities to become climate resilient. After completion of these modules, participating youth will conduct a resilience-focused action project. Participants will be encouraged to engage peers, families, friends, and other community stakeholders in the design and implementation of their projects, and they will gain experience in accessing local climate and weather data, and in sharing their findings through relevant web portals. Participants will also use various sensors and web-based tools to collect their own data.
This study is guided by three research questions: 1) To what extent do youth develop knowledge, skills, and self- efficacy for developing community resilience (taken together, environmental health literacy in the context of resilience) through participation in museum-led, resilience-focused programming? 2) What program features and settings foster these science learning outcomes? And 3) How does environmental health literacy differ among rural and urban youth, and what do any differences imply for project replication? Over a two- year period, the project will proceed in six stages: a) Materials Development during the first year, b) Recruitment and selection of youth participants, c) Summer institute (six days), d) Workshops and field experiences during the school year following the summer institute, e) Locally relevant action projects, and f) End- of-program summit (one day). In pursuing answers to the research questions, a variety of data sources will be used, including transcripts from youth focus groups and educator interviews, brief researcher reflections of each focus group and interview, and a survey of resilience- related knowledge. Quantitative data sources will include a demographic survey and responses to a self-efficacy instrument for adolescents. The project will directly engage 32 youth, together with one parent or guardian per youth. The study will explore the experiences of rural and urban youth of high school age engaged in interactive, parallel programming to enable the project team to compare and contrast changes in environmental health literacy between rural and urban participants. It is anticipated that this research will advance knowledge of how engagement of diverse youth in informal learning environments influences understanding of resilience and development of environmental health literacy, and it will provide insights into the role of partnerships between research universities and informal science centers in focusing on community resilience.
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
It has been well documented that under-resourced Latinx communities face persistent barriers to accessing quality STEM education and STEM careers, particularly in the field of engineering. For young children and their families from these communities, the development of executive function skills offers promising pathways to support educational success and prepare children to engage with STEM practices and content. Executive function skills, such as focusing attention, retaining information, and managing emotions are critical for children’s development and long-term success, and have been identified as central to engagement with STEM practices and content, whether in or out of school. However, much of the work on development of executive function skills to date has been conducted with White, middle-class children and has largely ignored the knowledge, values, or perspectives of other communities, including Latinx families. Similar gaps also exist in attention to culturally responsive approaches to using family-based STEM activities to support executive function skills. Taken together, there is a critical need to work with Latinx communities to re-imagine the intersection of STEM learning and executive function skills using equity-based frameworks. This Pilot and Feasibility project will develop and test a new participatory, dialogic method that leverages informal family engineering activities to support the development of executive function skills for preschool-age children from Latinx families. The combination of this proposal’s unique engagement of parents as research partners with the study of engineering and executive functions could lay the foundation for a promising program of future equity-focused research.
Three research questions will guide the study: 1) What knowledge, assets, and practices already exist within Latinx families related to these executive function skills? 2) What aspects of executive function skills can be supported through informal family engineering activities? and 3) What are promising design strategies for adapting informal family engineering activities to highlight family assets and support executive function skills for young children? To address these questions, the project team will engage Latinx parents in a dialogue series in which parents are central collaborators, sharing their in-depth perspectives and partnering with researchers to develop conceptual frameworks and new approaches. Data generated through these ongoing discussions will be analyzed using (a) qualitative, participatory approaches, including iterative co-development and refinement of emergent themes with parents, (b) detailed inductive coding of parent dialogue group discussions using grounded theory techniques, and (c) retrospective analysis at the end of the project. The parent dialogue series will be supported by a systematic literature review examining the intersections between engineering design, executive function, and the strengths and assets within Latinx families. The results of the exploratory research will include a (1) conceptual framework co-developed with parents that highlights promising opportunities and design strategies for using family engineering design activities to support executive function skills for preschool-age children from Latinx families and (2) research agenda outlining questions and priorities for future work that reflect the goals and interests of this community. Aligned with project’s equity approach, the team will work collaboratively with project partners and families for dissemination, focusing on amplifying community voices, sharing challenges and successes, and supporting improvements in the local community. Results will also be broadly shared with educators and researchers to advance knowledge and promote new equitable approaches to collaborating with parents from Latinx communities.
This Pilots and Feasibility project is funded by the Advancing Informal STEM Learning (AISL) program.
While museums strive to be as inclusive and welcoming as possible to all visitors, data from many institutions shows that audiences are still disproportionately white, well-educated, and more affluent than the average local population. One contributing factor to the lack of progress is that staff often create programs that work to create inclusivity from their own perspective, rather than grounding the work in a broader vision of the museum experience. This project will allow for a deeper exploration of how visitors, particularly those from groups that visit less frequently, experience a museum visit, and how their sense of belonging is supported or eroded during their visit. The team believes this sense is built up or taken away through specific moments of engagement or alienation and will explore these moments that matter through the work. Through intensive work at one museum, and additional work at three other museums, the project will look for themes and insights that can help all museums to create more positive moments that matter for all audiences. Specifically, the project will result in a) insights for museums in supporting a visitor-based sense of belonging, b) shared methods for working with visitors that could be applied by other researchers to explore specifics in a particular setting, and c) grounding work to develop survey questions for use across the field. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Building on existing work around exclusion and inclusion in everyday science learning, this project aims to formally define what a sense of belonging means in the science and natural history museum context as a construct for understanding inclusivity. The research team hypothesizes that the majority of experiences in an entire museum visit have a relatively neutral effect on visitor sense of belonging; however, at times, visitors may experience positive or negative moments, and these moments that matter may influence a visitor's STEM engagement, interest, and/or identity. This exploratory work will help to develop and ground the construct of sense of belonging within the museum visitor's experiences, to identify visitor moments that matter using an equity approach that intentionally centers the experiences of visitors from underrepresented groups, and to form the basis for future research that would support the development of a fieldwide measure of sense of belonging. The research study will focus on defining the construct of sense of belonging so it 1) aligns with the research literature and 2) is grounded in the experiences of science/natural history museum visitors. Photovoice data collection method and interviews will be used with visitors ages six and above to identify moments that matter for them during a visit to a science/natural history museum. This project will create new understanding of this construct for not only science/natural history museums and the larger informal science education (ISE) field, but fill a gap in the overall literature around the construct of sense of belonging. The project will also provide new learnings for the ISE field on how to adapt and use the photovoice method to study complex constructs, such as sense of belonging, in science/natural history museums.
This Pilots and Feasibility Studies award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.