Diversity in the STEM workforce is essential for expanding the talent pool and bringing new ideas to bear in solving societal problems, yet entrenched gaps remain. In STEM higher education, students from certain racial and ethnic groups continue to be underrepresented in STEM majors and fields. Colleges and universities have responded by offering precollege STEM programs to high school students from predominantly underrepresented groups. These programs have been shown to positively affect students' analytical and critical thinking skills, STEM content knowledge and exposure, and self-efficacy through STEM-focused enrichment and research experiences. In fact, salient research suggests that out-of-school-time, precollege STEM experiences are key influencers in students' pursuit of STEM majors and careers, and underscore the value of precollege STEM programs in their ability to prepare students in STEM. This NSF INCLUDES Alliance: STEM PUSH - Pathways for Underrepresented Students to Higher Education Network - will form a national network of precollege STEM programs to actualize their value through the creation, spread and scale of an equitable, evidence-based pathway for university admissions - precollege STEM program accreditation. Building on several successful NSF INCLUDES Design and Development Launch Pilots, this Alliance will use a networked improvement community approach to transform college admissions by establishing an accreditation process for precollege STEM programs in which standards-based credentials serve as indicators of program quality that are recognized by colleges and universities as rigorous and worthy of favorable consideration during undergraduate admissions processes. Given the high enrollment of students from underrepresented groups in precollege STEM programs, the Alliance endeavors to broaden participation in STEM by maximizing college access and STEM outcomes in higher education and beyond.
The STEM PUSH Network is a national alliance of precollege STEM programs, STEM and culturally responsive pedagogy experts, formal and informal education practitioners, college admissions professionals, the accreditation sector, and other higher education representatives. The Alliance will establish a formidable collaborative improvement space using the networked improvement community model and a "next generation" accreditation model that will serve as a mechanism for communicating the power of precollege programs to admissions offices. Framing this work is the notion that the accreditation of precollege STEM programs is an equitable supplemental admissions criterion to the current, often cited as a culturally biased, standardized test score-based system. To achieve its shared vision and goals, the Alliance has four key objectives: (1) establish and support a national precollege STEM program networked community, (2) develop a standards-based precollege STEM program accreditation system to broaden participation in STEM, (3) test and validate the model within the networked improvement community, and (4) spread, scale, and sustain the model through its backbone organization, the STEM Learning Ecosystem Community of Practice. Each objective will be closely monitored and evaluated by an external evaluator. In addition, the data infrastructure developed through this Alliance will provide an unprecedented opportunity to advance scholarship in the fields of networked improvement community design and development, the efficacy of STEM precollege programs, and effective practices for broadening participation pathways from high school to higher education. By the end of five years, the STEM PUSH Network will transform ten urban ecosystems across the country into communities where students from underrepresented groups have increased college access and therefore, entree to STEM opportunities and majors in higher education. The model has the potential to be replicated by another 80 STEM ecosystems that will have access to Alliance materials and strategies through the backbone organization.
This NSF INCLUDES Alliance is funded by NSF Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES), a comprehensive national initiative to enhance U.S. leadership in discoveries and innovations by focusing on diversity, inclusion and broadening participation in STEM at scale. It is also co-funded by the NSF Innovative Technology Experiences for Students and Teachers program and the Advancing Informal STEM Learning Program.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Alison Slinskey LeggJan MorrisonJennifer IritiAlaine AllenDavid Boone
resourceprojectProfessional Development, Conferences, and Networks
This project in the Advancing Informal STEM (Science, Technology, Engineering and Mathematics) Learning program's Innovations in Development track aims to build professional capacity in Informal Science Education (ISE) institutions for effective engagement of Latinx audiences. A collaboration between The Exploratorium and the Children's Discovery Museum (CDM) of San Jose, Cambio is a professional development project based on the premise that developing cultural competence specific to Latinx communities and STEM learning, together with organizational change capacity, will enable ISE institutions to improve their ability to be inclusive of Latinx communities, cultures, and audiences. Cambio's ultimate aim is to broaden participation in STEM by building the ISE field's capacity to effectively engage Latinxs in informal STEM learning. ISE institutions and other out-of-school programs and organizations have an important role to play in inspiring and preparing the next generation of Latinx STEM students, employees, and educators. Cambio participants will deepen their engagement with the research and practice relevant to this role and build an understanding of what broadening Latinx engagement can and should look like in their institutions. Working with expert instructors and coaches, and together as peers, Cambio participants will apply what they learn to real-world strategic initiatives they implement at their home institutions.
The heart of the Cambio project is the creation of a professional development (PD) model for ISE institutions and their staff that synthesizes: (a) current knowledge about strategies for Latinx engagement in informal STEM learning; (b) previous NSF-funded projects that leveraged that knowledge to chart a way forward for the field; and (c) CDM's Cultural Competence Learning Institute professional development program for building cultural competence, inclusion, and organizational change in museums. This synthesis will form a robust professional development platform that has the potential to create a field-wide shift in the way informal science institutions approach working with Latinx audiences. The Cambio professional development program will include: a new professional development framework and curriculum that will reach 54 practitioners in 15 institutions; the development and dissemination of professional development tools and resources for use by ISE practitioners; a Community of Practice focused on Latinx engagement in informal STEM learning; evidence of the efficacy of the Cambio PD model; and knowledge generated by formative and summative evaluation that will inform other ISE efforts focused on increasing the participation of Latinxs in STEM. A STEM focus will be woven throughout the professional development experience that focuses explicitly on areas of intersection between Latinx culture and identities and STEM. Practitioners will increase their expertise in designing experiences that will invoke emotional engagement, spark curiosity and excitement, in ways that explicitly value Latinx identities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This project will research and develop the Circuit, a mobile phone and web-based application that will empower families and the general public to discover the broad spectrum of informal Science, Technology, Engineering and Mathematics (STEM) opportunities that exist in most communities. These informal STEM resources include science and children's museums, science and computer camps, maker spaces, afterschool programs, citizen science and much more. There is currently no "one-stop" searching for these resources. Instead, participants must conduct multiple, inefficient Internet searches to find the sought for STEM resources. The Circuit will enable users to efficiently search a rich informal STEM database, identifying resources by location, geography, age levels, science discipline, type of program and other factors. The Circuit builds on SciStarter, an existing online platform that connects thousands of prospective and active citizen scientists to citizen science projects. SciStarter has made possible the collection and organization of several thousand citizen science projects that would otherwise be scattered across the web. The Circuit will build on SciStarter's technical achievements in the citizen science sector, while systematically encompassing the offerings of established national networks. By integrating existing networks of informal STEM resources, the app will afford the public with unrivaled access to informal STEM opportunities, while collecting data that reveals patterns of engagement towards understanding factors of influence between different types of STEM experiences.
The app will provide researchers with new opportunities for researching how families and adults participate in the ecosystem of informal STEM resources in their communities. The Circuit will develop web tools to aggregate and organize digital content from trusted, currently siloed, informal STEM networks of content providers. These include science festivals, science and children's museums, the American Association for the Advancement of Science (AAAS), and Discover Magazine (3 million readers), the largest general interest science publication. Each content partner will feed the app with information directly or through their membership and encourage adoption of The Circuit within their respective communities. The project will design digital tools, including APIs (application program interfaces) to acquire and share digital content, embeddable tools to record and analyze data about movement, engagement, and persistence across domains, and social media tools and related APIs to distribute, track, and analyze content, engagement and demographics. (An API is a code that allows two software programs to communicate with each other.) The project will conduct small-scale, proof-of-conduct studies, to test the viability of the platform to support future, independent full-scale research. An analytics dashboard will be designed and tested with partners, researchers, and evaluators to ensure access to data on patterns of visits, clicks, referrals, searches, "joins," bookmarks, shares, contributions, user-locations, persistence, and more, within and across domains. Because each partner will feed their analytics into the shared dashboard, this will provide unprecedented and much-needed data to advance research in informal STEM learning. The Circuit will allow the tracking of patterns of engagement across networks and programs. Anonymized analytics of behavioral data from end users of The Circuit will support new approaches to advance evidence-based understanding of connected informal STEM learning by exhibiting engagement patterns across informal STEM domains. Through volunteer participation by the public, the Circuit will explore the geographic and demographic patterns of participants in the system, and derive important design lessons for its own and future efforts to create curated systems of connected learning across STEM education in informal settings.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Polar Literacy: A model for youth engagement and learning will foster public engagement with polar science. The project targets middle-school aged underserved youth and polar research scientists, with the goal to increase youth interest in and understanding of Polar Regions, and to hone researchers' science communication skills. The project will develop affordable and replicable ways of bringing polar education to informal learning environments, extend our understanding of how polar education initiatives can be delivered to youth with maximum effect, and design a professional development model to improve the capacity for Polar Region researchers to craft meaningful broader impact activities. Polar Literacy will create and test a model which combines direct participation by scientists in after-school settings, with the use of curated polar research data sets and data visualization tools to create participatory learning experiences for youth. Beyond the life of the project funding, many of the project deliverables (including kits, videos, and other resources) will continue to be used and disseminated online and in person through ongoing work of project collaborators.
Polar Literacy: A model for youth engagement and learning will advance the understanding of informal learning environments while leveraging the rich interdisciplinary resources from polar investments made by the National Science Foundation (NSF). The project's key audiences -- polar researchers, informal educators, and out-of-school time (OST) youth in grades 4-7 (ages 9-13) -- will connect through both place-based and internet-based experiences and work collaboratively to generate a flexible, scalable, and transferable education model. The project will 1) design OST kits and resource guides (focused on Polar Literacy Principles) and include "Concept in a Minute" videos designed to highlight enduring ideas, 2) provide professional development for informal educators, 3) synthesize a club model through adaptation of successful facets of existing informal learning programs, and 4) create Data Jam events for the OST Special Interest (SPIN) clubs and camp programs by modifying an existing formal education model. A research design, implemented at four nodes over three years, will answer three research questions to evaluate the impact of professional development on informal educators, as well as the impact of programs on youth, and the effectiveness of the model. In addition to the project team and collaborators who are informal education practitioners, an advisory board composed of experts in youth programming, informal education, and evaluation will guide the project to ensure that it advances the body of informal STEM learning research.
Polar Literacy is an Advancing Informal STEM Learning (AISL) Innovations in Development project in response to the Dear Colleague Letter: Support for Engaging Students and the Public in Polar Research (NSF 18-103). Polar Literacy is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (Science, Technology, Engineering, Mathematics) learning in informal environments. This project has co-funding support from the Antarctic section of the Office of Polar Programs.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Janice McDonnellOscar SchofieldCharles LichtenwalnerJason Cervenec
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. The project will develop and research, as a feasibility study, a series of art-inclusive, pop-up Science, Art, Technology, Engineering, and Mathematics (STEAM) makerspaces in a high-poverty, primarily rural county in Oklahoma. A makerspace is a collaborative work space inside a library, school or other community space for making, learning, exploring and sharing that uses high tech to low tech tools. The makerspaces will be temporary workshops that are developed through a community planning process that assesses the needs and interests of citizen stakeholders. Scientists, artists and other experts will work together with the community to design a series of thematic pop-up makerspace sessions. The project builds a collaborative infrastructure and capacity for small and rural communities by bringing together resource providers and experts to identify and design science-oriented challenges. Long-term benefits for participants include sustained focus on new approaches for civic engagement through STEAM-driven making which could foster new role identities pertaining to science and art. The project deliverables include: (1) a theoretically informed model to build a community's capacity to collaborate toward fostering civic engagement through science-oriented pop-up makerspaces, (2) Pop-Up STEAM Studio makerspaces, (3) training for pop-up facilitators, and (4) visual documentation panels and web-based digital stories to communicate progress and process.
Project research will enhance knowledge-building of the process of developing a science-oriented community challenge that embraces STEAM and making. A key contribution of the proposed project will be the generation of insights into how community members establish consensus around the joint goal of designing, documenting, and facilitating integrated art and science making activities to address and communicate the challenge. Research will focus on the roles participants take when engaging in the making process through an identity-based model of motivated action. Analysis of advisory board meeting artifacts and focus group data will allow the researchers to identify processes of negotiation and consensus building at the collective level and in relation to each issue to which the group attends. Emergent themes (such as negotiation, shared learning, idea or project revisions, diverse perspectives coming to consensus, etc.) will be examined across individual and group units of analysis, from all data sources, and through the congruent theoretical lenses of role identity theory and negotiated learning pedagogy. The research outcomes should inform efforts to build infrastructure and capacity of community resources by providing a model for developing collaborative pop-up makerspaces.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Sheri VasindaJoanna GarnerStephanie HathcockRebecca Brienen
The role of afterschool programs in the science, technology, engineering, and mathematics (STEM) learning ecosystem has grown over the past two decades, which has led to increasing efforts to support and improve program quality. These efforts include developing STEM programs and curricula, creating standards for facilitating informal STEM learning experiences, building networks of support, and developing tools for assessment and evaluation. However, such efforts may have limited impact in terms of ongoing quality improvement. STEM curricula vary in disciplinary focus, quality and may not apply to local contexts and needs. Many afterschool programs resort to using simple STEM kits or online activities rather than rigorous curricula with support for educators. The project will study how the California Department of Education's (CDE) efforts to change organizational culture to support continuous quality improvement (CQI) have affected the offerings and quality of afterschool STEM in the state's more than 4,500 publicly funded afterschool sites. The EPISTEMIC project will contribute new research findings on how CQI can increase access to higher quality STEM learning opportunities for underserved youth. Even more important, the project will provide new insights on how organizational culture affects participation in and implementation of afterschool CQI.
The team will use an organizational theory framework and a mixed methods approach to conduct three research activities: (1) Describe the organizational context through interviews, participant observations, and artifact analysis to map and describe the overall support system as a context for understanding organizational culture change; (2) Describe change over time in organizational culture, CQI processes, and STEM program offerings and quality through surveys/interviews of afterschool youth, staff, directors, and grantee representatives; and (3) Generate explanations about the relationships between organizational culture, CQI, and STEM quality in different contexts through in depth case studies. Bringing organizational culture, CQI, and STEM offerings and quality into shared focus is the most important intellectual contribution of this work. Organizational theory's sensemaking concept will guide analyses to describe, exemplify, and generate theoretical explanations for patterns in organizational culture, CQI, and STEM program changes, with attention to relevant contextual factors.
Continuous quality improvement provides tools for afterschool STEM staff to identify needs and ways to improve. The EPISTEMIC study will contribute recommendations on the systemic, organizational, and cultural aspects of improvement strategies relevant to policymakers, funders, support providers, and afterschool organizations in California, as well as other state or nongovernmental support systems around the country. The study will also produce CQI guidelines for reflecting on and incorporating changes to organizational culture as part of CQI for afterschool staff and site directors. These will be helpful for practitioners around the country. The study's focus on three organizational contexts -- school district, national afterschool, and local afterschool -- will extend the relevance of the findings and recommendations, which will be disseminated through forums, workshops, and articles in practice and policy-oriented publications. The study will also benefit the research community by providing a framework and methods for studying organizational culture and CQI. The findings on the relationships between organizational culture, CQI, and STEM offerings and outcomes will provide a foundation for further research on how these relate to STEM learning outcomes for youth. EPISTEMIC is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Patrik LundhAndrea BeesleyTimothy PodkulCarrie Allen
This four-year research study will investigate families' joint media engagement (JME) and informal STEM learning while listening to the child-focused STEM podcast, Brains On! Prior research has shown that the setting where families most often listen to this podcast together is the family automobile as children are being driven to school, on road trips, or other activities. Brains On! is rooted in the mission-driven principle of public radio to educate and inspire. The target audience is children 5-12 years old and their parents or caregivers. Each episode ranges from 20-45 minutes in length and presents ideas from a variety of STEM disciplines such as physics, chemistry, biology and engineering featuring sound-rich explanations of concepts through fun skits, original songs and interviews with scientists. The episodes use a light-hearted, humorous approach to share oftentimes complex STEM information. To provide an interactive experience, hosts encourage the audience to participate with the show by sending in drawings, emailing photos of plants and animals, or posing questions to be answered in future episodes. Every episode is co-hosted by a different child who interviews top scientists about their work. The scientists are selected to be representative of the range of topics presented and are meant to serve as role models for the listeners and demonstrating a wide range of career options in the STEM field.
The research adds to the social learning theory of joint media engagement (JME) which has shown that interactions between people sharing a media experience can result in learning together. Recent work on Joint Media Engagement has focused on parent/child interactions with television/video in the home. But little is known about how families engage with children's STEM podcasts together and what learning interactions occur as a result. Even less is known about this engagement within an automobile setting. This research project will build new knowledge filling a gap in the informal STEM learning field. It will use a mixed-methods research design with three phases of research to answer these questions: 1) How does the Brains On! podcast mediate STEM-based joint media engagement and family learning in an automobile setting? 2) What does STEM based joint media engagement and family learning look and sound like in this setting? 3) How do "in-automobile" factors foster or impede STEM-based joint media engagement and family learning? Phase 1 is a listener experience video study of 30 families listening to the Brains On! episodes. Phase 2 is video-based case studies of the natural automobile-based listening behaviors of eight Phase 1 families. Phase 3 is an online survey of Brains On! listeners to understand how representative the findings from Phases 1 and 2 are to the larger Brains On! Research. Results will be shared widely with key audiences that can use the findings (media developers, ISE practitioners, ISE evaluators and researchers, and families). It will also make an important contribution to the Joint Media Engagement literature and the ISE field.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This Research in Service to Practice project will bring together representatives from six long-standing youth programs, experts in the field of out-of-school-time youth programming, and education researchers to collaboratively explore the long-term (15-25 years) impact of STEM-focused, intensive (100+ hours/year), multi-year programming. The six partnering programs have maintained records with a combined total of over 3000 alums who participated between 1995 and 2005. This four-year research project uses an explanatory, sequential, mixed-method design to carry out four steps: (1) identify and describe the impact on the lives of program alums who are now ages 30 to 45; (2) identify causal pathways from program strategies to long-term outcomes; (3) develop an understanding of these pathways from the perspective of the people who experienced them; and (4) disseminate this knowledge broadly to those associated with STEM-focused programming. Research questions include: How did these programs affect youth's lives as they progressed toward and into adulthood? What program strategies and what participant attributes contributed most to the staying power of these effects? What life events and social structures supported and inhibited participant outcomes? This project describes the effects, identifies the causal pathways, and produces materials that programs can use for both strategic planning and generating support resources. Additionally, this project provides research methodology for organizations that want to conduct their own retrospective research and lays a foundation for a more comprehensive study that includes programs without historical documentation. The project aligns with NSF's Big Idea "NSF INCLUDES: Transforming education and career pathways to help broaden participation in science and engineering" by providing essential information about the long-term effect of interventions on educational and career pathways in STEM.
The project's approach involves three phases: (1) research preparation, (2) causal structural modeling of survey data from approximately 2,000 respondents, and (3) rich qualitative follow-up. Human ecological and self-determination theories inform data collection and analyses at every project phase. In the preparation phase, program staff complete program profiles from an historic perspective by identifying program strategies that may have included, for example, scientific research, robotics development, teaching science in informal settings, and working in scientific research labs. In the quantitative phase, the project will recruit alums who attended one of the 6 youth programs between 1995 and 2005 to submit a current resume and complete an online questionnaire, based on the following scaled variables: retrospective recall of basic psychological need satisfaction and frustration in relation to perceived program strategies; STEM identity (at three time periods: pre-program; post-program; and current); current well-being; career influences; and career barriers. The questionnaire also includes open-ended questions about life events related to the following categories: family and friends, school and work, and living conditions. Analysis of the questionnaire will lead to development of a causal structural model. In the qualitative phase, data will be collected from a purposefully selected sample of 30 alums based on findings from the quantitative phase. Methods include interviews, photo journals, and STEM pathways maps. Analysis of interviews, resumes, and photo journals take place within the structure of basic psychological need satisfaction and motivational quality across ecological systems over time. Qualitative analysis uses the constant comparative method, and findings are used to update and refine the final causal structural model and inform overall findings, conclusions, and recommendations of the project.
Since the 1990s, out-of-school time programs have engaged youth from underserved communities in STEM learning and in building interest in STEM careers, yet these programs often based on untested assumptions that participation has lasting effects on education, career, and life choices related to STEM. This Research in Service to Practice project has the potential to 1) guide practitioners in program improvement and improved program outcomes; 2) provide insight into achieving program goals, such as equity, increased well-being of participants, an informed citizenry, and a diversified STEM workforce; and 3) inform multi-stakeholder decision-making with respect to this type of programming. This research also builds a foundation of research data collection and analysis methods to guide and support future research on long term-impacts and youth STEM programming. Dissemination strategies include a website, webinars, video, infographics, conference presentations, and written reports to reach stakeholders including practitioners, researchers, administrators, and funders.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This project examines the conditions in which families and young learners most benefit from "doing science and math" together among a population that is typically underserved with respect to STEM experiences--families experiencing poverty. This project builds on an existing program called Teaching Together that uses interactive parent-child workshops led by a museum educator and focused on supporting STEM learning at home. The goal of these workshops is to increase parents'/caregivers' self-perception and ability to serve as their child's first teacher by supporting learning and inquiry conversations during daily routines and informal STEM activities. Families attend a series of afternoon and evening workshops at their child's preschool center and at a local children's museum. Parents/Caregivers may participate in online home learning activities and museum experiences. The project uses an experimental design to test the added value of providing incremental supports for informal STEM learning. The study uses an experimental design to address potential barriers parents/caregivers may perceive to doing informal STEM activities with their child. The project also explores how the quantity and quality parent-child informal learning interactions may relate to changes in children's science and mathematics knowledge during the pre-kindergarten year. The project partners include the Children's Learning Institute at the University of Texas Health Science Center at Houston and the Children's Museum of Houston.
The project is designed to increase understanding of how parents/caregivers can be encouraged to support informal STEM learning by experimentally manipulating key aspects of the broader expectancy-value-cost motivation theory, which is well established in psychology and education literatures but has not been applied to preschool parent-child informal STEM learning. More specifically, the intervention conditions are designed to identify how specific parent supports can mitigate potential barriers that families experiencing poverty face. These intervention conditions include: modeling of informal STEM learning during workshops to address skills and knowledge barriers; materials to address difficulties accessing science and math resources; and incentives as a way to address parental time pressures and/or costs and thereby improve involvement in informal learning activities. Intervention effects will be calculated in terms of effect sizes and potential mediators of change will be explored with structural equation modeling. The first phase of the project uses an iterative process to refine the curriculum and expand the collection of resources designed for families of 3- to 5-year-olds. The second phase uses an experimental study of the STEM program to examine conditions that maximize participation and effectiveness of family learning programs. In all, 360 families will be randomly assigned to four conditions: 1) business-as-usual control; 2) the Teaching Together core workshop-based program; 3) Teaching Together workshops + provision of inquiry-based STEM activity kits for the home; and 4) Teaching Together workshop + activity kits + provision of monetary incentives for parents/caregivers when they document informal STEM learning experiences with their child. The interventions will occur in English and Spanish. A cost analysis across the interventions will also be conducted. This study uses quantitative and qualitative approaches. Data sources include parent surveys and interviews, conversation analysis of home learning activities, parent photo documentation of informal learning activities, and standardized assessments of children's growth in mathematics, science, and vocabulary knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will build and test a new model for co-created public engagement with science activities in partnership with civic, community, and scientist partners. The innovation to be tested is deliberative dialogues in science museums that help reduce the polarization about socio-scientific issues, giving people a greater voice in science, and addressing barriers that disconnect scientists from the public. The project will engage four target audiences (informal science education/ISE professionals, civic, community and scientist partners). Science museum partners include Museum of Science (MOS) Boston, Oregon Museum of Science, the Michigan Science Center, and the North Carolina Museum of Life and Science. The project is designed to have a strategic impact on how ISE institutions choose topics of STEM engagement and build public Forum programs.
There will be two evaluation teams for the project. MOS Research and Evaluation will act as formative evaluation mentors for the four partner sites as they co-create their forums. They will provide evaluation capacity building for the sites using team-based inquiry as they create and understand the potential impacts and outcomes of the model. Data collection will include panel surveys and focus groups. The evaluation will explore how the forums can decrease 1) public polarization around STEM topics and (2) the disconnect between scientists, civic organization, and the public. The external summative evaluation will be conducted by Rockman et al (REA). They will conduct a study of the project's process to help the team identify challenges and strategies for overcoming them as they work through the phases of public engagement. The summative study will focus on the project goals taking a qualitative approach. Early interviews with partner participants will explore their strengths and weaknesses in taking on this type of public engagement model including the extent of their previous work with civic partners. Later interviews will investigate what factors have enabled or hindered this project. Summative evaluation questions will also address changes in attitudes toward public engagement with science. REA will collect feedback from summit attendees through intercept interviews and post-surveys administered within a week at the event's conclusion to explore the any changes in knowledge or confidence in undertaking this type of model. REA will present findings from the external evaluation during the annual meeting of the Association of Science-Technology Centers and publish reports to Informalscience.org. Once the model has been developed and tested it will be disseminated to an initial group of 25-30 science museums and eventually to the entire ISE museum field.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The intent of this five-year project is to design, deliver, and study professional development for Informal Science Learning (ISL) educators in the arena of equity-focused STEAM (Science, Technology, Engineering, Art, and Mathematics) teaching and learning. While the strategy of integrating art and science to promote interest, identity, and other STEM-related learning has grown in recent years, this domain is still nascent with respect to a guiding set of best practices. Through prior work, the team has developed and implemented a set of design principles that incorporate effective practices for broadening participation of girls in science via science-art integration on the topic of the biology, chemistry and optics of "Colors in Nature." The continued initiative would impact the ISL field by providing a mechanism for ISL educators in museums, libraries and after-school programs to adopt and implement these STEAM design principles into their work. The team will lead long-term (12-18 months) professional development activities for ISL educators, including: 1) in-person workshops that leverage their four previously developed kits; 2) online, asynchronous learning activities featuring interactive instructional videos around their STEAM design principles; 3) synchronous sessions to debrief content and foster communities of practice; and 4) guided design work around the development or redesign of STEAM activities. In the first four years of the project, the team will work with four core institutional partners (Sitka Sound Science Center, Sno-Isle Libraries, the Fairbanks North Star Borough School District after-school program, and the Pima County Public Library system) across three states (Alaska, Washington, and Arizona). In the project's later stages, they will disseminate their learning tools to a broad, national audience. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project has three main goals: (1) To support ISL educators in offering meaningful STEAM activities, (2) To create institutional change among the partner organizations, and (3) To advance the ISL field with respect to professional development and designing for STEAM Programming. The research questions associated with the professional development activities address the ways in which change occurs and focus on all three levels: individual, institutional, and the ISL field. The methods are qualitative and quantitative, including videotaped observations, pre and post interviews, surveys and analysis of online and offline artifacts. In addition, the project evaluation will assess the implementation of the project's professional development model for effectiveness. Methods will include observations, interviews, surveys and Website analytics and program data.