Skip to main content

Community Repository Search Results

resource project Media and Technology
This project will research and develop the Circuit, a mobile phone and web-based application that will empower families and the general public to discover the broad spectrum of informal Science, Technology, Engineering and Mathematics (STEM) opportunities that exist in most communities. These informal STEM resources include science and children's museums, science and computer camps, maker spaces, afterschool programs, citizen science and much more. There is currently no "one-stop" searching for these resources. Instead, participants must conduct multiple, inefficient Internet searches to find the sought for STEM resources. The Circuit will enable users to efficiently search a rich informal STEM database, identifying resources by location, geography, age levels, science discipline, type of program and other factors. The Circuit builds on SciStarter, an existing online platform that connects thousands of prospective and active citizen scientists to citizen science projects. SciStarter has made possible the collection and organization of several thousand citizen science projects that would otherwise be scattered across the web. The Circuit will build on SciStarter's technical achievements in the citizen science sector, while systematically encompassing the offerings of established national networks. By integrating existing networks of informal STEM resources, the app will afford the public with unrivaled access to informal STEM opportunities, while collecting data that reveals patterns of engagement towards understanding factors of influence between different types of STEM experiences.

The app will provide researchers with new opportunities for researching how families and adults participate in the ecosystem of informal STEM resources in their communities. The Circuit will develop web tools to aggregate and organize digital content from trusted, currently siloed, informal STEM networks of content providers. These include science festivals, science and children's museums, the American Association for the Advancement of Science (AAAS), and Discover Magazine (3 million readers), the largest general interest science publication. Each content partner will feed the app with information directly or through their membership and encourage adoption of The Circuit within their respective communities. The project will design digital tools, including APIs (application program interfaces) to acquire and share digital content, embeddable tools to record and analyze data about movement, engagement, and persistence across domains, and social media tools and related APIs to distribute, track, and analyze content, engagement and demographics. (An API is a code that allows two software programs to communicate with each other.) The project will conduct small-scale, proof-of-conduct studies, to test the viability of the platform to support future, independent full-scale research. An analytics dashboard will be designed and tested with partners, researchers, and evaluators to ensure access to data on patterns of visits, clicks, referrals, searches, "joins," bookmarks, shares, contributions, user-locations, persistence, and more, within and across domains. Because each partner will feed their analytics into the shared dashboard, this will provide unprecedented and much-needed data to advance research in informal STEM learning. The Circuit will allow the tracking of patterns of engagement across networks and programs. Anonymized analytics of behavioral data from end users of The Circuit will support new approaches to advance evidence-based understanding of connected informal STEM learning by exhibiting engagement patterns across informal STEM domains. Through volunteer participation by the public, the Circuit will explore the geographic and demographic patterns of participants in the system, and derive important design lessons for its own and future efforts to create curated systems of connected learning across STEM education in informal settings.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
resource project Media and Technology
Polar Literacy: A model for youth engagement and learning will foster public engagement with polar science. The project targets middle-school aged underserved youth and polar research scientists, with the goal to increase youth interest in and understanding of Polar Regions, and to hone researchers' science communication skills. The project will develop affordable and replicable ways of bringing polar education to informal learning environments, extend our understanding of how polar education initiatives can be delivered to youth with maximum effect, and design a professional development model to improve the capacity for Polar Region researchers to craft meaningful broader impact activities. Polar Literacy will create and test a model which combines direct participation by scientists in after-school settings, with the use of curated polar research data sets and data visualization tools to create participatory learning experiences for youth. Beyond the life of the project funding, many of the project deliverables (including kits, videos, and other resources) will continue to be used and disseminated online and in person through ongoing work of project collaborators.

Polar Literacy: A model for youth engagement and learning will advance the understanding of informal learning environments while leveraging the rich interdisciplinary resources from polar investments made by the National Science Foundation (NSF). The project's key audiences -- polar researchers, informal educators, and out-of-school time (OST) youth in grades 4-7 (ages 9-13) -- will connect through both place-based and internet-based experiences and work collaboratively to generate a flexible, scalable, and transferable education model. The project will 1) design OST kits and resource guides (focused on Polar Literacy Principles) and include "Concept in a Minute" videos designed to highlight enduring ideas, 2) provide professional development for informal educators, 3) synthesize a club model through adaptation of successful facets of existing informal learning programs, and 4) create Data Jam events for the OST Special Interest (SPIN) clubs and camp programs by modifying an existing formal education model. A research design, implemented at four nodes over three years, will answer three research questions to evaluate the impact of professional development on informal educators, as well as the impact of programs on youth, and the effectiveness of the model. In addition to the project team and collaborators who are informal education practitioners, an advisory board composed of experts in youth programming, informal education, and evaluation will guide the project to ensure that it advances the body of informal STEM learning research.

Polar Literacy is an Advancing Informal STEM Learning (AISL) Innovations in Development project in response to the Dear Colleague Letter: Support for Engaging Students and the Public in Polar Research (NSF 18-103). Polar Literacy is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (Science, Technology, Engineering, Mathematics) learning in informal environments. This project has co-funding support from the Antarctic section of the Office of Polar Programs.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Janice McDonnell Oscar Schofield Charles Lichtenwalner Jason Cervenec
resource project Media and Technology
Familiarity with statistical and data literacy is important in many areas of modern life, but there is little research on how adults continue to build mathematical literacy beyond formal schooling. Mass media science news stories contain much data, assuming that adults will understand the content.This 4-year project will first map the landscape of adult statistical literacy in the US, particularly as it relates to news consumption. The second phase will build on results from the first phase through a longitudinal study. In the third phase, the project will develop a range of experiments to manipulate mathematical explainers embedded in STEM news stories and test techniques with adult audiences, with the goal of identifying the attributes and affordances that best improve confidence and competence in the underlying math principles and their meaning to news stories. in addition to the research, project components include 12 broadcast video and social media pieces each year that will form the basis for testing with audiences, a one-day symposium for professional science journalists, and a written best practice guide that summarizes key findings and implications for practitioners.

Critical research questions are: How do mathematical competence and confidence differ among different segments of the adult population? How can STEM journalists improve adult mathematical competence and confidence through their reporting techniques? Phase 1 of the research will be a landscape review of mathematical content in the news including a baseline study of adult statistical literacy. Phase 2 will be a longitudinal study with news audiences recruited to participate in a panel study. Phase 3 will be iterative testing of the digital content based on the findings from Phases 1 and 2 and will use both focus groups and online testing. External evaluation will be conducted by TERC including an evaluation of the symposium for professional journalists.

The broader impacts of this project are twofold: the science videos created will be broadcast and made available free to a national audience including those in rural areas; and the training of science journalists has the potential for multiple, long term impact by increasing their ability to communicate statistics meaningfully to their readers/viewers.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
resource project Media and Technology
Families play a large role in igniting children's interest in science pathways, but they may not always have access to high-quality materials that demonstrate clear connections between science and their daily lives. This project will address this issue by developing high-interest materials that teach the science of food preparation to families with children ages 7-13. These materials include the following four components: (a) Food Labs, food-based investigations taking place in museums or in food service facilities; (b) take-home kits allowing families to conduct similar types of Food Labs at home; (c) a series of question starters called Promoting Interest and Engagement in Science (PIES) designed to facilitate meaningful family conversations around food preparation; and (d) a mobile app designed to deepen families' understandings of relevant science concepts and containing embedded measures of STEM learning. This project will advance knowledge regarding features of take-home materials that foster family science learning and ignite children's interest in science pathways.

This Innovations in Development Project will result in empirically-tested instructional materials that support families, with children ages 7-13, in conducting scientific investigations and holding scientific conversations related to food preparation. Kent State University, in partnership with The Cincinnati Museum Center and La Soupe, a food service provider for families who face food insecurity, will collaboratively develop and test the four interrelated sets of instructional materials mentioned above that are designed to deepen families' scientific content knowledge related to the chemistry of food preparation. To iteratively design and evaluate these materials, the team will conduct both laboratory and in-vivo experiments using a Solomon design with a pre- and post-demonstration survey. The survey will measure children's interest, knowledge, and engagement. For a month after interacting with instructional materials, families will document their science activity at home through the app. Additionally, through analyzing audio-recordings, the team will determine whether and how families ask questions using the PIES materials. Finally, post-demonstration interviews with participating families will focus on the usability and accessibility of the instructional materials. Quantitative and qualitative analyses of the pre-post surveys, interview transcripts, and audio-recordings will be used to improve the instructional materials, and the revised materials will be re-assessed using the same experimental methods and outcome measures. The final set of instructional materials will be developed and widely disseminated for easy use at other science museums, food service providers, and in families' homes. This project leverages partnerships to generate empirical knowledge on features of learning environments that support family science learning and engagement, resulting in empirically-based materials designed to broaden participation in science. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Bradley Morris John Dunlosky Whitney Owens
resource project Public Programs
The role of afterschool programs in the science, technology, engineering, and mathematics (STEM) learning ecosystem has grown over the past two decades, which has led to increasing efforts to support and improve program quality. These efforts include developing STEM programs and curricula, creating standards for facilitating informal STEM learning experiences, building networks of support, and developing tools for assessment and evaluation. However, such efforts may have limited impact in terms of ongoing quality improvement. STEM curricula vary in disciplinary focus, quality and may not apply to local contexts and needs. Many afterschool programs resort to using simple STEM kits or online activities rather than rigorous curricula with support for educators. The project will study how the California Department of Education's (CDE) efforts to change organizational culture to support continuous quality improvement (CQI) have affected the offerings and quality of afterschool STEM in the state's more than 4,500 publicly funded afterschool sites. The EPISTEMIC project will contribute new research findings on how CQI can increase access to higher quality STEM learning opportunities for underserved youth. Even more important, the project will provide new insights on how organizational culture affects participation in and implementation of afterschool CQI.

The team will use an organizational theory framework and a mixed methods approach to conduct three research activities: (1) Describe the organizational context through interviews, participant observations, and artifact analysis to map and describe the overall support system as a context for understanding organizational culture change; (2) Describe change over time in organizational culture, CQI processes, and STEM program offerings and quality through surveys/interviews of afterschool youth, staff, directors, and grantee representatives; and (3) Generate explanations about the relationships between organizational culture, CQI, and STEM quality in different contexts through in depth case studies. Bringing organizational culture, CQI, and STEM offerings and quality into shared focus is the most important intellectual contribution of this work. Organizational theory's sensemaking concept will guide analyses to describe, exemplify, and generate theoretical explanations for patterns in organizational culture, CQI, and STEM program changes, with attention to relevant contextual factors.

Continuous quality improvement provides tools for afterschool STEM staff to identify needs and ways to improve. The EPISTEMIC study will contribute recommendations on the systemic, organizational, and cultural aspects of improvement strategies relevant to policymakers, funders, support providers, and afterschool organizations in California, as well as other state or nongovernmental support systems around the country. The study will also produce CQI guidelines for reflecting on and incorporating changes to organizational culture as part of CQI for afterschool staff and site directors. These will be helpful for practitioners around the country. The study's focus on three organizational contexts -- school district, national afterschool, and local afterschool -- will extend the relevance of the findings and recommendations, which will be disseminated through forums, workshops, and articles in practice and policy-oriented publications. The study will also benefit the research community by providing a framework and methods for studying organizational culture and CQI. The findings on the relationships between organizational culture, CQI, and STEM offerings and outcomes will provide a foundation for further research on how these relate to STEM learning outcomes for youth. EPISTEMIC is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Patrik Lundh Andrea Beesley Timothy Podkul Carrie Allen
resource project Exhibitions
The project will refine, research and disseminate making exhibits and events that the museum has developed and tested to support early engineering skill development. The project will use cardboard, a familiar and flexible material, to support the activities. The goal is to develop insights and resources for informal educators across the museum field and beyond into how to effectively structure and facilitate open-ended maker education experiences for visitors that expand the number and kinds of museums and families who can engage in these activities. Maker education is often linked to Science, Technology, Engineering and Mathematics (STEM) learning and uses hands-on and collaborative approaches to support activities and projects that foster creativity, interest, and skill development. To address patterns of inequitable access to and participation in both formal and informal learning opportunities, the project will be designed to engage families from under-represented communities and research how they participate in informal engineering activities and environments. The project will make a suite of resources available for museums and other ISE practitioners that will be developed through iterative testing at all of the different settings. These resources will be made widely available via an open access online portal.

The project will research how effectively the use of cardboard making exhibits and events engage families, particularly families from underrepresented groups, in STEM and early engineering. The project's theoretical framework combines elements of: (1) learning sciences theories of family learning in museums; (2) making as a learning process; (3) early engineering practices and dispositions, and (4) equity in museums and the maker movement. The research will be conducted within two multi-month implementations of a large-scale Cardboard Engineering gallery at the Science Museum of Minnesota and two-week scaled implementations of the gallery at each of three recruited partner museum sites. The project design interweaves evaluation and research aims. Paired observations and surveys will be used to research how effectively the project is working in different venues. This integration of research and evaluation will generate a large data set from which to generalize about cardboard making across contexts. Case studies will be used to identify barriers to engagement that can be remedied, but they will provide a rich data set for understanding family learning and engineering in making. Research findings and products will be posted on the Center for Informal Science Education website and submitted for publication in peer-reviewed journals such as Visitor Studies, ASTC Dimensions, the Journal of Pre-College Engineering Education Research and others.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
resource project Media and Technology
This four-year research study will investigate families' joint media engagement (JME) and informal STEM learning while listening to the child-focused STEM podcast, Brains On! Prior research has shown that the setting where families most often listen to this podcast together is the family automobile as children are being driven to school, on road trips, or other activities. Brains On! is rooted in the mission-driven principle of public radio to educate and inspire. The target audience is children 5-12 years old and their parents or caregivers. Each episode ranges from 20-45 minutes in length and presents ideas from a variety of STEM disciplines such as physics, chemistry, biology and engineering featuring sound-rich explanations of concepts through fun skits, original songs and interviews with scientists. The episodes use a light-hearted, humorous approach to share oftentimes complex STEM information. To provide an interactive experience, hosts encourage the audience to participate with the show by sending in drawings, emailing photos of plants and animals, or posing questions to be answered in future episodes. Every episode is co-hosted by a different child who interviews top scientists about their work. The scientists are selected to be representative of the range of topics presented and are meant to serve as role models for the listeners and demonstrating a wide range of career options in the STEM field.

The research adds to the social learning theory of joint media engagement (JME) which has shown that interactions between people sharing a media experience can result in learning together. Recent work on Joint Media Engagement has focused on parent/child interactions with television/video in the home. But little is known about how families engage with children's STEM podcasts together and what learning interactions occur as a result. Even less is known about this engagement within an automobile setting. This research project will build new knowledge filling a gap in the informal STEM learning field. It will use a mixed-methods research design with three phases of research to answer these questions: 1) How does the Brains On! podcast mediate STEM-based joint media engagement and family learning in an automobile setting? 2) What does STEM based joint media engagement and family learning look and sound like in this setting? 3) How do "in-automobile" factors foster or impede STEM-based joint media engagement and family learning? Phase 1 is a listener experience video study of 30 families listening to the Brains On! episodes. Phase 2 is video-based case studies of the natural automobile-based listening behaviors of eight Phase 1 families. Phase 3 is an online survey of Brains On! listeners to understand how representative the findings from Phases 1 and 2 are to the larger Brains On! Research. Results will be shared widely with key audiences that can use the findings (media developers, ISE practitioners, ISE evaluators and researchers, and families). It will also make an important contribution to the Joint Media Engagement literature and the ISE field.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Amy Grack Nelson Molly Bloom
resource project Exhibitions
There is a dearth of prominent STEM role models for underrepresented populations. For example, according to a 2017 survey, only 3.1% of physicists in the United States are Black, only 2.1% are Hispanic, and only 0.5% are Native American. The project will help bridge these gaps by developing exhibits that include simulations of historical scientific experiments enacted by little-known scientists of color, virtual reality encounters that immerse participants in the scientists' discovery process, and other content that allows visitors to interact with the exhibits and explore the exhibits' themes. The project will develop transportable, interactive exhibits focusing on light: how we perceive light, sources of light from light bulbs to stars, uses of real and artificial light in human endeavors, and past and current STEM innovators whose work helps us understand, create, and harness light now. The exhibits will be developed in three stages, each exploring a characteristic of light (Color, Energy, or Time). Each theme will be explored via multiple deliveries: short documentary and animated films, virtual reality experiences, interactive "photobooths," and technology-based inquiry activities. The exhibit components will be copied at seven additional sites, which will host the exhibits for their audiences, and the project's digital assets will enable other STEM learning organizations to duplicate the exhibits. The exhibits will be designed to address common gaps in understanding, among adults as well as younger learners, about light. What light really is and does, in scientific terms, is one type of hidden story these exhibits will convey to general audiences. Two other types of science stories the exhibits will tell: how contemporary research related to light, particularly in astrophysics, is unveiling the hidden stories of our universe; and hidden stories of STEM innovators, past and present, women and men, from diverse backgrounds. These stories will provide needed role models for the adolescent learners, helping them learn complex STEM content while showing them how scientific research is conducted and the diverse community of people who can contribute to STEM innovations and discoveries.

The project deliverables will be designed to present complex physics content through coherent, immersive, and embodied learning experiences that have been demonstrated to promote engagement and deeper learning. The project will research whether participants, through interacting with these exhibits, can begin to integrate discrete ideas and make connections with complex scientific content that would be difficult without technology support. For example, students and other novices often lack the expertise necessary to make distinctions between what is needed and what is extra within scientific problems. The proposed study follows a Design-Based Research (DBR) approach characterized by iterative cycles of data collection, analysis, and reflection to inform the design of educational innovations and advance educational theory. Project research includes conceiving, building, and testing iterative phases, which will enable the project to capture the complexity of learning and engagement in informal learning settings. Research participants will complete a range of research activities, including focus group interviews, observation, and pre-post assessment of science content knowledge and dispositions.

By showcasing such role models and informing about related STEM content, this project will widen perspectives of audiences in informal learning settings, particularly adolescents from groups underrepresented in STEM fields. Research findings and methodologies will be shared widely in the informal STEM learning community, building the field's knowledge of effective ways to broaden participation in informal science learning, and thus increase broaden participation in and preparation for the STEM-based workforce.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Todd Boyette Jill Hamm Janice Anderson Crystal Harden
resource project Media and Technology
It is estimated that there could be 40 billion earth-sized planets orbiting in the habitable zones of stars in the Milky Way. Major advances in long range telescopes have allowed astronomers to identify thousands of exoplanets in recent decades, and the discovery of new exoplanets is a now a common occurrence. Public excitement for the discoveries grown alongside these discoveries, thus opening new possibilities for inspiring a new generation of scientists and engineers that may dream of one day visiting these planets. This project investigates the use of interactive, intelligent educational technologies to generate interest in STEM by allowing learners to explore and even create their own exoplanets. Research will occur across several informal learning contexts, including summer camps, after school programs, planetarium shows, and at home. The approach is based on the idea of "What if?"questions about Earth (e.g., "What if the Moon did not exist?"), designed to trigger interest in STEM and frame exploratory and elaborative discussions around hypothetical science questions that are subsequently linked to the search for habitable exoplanets. Learners are able to interact with and explore scientifically accurate simulations of alternative versions of Earth, while making observations and posing explanations for what they see. Technology-based informal learning experiences designed to act as triggers for and sustainment of interest in STEM have the potential to plug the leaky STEM pipeline, and thus have profound implications for the future of science and technology in the United States.

The project seeks to advance the science of designing technologies for promoting interest in STEM and informal astronomy education in several ways. First, the project will develop simulations for exploratory learning about astronomy and planetary science. These simulations will present hypothetical worlds based on what-if questions and feasible models of known exoplanets, thus giving learners a chance to better understand the challenges of finding a habitable world and learning about what is needed to survive there. Second, a new PBS NOVA Lab will be developed that will focus on Exoplanet education. This web-based activity has the potential to reach millions of learners and will help them understand how planets are formed and the requirements for supporting life. Learners who use the lab will have an opportunity to invent their own exoplanets and export them for first-person exploration. Third, researchers on the project will design and implement Artificial Intelligence-based pedagogical agents to support learning and promote interest. These agents will inhabit the simulations with the learner, acting as a coach and guide, and be designed to be culturally responsive and personalized based on learner preferences. Fourth, interactive exoplanet-focused planetarium shows, that will involve live interaction with simulations, will take place at the Fiske Planetarium (Boulder, CO). Finally, the project will develop a server-based infrastructure for tracking and supporting long term development of interest in STEM. This back-end will track fine-grained behaviors, including movement, actions, and communications in the simulations. Such data will reveal patterns about how interest develops, how learners engage in free-choice learning activities, and how they interact with agents and peers in computer simulations. A design-based research methodology will be employed to assess the power of these different experiences to trigger interest and promote learning of astronomy. A range of different pathways for interest in STEM will therefore be considered and assessed. Research will measure the power of these experiences to trigger interest in STEM and promote re-engagement over time. Innovation lies in the use of engaging and intelligent technologies with thought-provoking pedagogy as a method for extended engagement of diverse young learners in STEM. Project research and educational resources will be widely disseminated to researchers, designers developers and the general public via peer-reviewed research journals, conference presentations, informal STEM education networks of science museums, children's museums, Fab Labs, and planetariums, and public media such as public television's NOVA science program website.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: H Chad Lane Neil Comins Jorge Perez-Gallego David Condon
resource project Public Programs
This Research in Service to Practice project will bring together representatives from six long-standing youth programs, experts in the field of out-of-school-time youth programming, and education researchers to collaboratively explore the long-term (15-25 years) impact of STEM-focused, intensive (100+ hours/year), multi-year programming. The six partnering programs have maintained records with a combined total of over 3000 alums who participated between 1995 and 2005. This four-year research project uses an explanatory, sequential, mixed-method design to carry out four steps: (1) identify and describe the impact on the lives of program alums who are now ages 30 to 45; (2) identify causal pathways from program strategies to long-term outcomes; (3) develop an understanding of these pathways from the perspective of the people who experienced them; and (4) disseminate this knowledge broadly to those associated with STEM-focused programming. Research questions include: How did these programs affect youth's lives as they progressed toward and into adulthood? What program strategies and what participant attributes contributed most to the staying power of these effects? What life events and social structures supported and inhibited participant outcomes? This project describes the effects, identifies the causal pathways, and produces materials that programs can use for both strategic planning and generating support resources. Additionally, this project provides research methodology for organizations that want to conduct their own retrospective research and lays a foundation for a more comprehensive study that includes programs without historical documentation. The project aligns with NSF's Big Idea "NSF INCLUDES: Transforming education and career pathways to help broaden participation in science and engineering" by providing essential information about the long-term effect of interventions on educational and career pathways in STEM.

The project's approach involves three phases: (1) research preparation, (2) causal structural modeling of survey data from approximately 2,000 respondents, and (3) rich qualitative follow-up. Human ecological and self-determination theories inform data collection and analyses at every project phase. In the preparation phase, program staff complete program profiles from an historic perspective by identifying program strategies that may have included, for example, scientific research, robotics development, teaching science in informal settings, and working in scientific research labs. In the quantitative phase, the project will recruit alums who attended one of the 6 youth programs between 1995 and 2005 to submit a current resume and complete an online questionnaire, based on the following scaled variables: retrospective recall of basic psychological need satisfaction and frustration in relation to perceived program strategies; STEM identity (at three time periods: pre-program; post-program; and current); current well-being; career influences; and career barriers. The questionnaire also includes open-ended questions about life events related to the following categories: family and friends, school and work, and living conditions. Analysis of the questionnaire will lead to development of a causal structural model. In the qualitative phase, data will be collected from a purposefully selected sample of 30 alums based on findings from the quantitative phase. Methods include interviews, photo journals, and STEM pathways maps. Analysis of interviews, resumes, and photo journals take place within the structure of basic psychological need satisfaction and motivational quality across ecological systems over time. Qualitative analysis uses the constant comparative method, and findings are used to update and refine the final causal structural model and inform overall findings, conclusions, and recommendations of the project.

Since the 1990s, out-of-school time programs have engaged youth from underserved communities in STEM learning and in building interest in STEM careers, yet these programs often based on untested assumptions that participation has lasting effects on education, career, and life choices related to STEM. This Research in Service to Practice project has the potential to 1) guide practitioners in program improvement and improved program outcomes; 2) provide insight into achieving program goals, such as equity, increased well-being of participants, an informed citizenry, and a diversified STEM workforce; and 3) inform multi-stakeholder decision-making with respect to this type of programming. This research also builds a foundation of research data collection and analysis methods to guide and support future research on long term-impacts and youth STEM programming. Dissemination strategies include a website, webinars, video, infographics, conference presentations, and written reports to reach stakeholders including practitioners, researchers, administrators, and funders.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
resource project Exhibitions
This project responds to calls to increase children's exposure and engagement in STEM at an early age. With the rise of the maker-movement, the informal and formal education sectors have witnessed a dramatic expansion of maker and tinkering spaces, programs, and curricula. This has happened in part because of the potential benefits of tinkering experiences to promote access and equity in engineering education. To realize these benefits, it is necessary to continue to make and iterate design and facilitation approaches that can deepen early engagement in disciplinary practices of engineering and other STEM-relevant skills. This project will investigate how stories can be integrated into informal STEM learning experiences for young children and their families. Stories can be especially effective because they bridge the knowledge and experiences young children and their caregivers bring to tinkering as well as the conversations and hands-on activities that can extend that knowledge. In addition, a unique contribution of the project is to test the hypothesis that stories can also facilitate spatial reasoning, by encouraging children to think about the spatial properties of their emerging structures.

This project uses design-based research methods to advance knowledge and the evidence base for practices that engender story-based tinkering. Using conjecture mapping, the team will specify their initial ideas and how it will be evident that design/practices impact caregivers-child behaviors and learning outcomes. The team will consider the demographic characteristics, linguistic practices, and funds of knowledge of the participants to understand the design practices (resources, activities) being implemented and how they potentially facilitate learning. The outcome of each study/DBR cycle serves as inputs for questions and hypotheses in the next. A culturally diverse group of 300+ children ages 5 to 8 years old and their parents at Chicago Children's Museum's Tinkering Lab will participate in the study to examine the following key questions: (1) What design and facilitation approaches engage young children and their caregivers in creating their own engineering-rich tinkering stories? (2) How can museum exhibit design (e.g., models, interactive displays) and tinkering stories together engender spatial thinking, to further enrich early STEM learning opportunities? and (3) Do the tinkering stories children and their families tell support lasting STEM learning? As part of the overall iterative, design-based approach, the team will also field test the story-based tinkering approaches identified in the first cycles of DBR to be most promising.

This project will result in activities, exhibit components, and training resources that invite visitors' stories into open-ended problem-solving activities. It will advance understanding of mechanisms for encouraging engineering learning and spatial thinking through direct experience interacting with objects, and playful, scaffolded (guided) problem-solving activities.


This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Tsivia Cohen Kim Koin Natalie Bortoli Catherine Haden David Uttal Maria Marcus
resource project Informal/Formal Connections
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This project examines the conditions in which families and young learners most benefit from "doing science and math" together among a population that is typically underserved with respect to STEM experiences--families experiencing poverty. This project builds on an existing program called Teaching Together that uses interactive parent-child workshops led by a museum educator and focused on supporting STEM learning at home. The goal of these workshops is to increase parents'/caregivers' self-perception and ability to serve as their child's first teacher by supporting learning and inquiry conversations during daily routines and informal STEM activities. Families attend a series of afternoon and evening workshops at their child's preschool center and at a local children's museum. Parents/Caregivers may participate in online home learning activities and museum experiences. The project uses an experimental design to test the added value of providing incremental supports for informal STEM learning. The study uses an experimental design to address potential barriers parents/caregivers may perceive to doing informal STEM activities with their child. The project also explores how the quantity and quality parent-child informal learning interactions may relate to changes in children's science and mathematics knowledge during the pre-kindergarten year. The project partners include the Children's Learning Institute at the University of Texas Health Science Center at Houston and the Children's Museum of Houston.

The project is designed to increase understanding of how parents/caregivers can be encouraged to support informal STEM learning by experimentally manipulating key aspects of the broader expectancy-value-cost motivation theory, which is well established in psychology and education literatures but has not been applied to preschool parent-child informal STEM learning. More specifically, the intervention conditions are designed to identify how specific parent supports can mitigate potential barriers that families experiencing poverty face. These intervention conditions include: modeling of informal STEM learning during workshops to address skills and knowledge barriers; materials to address difficulties accessing science and math resources; and incentives as a way to address parental time pressures and/or costs and thereby improve involvement in informal learning activities. Intervention effects will be calculated in terms of effect sizes and potential mediators of change will be explored with structural equation modeling. The first phase of the project uses an iterative process to refine the curriculum and expand the collection of resources designed for families of 3- to 5-year-olds. The second phase uses an experimental study of the STEM program to examine conditions that maximize participation and effectiveness of family learning programs. In all, 360 families will be randomly assigned to four conditions: 1) business-as-usual control; 2) the Teaching Together core workshop-based program; 3) Teaching Together workshops + provision of inquiry-based STEM activity kits for the home; and 4) Teaching Together workshop + activity kits + provision of monetary incentives for parents/caregivers when they document informal STEM learning experiences with their child. The interventions will occur in English and Spanish. A cost analysis across the interventions will also be conducted. This study uses quantitative and qualitative approaches. Data sources include parent surveys and interviews, conversation analysis of home learning activities, parent photo documentation of informal learning activities, and standardized assessments of children's growth in mathematics, science, and vocabulary knowledge.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Tricia Zucker