This evaluation report provides a brief review of the National Science Foundation (NSF) planning grant, Creating an Early Childhood STEM Ecosystem, as of August 2019. The purpose of the evaluation was to provide an external, independent overview of the work completed and some of the lessons learned to date.
Project SYSTEMIC (A Systems Thinking Approach to STEM Ecosystem Development in Chicago) will apply systems thinking to a community-level STEM ecosystem development effort in one of Chicago's largest and most distressed neighborhoods. The project aims to broaden participation of African American and low-income Chicago Public School students (preK-12) in STEM learning opportunities. The proposed model of collaborative change for this project builds on the work of two coordinated collective impact initiatives--the Chicago STEM Pathways Cooperative and Austin Coming Together, a network of local organizations committed to improving educational and economic outcomes for the community. A key feature of this project is that it adds innovative, interactive, visual problem structuring and solving strategies to highlight and uncover the systemic interdependencies that contribute to the BP challenge for African American youth. The project will convene a series of workshops to engage community stakeholders in the mapping of the STEM ecosystem. A broad and representative cross-section of community stakeholders will design and develop evidence-based STEM ecosystem organizing and implementation strategies. Key outcomes anticipated from this project are the development of a shared understanding, agenda, activities, and commitment to collectively address the underlying challenges of STEM access and participation for African American youth. The goal of this community-driven project is to develop a viable system model that elevates neighborhood voices, historically excluded from the problem-solving table and decision-making processes, to leverage existing assets, build local capacity, increase messaging and awareness of the value of STEM, identify needed new programs, and develop coordination/resource sharing mechanisms across partners to support implementation. The evaluation of this project will be grounded in systems thinking and culturally-responsive approaches that seek to understand the diverse perspectives of stakeholders while measuring progress toward project goals. Evaluation data will be used to assess the problem structuring process, to evaluate the organizational strategy designed to address the structured problem, and to support adaptive learning among stakeholders.
This one-year Collaborative Planning project seeks to bring together an interdisciplinary planning team of informal and formal STEM educators, researchers, scientists, community, and policy experts to identify the elements, activities, and community relationships necessary to cultivate and sustain a thriving regional early childhood (ages 3-6) STEM ecosystem. Based in Southeast San Diego, planning and research will focus on understanding the needs and interests of young Latino dual language learners from low income homes, as well as identify regional assets (e.g., museums, afterschool programs, universities, schools) that could coalesce efforts to systematically increase access to developmentally appropriate informal STEM activities and resources, particularly those focused on engineering and computational thinking. This project has the potential to enhance the infrastructure of early STEM education by providing a model for the planning and development of early childhood focused coalitions around the topic of STEM learning and engagement. In addition, identifying how to bridge STEM learning experiences between home, pre-k learning environments, and formal school addresses a longstanding challenge of sustaining STEM skills as young children transition between environments. The planning process will use an iterative mixed-methods approach to develop both qualitative and quantitative and data. Specific planning strategies include the use of group facilitation techniques such as World Café, graphic recording, and live polling. Planning outcomes include: 1) a literature review on STEM ecosystems; 2) an Early Childhood STEM Community Asset Map of southeast San Diego; 3) a set of proposed design principles for identifying and creating early childhood STEM ecosystems in low income communities; and 4) a theory of action that could guide future design and research. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Increasingly, the prosperity, innovation and security of individuals and communities depend on a big data literate society. Yet conspicuously absent from the big data revolution is the field of teaching and learning. The revolution in big data must match a complementary revolution in a new kind of literacy, through a significant infusion of STEM education with the kinds of skills that the revolution in 21st century data-driven science demands. This project represents a concerted effort to determine what it means to be a big data literate citizen, information worker, researcher, or policymaker; to identify the quality of learning resources and programs to improve big data literacy; and to chart a path forward that will bridge big data practice with big data learning, education and career readiness.
Through a process of inquiry research and capacity-building, New York Hall of Science will bring together experts from member institutions of the Northeast Big Data Innovation Hub to galvanize big data communities of practice around education, identify and articulate the nature and quality of extant big data education resources and draft a set of big data literacy principles. The results of this planning process will be a planning document for a Big Data Literacy Spoke that will form an initiative to develop frameworks, strategies and scope and sequence to advance lifelong big data literacy for grades P-20 and across learning settings; and devise, implement, and evaluate programs, curricula and interventions to improve big data literacy for all. The planning document will articulate the findings of the inquiry research and evaluation to provide a practical tool to inform and cultivate other initiatives in data literacy both within the Northeast Big Data Innovation Hub and beyond.
This one-year Collaborative Planning project seeks to bring together an interdisciplinary planning team of informal and formal STEM educators, researchers, scientists, community, and policy experts to identify the elements, activities, and community relationships necessary to cultivate and sustain a thriving regional early childhood (ages 3-6) STEM ecosystem. Based in Southeast San Diego, planning and research will focus on understanding the needs and interests of young Latino dual language learners from low income homes, as well as identify regional assets (e.g., museums, afterschool programs, universities, schools) that could coalesce efforts to systematically increase access to developmentally appropriate informal STEM activities and resources, particularly those focused on engineering and computational thinking. This project has the potential to enhance the infrastructure of early STEM education by providing a model for the planning and development of early childhood focused coalitions around the topic of STEM learning and engagement. In addition, identifying how to bridge STEM learning experiences between home, pre-k learning environments, and formal school addresses a longstanding challenge of sustaining STEM skills as young children transition between environments.
The planning process will use an iterative mixed-methods approach to develop both qualitative and quantitative and data. Specific planning strategies include the use of group facilitation techniques such as World Café, graphic recording, and live polling. Planning outcomes include: 1) a literature review on STEM ecosystems; 2) an Early Childhood STEM Community Asset Map of southeast San Diego; 3) a set of proposed design principles for identifying and creating early childhood STEM ecosystems in low income communities; and 4) a theory of action that could guide future design and research. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This project had three objectives to build knowledge with respect to advancing Informal STEM Education:
Plan, prototype, fabricate, and document a game-linked design-and-play STEM exhibit for multi-generational adult-child interaction utilizing an iterative exhibit design approach based on research and best practices in the field;
Develop and disseminate resources and models for collaborative play-based exhibits to the informal STEM learning community of practice of small and mid-size museums including an interactive, tangible tabletop design-and-play game and a related tablet-based game app for skateboarding science and technology design practice;
Conduct research on linkages between adult-child interactions and game-connected play with models in informal STEM learning environments.
Linked to these objectives were three project goals:
Develop tools to enable children ages 5-8 to collaboratively refine and test their own theories about motion by exploring fundamental science concepts in linked game and physical-object design challenge which integrates science (Newton’s Laws of Motion) with engineering (iterative design and testing), technology (computational models), and mathematics (predictions and comparisons of speed, distance, and height). [Linked to Objectives 1 & 3]
Advance the informal STEM education field’s understanding of design frameworks that integrate game environments and physical exhibit elements using tangibles and playful computational modeling and build upon the “Dimensions of Success” established STEM evaluation models. [Linked to Objectives 1 & 2]
Examine methods to strengthen collaborative learning within diverse families through opportunities to engage in STEM problem-based inquiry and examine how advance training for parents influences the extent of STEM content in conversations and the quality of interactions between caregivers and children in the museum setting. [Linked to Objectives 1 & 3]
The exhibit designed and created as a result of this grant project integrates skateboarding and STEM in an engaging context for youth ages 5 to 8 to learn about Newton’s Laws of Motion and connect traditionally underserved youth from rural and minority areas through comprehensive outreach. The exhibit design process drew upon research in the learning sciences and game design, science inquiry and exhibit design, and child development scholarship on engagement and interaction in adult-child dyads.
Overall, the project "Understanding Physics through Collaborative Design and Play: Integrating Skateboarding with STEM in a Digital and Physical Game-Based Children’s Museum Exhibit" accomplished three primary goals. First, we planned, prototyped, fabricated, and evaluated a game-linked design-and-play STEM gallery presented as a skatepark with related exhibits for adult-child interaction in a Children's Museum.
Second, we engaged in a range of community outreach and engagement activities for children traditionally underserved in Museums. We developed and disseminated resources for children to learn about the physics of the skatepark exhibit without visiting the Museum physically. For example, balance board activities were made portable, the skatepark video game was produced in app and web access formats, and ramps were created from block sets brought to off-site locations.
Third, we conducted a range of research to better understand adult-child interactions in the skatepark exhibit in the Children's Museum and to explore learning of physics concepts during physical and digital play. Our research findings collectively provide a new model for Children's Museum exhibit developers and the informal STEM education community to intentionally design, evaluate, and revise exhibit set-up, materials, and outcomes using a tool called "Dimensions of Success (DOS) for Children's Museum Exhibits." Research also produced a tool for monitoring the movement of children and families in Museum exhibit space, including time on task with exhibits, group constellation, transition time, and time in gallery. Several studies about adult-child interactions during digital STEM and traditional pretend play in the Museum produced findings about social positioning, interaction style, role, and affect during play.
DATE:
-
TEAM MEMBERS:
Deb DunkhaseKristen MissallBenjamin DeVane
The overarching purpose of the Climate Literacy Zoo Education Network is to develop and evaluate a new approach to climate change education that connects zoo visitors to polar animals currently endangered by climate change, leveraging the associative and affective pathways known to dominate decision-making. Utilizing a polar theme, the partnership brings together a strong multidisciplinary team that includes the Chicago Zoological Society of Brookfield, IL, leading a geographically distributed consortium of nine partners: Columbus Zoo & Aquarium, OH; Como Zoo & Conservatory, St. Paul, MN; Indianapolis Zoo, IN; Louisville Zoological Garden, KY; Oregon Zoo, Portland, OR; Pittsburgh Zoo & PPG Aquarium, PA; Roger Williams Park Zoo, Providence, RI; Toledo Zoological Gardens, OH, and the organization Polar Bears International. The partnership leadership includes the Learning Sciences Research Institute at the University of Illinois at Chicago, and the Earth System Science Center at Pennsylvania State University. The partnership is joined by experts in conservation psychology and an external advisory board. The primary stakeholders are the diverse 13 million annual visitors to the nine partner zoos. Additional stakeholders include zoo docents, interpreters and educators, as well as the partnership technical team in the fields of learning innovations, technological tools, research review and education practice. The core goals of the planning phase are to a) develop and extend the strong multidisciplinary partnership, b) conduct research needed to understand the preconceptions, attitudes, beliefs, and learning modes of zoo visitors regarding climate change; and c) identify and prototype innovative learning environments and tools. Internal and external evaluations will be conducted by Facet Innovations of Seattle, WA. Activities to achieve these goals include assessments and stakeholder workshops to inventory potential resources at zoos; surveys of zoo visitors to examine demographic, socioeconomic, and technology access parameters of zoo visitors and their existing opinions; and initial development and testing of participatory, experiential activities and technological tools to facilitate learning about the complex system principles underlying the climate system. The long-term vision centers on the development of a network of U.S. zoos, in partnership with climate change domain scientists, learning scientists, conservation psychologists, and other stakeholders, serving as a sustainable infrastructure to investigate strategies designed to foster changes in public attitudes, understandings, and behavior surrounding climate change.
The objective of this project is to provide a complete package of KIDSPACE hands-on science experiences to small and developing science centers across the country through the National KIDSPACE Partnership Program. This project will allow twelve (12) selected science centers to implement a complete, proven education package geared toward young children at a fraction of the cost of starting one from scratch. This project will provide comprehensive training to a large core of educators within the science center field, and will support continued research into the informal science education of young children through an original Research Study and the formation of a national User's Group. Best of all, this project will generate a wellspring of invaluable science-play connections for hundreds of thousands of children to tale with them into adulthood.
Boston's Museum of Science (MOS), with Harvard as its university research partner, is extending, disseminating, and further evaluating their NSF-funded (DRL-0714706) Living Laboratory model of informal cognitive science education. In this model, early-childhood researchers have both conducted research in the MOS Discovery Center for young children and interacted with visitors during the museum's operating hours about what their research is finding about child development and cognition. Several methods of interacting with adult visitors were designed and evaluated, including the use of "research toys" as exhibits and interpretation materials. Summative evaluation of the original work indicated positive outcomes on all targeted audiences - adults with young children, museum educators, and researchers. The project is now broadening the implementation of the model by establishing three additional museum Hub Sites, each with university partners - Maryland Science Center (with Johns Hopkins), Madison Children's Museum (with University of Wisconsin, Madison), and Oregon Museum of Science and Industry (with Lewis & Clark College). The audiences continue to include researchers (including graduate and undergraduate students); museum educators; and adults with children visiting the museums. Deliverables consist of: (1) establishment of the Living Lab model at the Hub sites and continued improvement of the MOS site, (2) a virtual Hub portal for the four sites and others around the country, (3) tool-kit resources for both museums and scientists, and (4) professional symposia at all sites. Intended outcomes are: (1) improve museum educators' and museum visiting adults' understanding of cognitive/developmental psychology and research and its application to raising their children, (2) improve researchers' ability to communicate with the public and to conduct their research at the museums, and (3) increase interest in, knowledge about, and application of this model throughout the museum community and grow a network of such collaborations.
As science centers and children's museums re-define their roles in a society that is increasingly linguistically diverse, many seek to engage more effectively with dual language learners. Dual language learners are young children who are still in the process of acquiring basic language skills in their first language while at the same time acquiring a second language. At present, museum professionals face the challenge of developing programs and practices in the absence of research on informal science education for this population. The Center of Science and Industry (COSI) and The Ohio State University (OSU) will collaborate to begin a systematic study of informal science education programs and practices for reaching and serving preschool dual language learners. The improvement of dual language learners' informal science learning experiences is an increasingly important part of efforts to achieve equity and diversity in participation in science. Such efforts are particularly important as this population grows in number and as the significance of early science learning experiences for later achievement becomes better understood. This project will begin to address the lack of research through three interconnected activities: (1) a national needs assessment of children's museums and science museums, (2) an in-person convening and quarterly virtual meet-ups with teams from eight partner museums, and (3) an exploratory study of COSI's programs and practices to support the access, participation, and learning of preschool dual language learners and their parents/caregivers. The project will yield important insights into current practices and priorities with respect to effective museum engagement with dual language learners, their families, and the early childhood professionals who serve them. The project will (1) produce a comprehensive report on the current state of the field related to providing informal science experiences for preschool dual language learners; (2) identify gaps in existing research and practice, as well as promising foci for future study and improvement and expansion of museum practice; and (3) create a full-scale Research in Service to Practice proposal and a national network of museums to implement the proposal. The overarching goal of the project is to advance the knowledge and awareness of needs and practices related to informal science programming for preschool children who are learning English as an additional language. The national needs assessment will be conducted by means of an online questionnaire sent to museums identified via public association lists, and questions will focus on institutional practices in relation to school readiness and the needs of preschool dual language learners and perceived gaps in services. In the convening and virtual meet-ups, the project team, local community partners, project advisers, museum association leaders, and museum partners selected for their innovative work with linguistically diverse populations will discuss partners' programs, practices and frameworks; emergent project findings; and directions for further study. The exploratory study of COSI programs and practices will entail participant observation, document analysis, and interviews and focus group conversations with stakeholders, including parents, early childhood educators, COSI team members, community organization leaders. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. Its funding includes broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. An AISL Pathways grant, such as this one, allows practitioners and researchers to undertake exploratory development work that has the potential to produce evidence, findings, and/or deliverables that will form the basis of anticipated further innovative, or potentially transformative, research and development work.