This summary brief captures highlights from the evaluation report for the first year of the NSF-funded WaterMarks project (also available on this page). The purpose of this document is to communicate key updates from evaluation in a less technical way with the many different audiences who have an interest in keeping up with WaterMarks.
This is the evaluation report for the first year of the NSF-funded WaterMarks project. It reflects an initial summary of available evidence about the intended outcomes of program activities to date, as well as commentary on how the project is using (or could use) this information moving forward. This report contains descriptions of embedded measures (i.e. anonymized drawings and reflections captured on a thematic postcard) included in community walks and analyses of secondary data (i.e., interviews conducted by other members of hte project team), as well as reflections emerging from the
The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeked to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Collaborative robots – cobots – are designed to work with humans, not replace them. What learning affordances are created in educational games when learners program robots to assist them in a game instead of being the game? What game designs work best?
Public outdoor spaces present opportunities for social experiences and learning. This Broader Implementation project will expand and evaluate a model that transforms urban public spaces into accessible and engaging environments for learning social science in outdoor public spaces. The model combines social science inquiry exhibits, place making and human facilitation of learning experiences in outdoor public areas. Project exhibits use the facilitated social interactions as both the content of and medium for the experiences. This project will adapt the existing exhibits and add new exhibits and facilitation techniques for testing in three different urban environments. Project research will explore the efficacy of these adaptations and revised facilitation techniques for the different settings in collaboration with civic partners at each site. The project will share the model and research findings widely through the Exploratorium website and publications for researchers, developers, and educators.
The team’s prior research showed that facilitators improved multiple learning outcomes with the current exhibits. Visitors acquired new social observation skills, reflected on their own experiences, perceptions, and actions, and increased their awareness for how social behavior, cognition, and emotion can be studied scientifically. Building on the prior research, the project will install the exhibition and test its efficacy in three different urban environments and explore the adaptations that are required for different settings with different civic partners. The project will use design-based research to develop a new theoretical model of facilitation strategies for supporting science learning in outdoor public spaces. For evaluation, the project will use mixed methods, including observations, interviews, surveys, and document review. Evaluation will assess success in attracting and engaging visitors; conveying social science concepts; prompting self-reflection of judgments and actions; and fostering empathy among those with different social identities. The project will assess the extent to which participants, particularly those from marginalized communities, experience feelings of belonging and inclusion. The project will be presented in three sites which represent the significant diversity, income levels, and urban environments of San Francisco. Facilitation strategies are being co-developed with Urban Alchemy, an organization that works within distressed urban communities in San Francisco. Project site partners and collaborators include the San Francisco Public Library, the Port of San Francisco, and the San Francisco Department of Parks and Recreation. The project will also measure partnership outcomes, through surveys and interviews, to look at the extent and ways the project integrates a co-creation model and develops an authentic, mutually beneficial, sustainable partnership. The project will generate and disseminate generalizable knowledge about the affordances of combining informal science learning, placemaking, and facilitation in a variety of free, outdoor STEM learning spaces in collaboration with local community groups. The project will also advance public understanding of the social and behavioral sciences.
This research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and sssessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Middle Ground, funded by the National Science Foundation, was an outdoor public installation developed by the Exploratorium and located in the Civic Center. This installation focused on the social science of how people think about others, particularly the cognitive basis for biases, judgements, and stereotypes, as well as more pro-social behavior and ways of connecting with others. Garibay Group is currently conducting a summative evaluation. As data are still being collected and analyzed, this report presents select preliminary results about installation-specific outcomes.
PLUM LANDING a digital media PBS Kids series that is designed to motivate six- to nine-year-old children to investigate the natural world. Content developers from WGBH Boston and researchers from the Education Development Center (EDC) used an iterative research and design process to create the Plum Landing Explore Outdoors Toolkit. The Toolkit includes digital media resources (animated stories, live-action videos, an online badging system, a digital game, and an app for families), hands-on science activities, and support materials for parents, caregivers, educators, and program directors to
PLUM LANDING a digital media PBS Kids series that is designed to motivate six- to nine-year-old children to investigate the natural world. Content developers from WGBH Boston and researchers from the Education Development Center (EDC) used an iterative research and design process to create the Plum Landing Explore Outdoors Toolkit. The Toolkit includes digital media resources (animated stories, live-action videos, an online badging system, a digital game, and an app for families), hands-on science activities, and support materials for parents, caregivers, educators, and program directors to
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Nature-based playgrounds—known as playscapes—offer numerous opportunities for young children to learn about nature. In the current study, we focus on teacher talk on playscapes, namely to capture the spontaneous utterances teachers offer when engaging with young children during playscape visits. Two different playscapes were contrasted, both of which featured loose parts, native plants, and running water. The difference in playscape was whether it featured ecosystems: While the rural playscape had a natural forest and a wetland, the urban playscape had a man-made stream and a garden. Ten
DATE:
TEAM MEMBERS:
Heidi KloosCatherine MaltbieRhonda BrownVictoria Carr
The goal of the National Science Foundation?s Research Coordination Network (RCN) program is to advance a field or create new directions in research or education by supporting groups of investigators to communicate and coordinate their research, training and educational activities across disciplinary, organizational, geographic and international boundaries. This RCN will bring together scholars and practitioners working at the intersection of equity and interdisciplinary making in STEM education. Making is a culture that emphasizes interest-driven learning by doing within an informal, peer-led and creative social environment. Hundreds of maker spaces and maker-oriented classroom pedagogies have developed across the country. Maker spaces often include digital technologies such as computer design, 3-D printers, and laser cutters, but may also include traditional crafts or a variety of artist-driven creations. The driving purpose of the project is to collectively broaden STEM-focused maker participation in the United States through pursuing common research questions, sharing resources, and incubating emergent inquiry and knowledge across multiple working sites of practice. The network aims to build capacity for research and knowledge, building in consequential and far-reaching mechanisms to leverage combined efforts of a core group of scholars, practitioners, and an extended network of formal and informal education partners in urban and rural sites serving people from groups underrepresented in STEM. Maker learning spaces can be particularly fruitful spaces for STEM learning toward equity because they foster interest-driven, collective, and community-oriented learning in making for social and community change. The network will be led by a team of multi-institutional and multi-disciplinary researchers from different geographic regions of the United States and guided by a steering committee of prominent researchers and practitioners in making and equity will convene to facilitate network activities.
Equitable processes are rooted in a commitment to understand and build on the skills, practices, values, and knowledge of communities marginalized in STEM. The research network aims to fill in gaps in current understandings about making and equity, including the many ways different projects define equity and STEM in making. The project will survey the existing research terrain to develop a dynamic and cohesive understanding of making that connects to learners' STEM ideas, communities, and historical ways of making. Additionally, the network will collaboratively develop central research questions for network partners. The network will create a repository for ethical and promising practices in community-based research and aggregate data across sites, among other activities. The network will support collaboration across a multiplicity of making spaces, research institutions, and community organizations throughout the country to share data, methodologies, ways of connecting to local communities and approaches to robust integration of STEM skills and practices. Project impacts will include new research partnerships, a dissemination hub for research related to making and equity, professional development for researchers and practitioners, and leveraging collective research findings about making values and practices to improve approaches to STEM-rich making integration in informal learning environments. The project is funded by NSF's Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of settings. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.