The Aldrich Contemporary Art Museum will amplify its partnership with Hart Magnet School, a Title 1 elementary school in urban Stamford, Connecticut, by increasing exposure and access to the arts for first-fifth graders, their families, and educators. A new program model, leveraging the museum's artist exhibitions, will focus on technology and an inquiry-based approach to science. Students, educators, and families will be encouraged to see and think in new ways through on-site STEAM tours at the museum, artist-led workshops at Hart, teacher professional development, and afterschool family activities. Outside evaluators will work with the project team to develop goals and associated metrics to measure how the model of museum-school partnership can enhance student achievement, engage families more deeply in their child's school experience and community, and contribute to teacher professional development. The evaluator will also train museum staff on best practices for program assessment.
Sciencenter will develop a touring exhibition, Engineer.Design.Build, to spark interest and build confidence in STEM by providing learning opportunities about the broad impact engineers have on the environment and society. The museum will partner with Cornell University's College of Engineering to develop scientific content which will be reviewed by an advisory board of representatives from the academic, business, and informal science education sectors. Partners from informal learning institutions will provide expertise on the educational content to ensure that it is accessible and engaging for the target audience of 5-11 year olds. Through a combination of focus groups, youth/guest feedback during exhibition development, and experts in girls' engagement in STEM on the advisory board, the museum will ensure that the exhibition and programming are designed to appeal to girls, and accessible to all learners. The project will include front-end, formative, and summative evaluation through observations and mediated interviews, collecting data from youth, families, and school groups.
The Pacific Science Center will develop new evaluation tools to assess the impact of Tinker Tank, a visitor-directed, hands-on design space in which participants are challenged to use their creativity, problem solving, and experience to understand the processes of design, engineering, and science. The project will allow the museum to determine which tools, adapted from both informal learning settings (such as timing and tracking studies, observations, surveys, and focus groups) and formal settings (such as design journals, digital portfolios, and badging),are most suitable for providing meaningful data about the learning and engagement occurring in its makerspace. By adjusting and refining the evaluation tools and methods, the museum will be able to measure learning in its makerspace, determine the extent to which it is achieving the goals and objectives of its Tinker Tank, and guide planning for expansion of making activities into different areas of its exhibition floor.
The Bay Area Discovery Museum will address the need for STEM education by delivering engineering outreach programming to schools and libraries throughout the San Francisco Bay Area. The museum's mobile engineering lab, Try It Truck, will introduce the engineering design process to students and teachers in grades K-5 with hands-on activities (both on and off the truck) where they can collaborate, experiment, and design solutions to engineering challenges. The Try It Truck will serve 21,600 children, parents, and educators throughout the Bay Area, with at least 50 percent of all participants coming from underserved communities and Title I schools. The museum will work with an external evaluator to design survey instruments for both formative and summative evaluation, analyze summative evaluation data, and produce a report. Museum staff will share project results with colleagues at national and statewide conferences.
The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
NASA@ My Library is made possible through the support of the National Aeronautics and Space Administration (NASA) Science Mission Directorate as part of its Science Activation program. The project is led by the National Center for Interactive Learning (NCIL) at the Space Science Institute (SSI) in partnership with the American Library Association (ALA) Public Programs Office, Lunar and Planetary Institute (LPI), and Education Development Center (EDC). From 2016-2020, 78 public libraries (75 partner libraries and 3 pilot libraries), 18 State Library Agencies, 6 Portal to the Public Network sites, and 30 NASA-funded scientists participated in the project. More than 225,000 library patrons were reached through their efforts.
In 2021-2022, public libraries, universities, and state library agencies will participate in the project to increase and enhance STEAM learning opportunities in their communities, with an emphasis on reaching audiences underrepresented in STEM education and professions.
This Smart and Connected Community (SCC) project will partner with two rural communities to develop STEMports, an innovative Science, Technology, Engineering and Mathematics (STEM) learning game for workforce development. The game's activities will take players on localized Augmented Reality (AR) missions to both engage in STEM learning challenges and discover emerging STEM careers in their community, specifically highlighting innovations in the fields of sustainable agriculture and aquaculture, forest products, and renewable energy. Community Advisory Teams (CATs) and co-design teams, including youth, representatives from the targeted emerging STEM economies, and decision-makers will partner with project staff to co-design STEMports that reflect the interests, cultural contexts, and envisioned STEM industries of the future for each community.
The project will: (a) design and pilot an AR game for community STEM workforce development; (b) develop and adapt a community engagement process that optimizes community networking for co-designing the gaming application and online community; and (c) advance a scalable process for wider applications of STEMports. This project is a collaboration between the Maine Mathematics and Science Alliance and the Field Day Lab at the University of Wisconsin-Madison to both build and research the co-designing of a SCC based within an AR environment. The project will contribute knowledge to the informal STEM learning, community development, and education technology fields in four major ways:
Deepening the understanding of how innovative technological tools support rural community STEM knowledge building as well as STEM identity and workforce interest.
Identifying design principles for co-designing the STEMports community related to the technological design process.
Developing social network approaches and analytics to better understand the social dimensions and community connections fostered by the STEMport community.
Understanding how participants' online and offline interactions with individuals and experiences builds networks and knowledge within a SCC.
With the scaling of use by an ever-growing community of players, STEMports will provide a new AR-based genre of public participation in STEM and collective decision making. The research findings will add to the emerging literature on community-wide education, innovative education technologies, informal STEM learning (especially place-based learning and STEM ecosystems), and participatory design research.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The University of Washington, the Exploratorium, the Education Development Center, Inverness Research, and the University of Colorado - Boulder have come together to form a Research+Practice (R+P) Collaboratory. The Collaboratory seeks to address and reframe the gap between research and practice in K-12 STEM education. This gap persists despite decades of work by many leading organizations, associations, and individuals. Attempts to close the gap have generally focused on creating resources and mechanisms that first explain or illustrate "what research says" and then invite educators to access and integrate findings into practice. Recently, however, attention has turned to the ways in which the medical sciences are addressing the gap between research and clinical practice through the developing field of "translational research." In medicine, the strategy has been to shift the focus from adoption to adaptation of research into practice. Implicit in the notion of adaptation is a bi-directional process of cultural exchange in which both researchers and practitioners come to understand how the knowledge products of each field can strengthen the professional activities in the other. Along these lines, the R+P Collaboratory is working with leading professional associations and STEM improvement efforts to leverage their existing knowledge and experience and to build sustainable strategies for closing the gap. Activities include:
Collecting, creating and synthesizing translational research resources to expand STEM educators' and educational leaders' access and awareness to current relevant research.
Supporting multiple opportunities for cross-sector (research and practice; education and social sciences; formal and informal) meetings to foster critical engagement and cultural exchange.
Testing, documenting and innovating new resources and mechanisms at Adaptation Sites and disseminating both products and results through the R+P Resource Center.
The R+P Collaboratory is developing an online 'Go-To' Resource Center website that houses the resources collected, created, and curated by the Collaboratory. The Resource Center also has significant 'Take-Out' features, with all materials meta-tagged so that they can be automatically uploaded, reformatted, and integrated into the existing communication and professional development mechanisms (e.g., newsletters, digests, conferences, and websites) of a dozen leading professional associations within a Professional Association Partner Network.
In light of new and emerging standards in the STEM disciplines, the Collaboratory is focusing its work on four salient and timely bodies of research: (a) STEM Practices, (b) Formative Assessment, (c) Cyberlearning, and (d) Learning as a Cross-Setting Phenomenon. Special emphasis is being placed on research and practice that focuses on the learning of children and youth from communities historically underrepresented in STEM fields.
The work of the R+P Collaboratory includes research and evaluation of its own efforts through studies aimed at answering the following questions:
How are Collaboratory resources and engagement activities accessed, experienced and leveraged by participants?
What resources, mechanisms and learning contexts support cultural exchange among STEM education researchers and practitioners?
What new kinds of practices result when research-based evidence is adapted into evidence-based practices, and how does it change learning opportunities for K-12 aged children?
How can effective strategies, mechanisms and resources of the Collaboratory be scaled and adapted to new contexts?
Research that seeks to understand classroom interactions often relies on video recordings of classrooms so that researchers can document and analyze what teachers and students are doing in the learning environment. When studies are large scale, this analysis is challenging in part because it is time-consuming to review and code large quantities of video. For example, hundreds of hours of videotaped interaction between students working in an after-school program for advancing computational thinking and engineering learning for Latino/a students. This project is exploring the use of computer-assisted methods for video analysis to support manual coding by researchers. The project is adapting procedures used for computer-aided diagnosis systems for medical systems. The computer-assisted process creates summaries that can then be used by researchers to identify critical events and to describe patterns of activities in the classroom such as students talking to each other or writing during a small group project. Creating the summaries requires analyzing video for facial recognition, motion, color and object identification. The project will investigate what parts of student participation and teaching can be analyzed using computer-assisted video analysis. This project is supported by NSF's EHR Core Research (ECR) program, the STEM+C program and the AISL program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. The project is funded by the STEM+Computing program, which seeks to address emerging challenges in computational STEM areas through the applied integration of computational thinking and computing activities within disciplinary STEM teaching and learning in early childhood education through high school (preK-12). As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The video analysis systems will provide video summarizations for specific activities which will allow researchers to use these results to quantify student participation and document teaching practices that support student learning. This will support the analysis of large volumes of video data that are often time-consuming to analyze. The video analysis system will identify objects in the scene and then use measures of distances between objects and other tracking methods to code different activities (e.g., typing, talking, interaction between the student and a facilitator). The two groups of research questions are as follows. (1) How can human review of digital videos benefit from computer-assisted video analysis methods? Which aspects of video summarization (e.g., detected activities) can help reduce the time it takes to review the videos? Beyond audio analytics, what types of future research in video summarization can help reduce the time that it takes to review videos? (2) How can we quantify student participation using computer-assisted video analysis methods? What aspects of student participation can be accurately measures by computer-assisted video analysis methods? The video to be used for this study is drawn from a project focused on engineering and computational thinking learning for Latino/a students in an after-school setting. Hundreds of hours of video are available to be reviewed and analyzed to design and refine the system. The resulting coding will also help document patterns of engagement in the learning environment.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Marios PattichisSylvia Celedon-PattichisCarlos LopezLeiva
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase student motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by designing, implementing, and testing an afterschool internship program that will engage older youth in work-based learning experiences in in STEM fields. The new model program will link the resources and learning approaches of the Global Learning and Observations to Benefit the Environment (GLOBE) program to career academies where youth from populations underrepresented in STEM fields will gain direct experiences in data collection and analysis through student-led investigations in the geosciences and environmental studies. Two key outcomes of this project will be: (a) Development of a replicable model of an afterschool STEM internship program for informal STEM learning environments and schools across the nation, and (b) Development of a set of measurement tools and approaches that can assess and promote understanding regarding how youth think and feel about science and their possible future roles in science careers. Participating youth will master scientific practices and become immersed in science culture through opportunities to develop research projects, interact with scientists, and collaborate with fellow student-researchers. In the process, they will develop collaboration and communication skills, and gain an increased sense of identity and agency in science fields. They will also learn new strategies to attain their career goals.
In developing and testing the new model of an afterschool program focusing on STEM careers, the project will draw on both existing and emerging knowledge from three areas of inquiry: informal STEM learning, youth development, and work-based learning. The project will bring together theory related to work-based learning and apprenticeship to knowledge about informal STEM learning and youth development, addressing the needs of older youth as they transition to adulthood. The program will also explore the use of measurement tools that address workforce-related student learning goals in addition to social-emotional learning and STEM learning goals, adapting existing tools and developing new tools as needed. The result will be a replicable model for an afterschool, career-focused internship that facilitates STEM learning and identity, employing youth development principles, such as experiential learning, peer collaboration, adult mentoring, and meaningful contributions to the world beyond school. The project will use a mixed-methods approach to investigate four research questions: (1) What aspects of the program are most important for promoting the development of scientific practices, socio-emotional learning, and career skills? (2) How can afterschool informal science learning be designed to address the perceptions and needs of diverse groups, especially those from populations underrepresented in STEM? (3) How do youth make gains in developing facility with STEM practices, key social-emotional outcomes needed in work and civic life, and career development knowledge? And (4) How do we accurately measure development of scientific practices, socio-emotional learning and career skills? The project will develop pretest and posttest self-report measures to gauge program influence on social-emotional outcomes and career-related outcomes, and performance-based assessments and rubrics will be used to assess culminating science projects. Other factors contributing to the success of the new model will be examined through analysis of coach instructional logs, surveys, and questions, as well as participant observations, interviews, and focus groups. Project participants will be youth of ages 14-18 recruited from ten inner-city schools having large populations of students from groups underrepresented in STEM fields. Participants will meet in teams of approximately 14 interns for a total of 2.5 hours per week for 32 weeks. Each team will also meet an additional 4-6 times for weekend or overnight outings associated with their study sites.
DATE:
-
TEAM MEMBERS:
Manuel AlonsoCathy RingstaffSvetlana Darche