In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This book chapter describes zoo and aquariums' history of conservation education programming for students and teachers. It showcases several examples of student-teacher-scientist partnerships, including Project TRUE, highlighting the program's success at cultivating sustained interest in science careers among high school youth.
Zoos and aquariums have a long history of providing conservation education to students and teachers. As the conservation work of zoos and aquariums has grown, so have the opportunities to connect students and teachers to the work of these scientists. This chapter
Overlaying Computer Science (CS) courses on top of inequitable schooling systems will not move us toward “CS for All.” This paper prioritizes the perspectives of minoritized students enrolled in high school CS classrooms across a large, urban school district in the Western United States, to help inform how CS can truly be for all.
DATE:
TEAM MEMBERS:
Jean RyooTiera TanksleyCynthia EstradaJane Margolis
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The goal of the National Science Foundation?s Research Coordination Network (RCN) program is to advance a field or create new directions in research or education by supporting groups of investigators to communicate and coordinate their research, training and educational activities across disciplinary, organizational, geographic and international boundaries. This RCN will bring together scholars and practitioners working at the intersection of equity and interdisciplinary making in STEM education. Making is a culture that emphasizes interest-driven learning by doing within an informal, peer-led and creative social environment. Hundreds of maker spaces and maker-oriented classroom pedagogies have developed across the country. Maker spaces often include digital technologies such as computer design, 3-D printers, and laser cutters, but may also include traditional crafts or a variety of artist-driven creations. The driving purpose of the project is to collectively broaden STEM-focused maker participation in the United States through pursuing common research questions, sharing resources, and incubating emergent inquiry and knowledge across multiple working sites of practice. The network aims to build capacity for research and knowledge, building in consequential and far-reaching mechanisms to leverage combined efforts of a core group of scholars, practitioners, and an extended network of formal and informal education partners in urban and rural sites serving people from groups underrepresented in STEM. Maker learning spaces can be particularly fruitful spaces for STEM learning toward equity because they foster interest-driven, collective, and community-oriented learning in making for social and community change. The network will be led by a team of multi-institutional and multi-disciplinary researchers from different geographic regions of the United States and guided by a steering committee of prominent researchers and practitioners in making and equity will convene to facilitate network activities.
Equitable processes are rooted in a commitment to understand and build on the skills, practices, values, and knowledge of communities marginalized in STEM. The research network aims to fill in gaps in current understandings about making and equity, including the many ways different projects define equity and STEM in making. The project will survey the existing research terrain to develop a dynamic and cohesive understanding of making that connects to learners' STEM ideas, communities, and historical ways of making. Additionally, the network will collaboratively develop central research questions for network partners. The network will create a repository for ethical and promising practices in community-based research and aggregate data across sites, among other activities. The network will support collaboration across a multiplicity of making spaces, research institutions, and community organizations throughout the country to share data, methodologies, ways of connecting to local communities and approaches to robust integration of STEM skills and practices. Project impacts will include new research partnerships, a dissemination hub for research related to making and equity, professional development for researchers and practitioners, and leveraging collective research findings about making values and practices to improve approaches to STEM-rich making integration in informal learning environments. The project is funded by NSF's Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of settings. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This paper contributes a theoretical framework informed by historical, philosophical and ethnographic studies of science practice to argue that data should be considered to be actively produced, rather than passively collected. We further argue that traditional school science laboratory investigations misconstrue the nature of data and overly constrain student agency in their production. We use our “Data Production” framework to analyze activity of and interviews with high school students who created data using sensors and software in a ninth-grade integrated science class. To understand the
Many urban New Yorkers believe that the Hudson River is so polluted that nothing could possibly live there. In reality, the estuary is thriving, and The River Project (TRP), a marine science field station in lower Manhattan, exists to showcase its vast biodiversity through place-based education. In 2014, TRP began collaborating on a city-wide initiative with New York Harbor Foundation and eight other partner organizations to integrate restoration science into Title I middle school curricula through the Curriculum and Community Enterprise for Restoration Science (CCERS). Teachers in the
DATE:
TEAM MEMBERS:
Elisa CarefMelissa RexAnnie LederbergGaylen Moore
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
Many urban universities offer precollege STEM programs aimed at broadening participation in STEM. These programs are designed to increase students' scientific content knowledge and skills, promote STEM engagement, increase self-efficacy, and prepare underserved and underrepresented minority high school students for success in undergraduate programs. However, even after demonstrating significant knowledge gains and success in these programs, students are often unable to authenticate their knowledge gains to receive favorable consideration on college applications. In fact, there is currently no systematic credentialing mechanism to assess and validate the scientific rigor of and competency gains within STEM precollege programs for college admissions purposes. This NSF INCLUDES Design and Development Launch Pilot seeks to address this gap by developing and testing credentialing and badging processes for four STEM precollege programs. Working with College Admissions Officers and project partners, the University of Pittsburgh endeavors to employ a collaborative impact approach to build and document the collaborative infrastructure needed to support STEM precollege program authentication processes. This will seed the development of a networked improvement community that supports all aspects of the work from participant support to the collaborative impact to the greater network of urban education university ecosystems involved in the pilot.
Over a two-year period, this pilot will examine a mechanism to strengthen the STEM pathway for disadvantaged and underrepresented minority students to enter postsecondary STEM programs and eventually STEM careers. Building on two social innovation theories, the technical approach will focus on four specific aims: (1) create a community engagement framework to recruit underserved and underrepresented high school students to STEM precollege programs, (2) develop a STEM Success Matrix that identifies student competencies acquired in precollege programs that prepare students for collegiate success in STEM, (3) credential precollege programs using the STEM Success Matrix, and (4) develop a student badging system for precollege program participants using the STEM Success Matrix. Four University of Pittsburgh STEM precollege programs will serve as the context for development and testing with support from a range of partners representing the broader Pittsburgh STEM ecosystem. Approximately 300 high school students are expected to participate in the pilot, across the four precollege programs. Data will be collected via participant surveys and interviews. Formative and summative evaluations will be conducted by an experienced, external evaluator. Shareable metrics, tools, and processes will be developed and disseminated using various platforms and mechanisms. If successful, this pilot could be transformative - changing admissions considerations by credentialing STEM precollege programs and increasing student interest and motivation in STEM through student badging. It would also transform the STEM ecosystem of underserved and underrepresented minority students by creating an important STEM pathway from precollege to undergraduate admissions and ultimately, STEM Careers. This pilot could serve as a baseline for a more expansive alliance with other urban education ecosystems or assisting others interested in establishing their own collaborative infrastructure and networked improvement community model to achieve similar results.
DATE:
-
TEAM MEMBERS:
Alison Slinskey LeggJennifer IritiDavid BooneAlaine AllenLori Delale-O'Connor
resourceprojectProfessional Development, Conferences, and Networks
Aligning for Impact: Computer Science Pathways Across Contexts [CS-PAC] is an NSF INCLUDES Design and Development Launch Pilot. It broadens participation of students who are underrepresented in computer science by using the convening and policy-making power of the Georgia State Department of Education to coalesce school district leaders to implement K-12 computer science education. The project provides a national model for how to work toward systemic change. With the State Department of Education's coordination, several school districts will collaboratively seek improvements in their own student participation rates. The coordination of data reporting and analysis, resources, communications, and policy promote more equitable participation in computer science education. Research emerging from this project informs other states about how to collaboratively shape computer science education policy and policy implementation.
Using a Collective Impact approach to systemic change, the project creates sustainable institutional change at the community, state, and national levels. Qualitative and quantitative data provide descriptions about how to utilize alignment strategies within Collective Impact in three different contexts: rural, suburban, and urban. Outcomes utilize a regression discontinuity analysis to justify successful implementation as well as qualitative analysis of implementation efforts that were deemed most effective by all stakeholders. The project outputs directly affect over 88,000 students across five districts and indirectly affect over 1.7 million in Georgia alone. The culminating project goal is the development of a coherent framework for aligning K-12 computer science education pathways.
DATE:
-
TEAM MEMBERS:
Caitlin DooleyBryan CoxShawn Utley
resourceprojectProfessional Development and Workshops
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie