In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
Many urban universities offer precollege STEM programs aimed at broadening participation in STEM. These programs are designed to increase students' scientific content knowledge and skills, promote STEM engagement, increase self-efficacy, and prepare underserved and underrepresented minority high school students for success in undergraduate programs. However, even after demonstrating significant knowledge gains and success in these programs, students are often unable to authenticate their knowledge gains to receive favorable consideration on college applications. In fact, there is currently no systematic credentialing mechanism to assess and validate the scientific rigor of and competency gains within STEM precollege programs for college admissions purposes. This NSF INCLUDES Design and Development Launch Pilot seeks to address this gap by developing and testing credentialing and badging processes for four STEM precollege programs. Working with College Admissions Officers and project partners, the University of Pittsburgh endeavors to employ a collaborative impact approach to build and document the collaborative infrastructure needed to support STEM precollege program authentication processes. This will seed the development of a networked improvement community that supports all aspects of the work from participant support to the collaborative impact to the greater network of urban education university ecosystems involved in the pilot.
Over a two-year period, this pilot will examine a mechanism to strengthen the STEM pathway for disadvantaged and underrepresented minority students to enter postsecondary STEM programs and eventually STEM careers. Building on two social innovation theories, the technical approach will focus on four specific aims: (1) create a community engagement framework to recruit underserved and underrepresented high school students to STEM precollege programs, (2) develop a STEM Success Matrix that identifies student competencies acquired in precollege programs that prepare students for collegiate success in STEM, (3) credential precollege programs using the STEM Success Matrix, and (4) develop a student badging system for precollege program participants using the STEM Success Matrix. Four University of Pittsburgh STEM precollege programs will serve as the context for development and testing with support from a range of partners representing the broader Pittsburgh STEM ecosystem. Approximately 300 high school students are expected to participate in the pilot, across the four precollege programs. Data will be collected via participant surveys and interviews. Formative and summative evaluations will be conducted by an experienced, external evaluator. Shareable metrics, tools, and processes will be developed and disseminated using various platforms and mechanisms. If successful, this pilot could be transformative - changing admissions considerations by credentialing STEM precollege programs and increasing student interest and motivation in STEM through student badging. It would also transform the STEM ecosystem of underserved and underrepresented minority students by creating an important STEM pathway from precollege to undergraduate admissions and ultimately, STEM Careers. This pilot could serve as a baseline for a more expansive alliance with other urban education ecosystems or assisting others interested in establishing their own collaborative infrastructure and networked improvement community model to achieve similar results.
DATE:
-
TEAM MEMBERS:
Alison Slinskey LeggJennifer IritiDavid BooneAlaine AllenLori Delale-O'Connor
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This Change Makers project will establish Food Justice Ambassador corps across three cities in Massachusetts where youth will install, manage and learn the science and technology underlying hydroponics. The project takes a near-peer mentoring approach that empowers high school youth to take the lead in improving ethnic minority and low-income residents' access to healthy produce and to help educate middle school youth regarding the value of fresh produce in one's diet by learning the science of hydroponics. Youth will create story maps to visualize food accessibility in their communities. High school youth will work with their communities to establish hydroponic farms in middle school after-school settings. The food that is grown will be provided to the community through farmers' markets. Youth will share their work with a larger community of urban farmers at the Massachusetts Urban Farming Conference. This project seeks to understand the contribution on youth development by the model's three components: (1) STEM learning embedded in a social justice framework, (2) near-peer mentoring, and (3) youth purpose and career development. This will enable researchers to better understand how the project enables youth to learn STEM skills; apply them to a real life problem; learn the relevance of STEM skills for addressing personal, career aspiration, and social justice issues; develop a sense of purpose and aspirations related to STEM fields; and mentor other youth through the same process. The project will use a mixed-method, multi-site longitudinal study utilizing quantitative surveys, structural equation modeling, and qualitative interviews to study the intersections of the components of the project. As such, the study will address three key questions: 1) How do youth and mentors perceive and experience their roles as participants in the pedagogy? 2) What is the impact of the intervention on youth' sense of purpose, identity, career adaptability, work volition, critical consciousness, school engagement, STEM interests, and STEM intentionality? 3) What is the contribution of relational/mentoring and psychosocial/career adaptability aspects of the youths' contexts on their capacity to benefit from this program and to develop and sustain purpose and engagement in school and STEM? Most urban youth (and adults) have little knowledge of where their food comes from and have limited opportunities to learn how to grow produce as well as develop related skills that can lead to a career in a STEM field. This is particularly disconcerting as 55% of African Americans live inside central cities (90% in metropolitan areas) and over half of all Latino/as live in central cities (United States Census Bureau, 2011). This project entails the recruitment of low-income youth from populations underrepresented in science into a program where social justice concerns (food justice, food security) are illuminated, analyzed, and acted upon through the development of STEM knowledge and skills. Specifically, this project recognizes the potential for urban youth to become deeply knowledgeable citizens who can mobilize their STEM knowledge and skills to resolve social injustices such as food deserts. If successful, this project will provide a model that should be transferable to similar contexts to help broaden participation in STEM.
DATE:
-
TEAM MEMBERS:
George BarnettBelle LiangDavid Blustein
In this case study, we highlight the work of the Bay Area STEM Ecosystem, which aims to increase equity and access to STEM learning opportunities in underserved communities. First, we lay out the problems they are trying to solve and give a high level overview of the Bay Area STEM Ecosystem’s approach to addressing them. Then, based on field observations and interviews, we highlight both the successes and some missed opportunities from the first collaborative program of this Ecosystem. Both the successes of The Bay Area STEM Ecosystem--as well as the partners’ willingness to share and examine
This is the final report from the external evaluator of the project that created MedLab, an interactive learning experiences for Chicago area middle and high school students. This external evaluator's final report summarizes the outcomes and impacts of the five-year (2012-2017) funding compared to project objectives. The aim of the project was to use in person and online curricula, including a humanoid patient simulator (iStan®), to build interest in and knowledge of health sciences and health careers, with a particular focus on local community health concerns. An additional goal was to
DATE:
TEAM MEMBERS:
Christina Shane-SimpsonJohn FraserSusan HannahKin KongPatricia WardRabiah Mayas
This longitudinal research study will contribute to a broader understanding of the pathways of STEM-interested high school students from underrepresented groups who plan to pursue or complete science studies in their post-high school endeavors. The project will investigate the ways that formative authentic science experiences may support youth's persistence in STEM. The study focuses on approximately 900 urban youth who are high interest, high potential STEM students who participate in, or are alumni of, the Science Research Mentoring Program. This program provides intensive mentoring for high school youth from groups underrepresented in STEM careers. It takes place at 17 sites around New York City, including American Museum of Natural History, which is the original program site. Identifying key supports and obstacles in the pathways of high-interest, under-represented youth towards STEM careers can help practitioners design more inclusive and equitable STEM learning experiences and supports. In this way, the project will capitalize on student interest so that students with potential continue to persist.
In order to understand better the factors that influence these students, this research combines longitudinal social network and survey data with interviews and case studies, as well as an analysis of matched student data from New York City Public Schools' records. The research questions in the study are a) how do youths' social networks develop through their participation in scientists' communities of practice? b) what is the relationship between features of the communities of practice and youths' social networks, measures of academic achievement, and youths' pursuit of a STEM major? and c) what are the variations in youth pathways in relationship to learner characteristics, composition of social networks, and features of the community of practice? The research design allows for a rich, layered perspective of student pathways. In particular, by employing social network analysis, this study will reveal relational features of persistence that may be particularly critical for underrepresented youth, for whom STEM role models and cultural brokers provide an otherwise unavailable sense of belonging and identity in STEM. The study will also access a New York City Public Schools data set comprised of student-level records containing biographical and demographic variables, secondary and postsecondary course enrollment and grades, exam scores, persistence/graduation indicators, linked responses to post-secondary surveys, and post-education employment records and wages. These data enable examination of inter-relationships between in-school achievement and out-of-school STEM experiences through comparison of program participants to similar non-participant peers. This project is supported by NSF's EHR Core Research (ECR) program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field.
The importance of increasing and widening participation in post-compulsory science and informal science learning (ISL) spaces is widely recognized—particularly for working-class and minority ethnic communities. While there is a growing understanding of the intersection of femininity with class, ethnicity, and science learning across formal and informal settings, there has been little work on how masculinity may shape urban boys’ science (non)participation and (dis)engagement. This article analyzes performances of masculinity enacted by 36 urban, working-class boys (from diverse ethnic
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater program and hands-on group activities. Multimedia Research, an independent evaluation firm, implemented a summative evaluation with low income, inner-city
Learn how to create opportunities for young people from low-income, ethnically diverse communities to learn about growing food, doing science, and how science can help them contribute to their community in positive ways. The authors developed a program that integrates hydroponics (a method of growing plants indoors without soil) into both in-school and out-of-school educational settings.
Because of the siloed nature of formal educational curricula, students who opt out of STEM coursework, for whatever reason, lose the opportunity to engage with the domain of science almost entirely, thereby closing the door to the STEM workforce pipeline. This disproportionately impacts students of color and women. This project advances an alliance that consists of a consortium of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and local businesses. The project built around this alliance will leverage interdisciplinary spaces in the curriculum, particularly the humanities and social sciences, across academic levels, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life. The PIs establish a physical Community STEM Center as an anchoring institution for STEM engagement. This Center will be situated within the community that the alliance serves, bringing STEM opportunities and engagement to students instead of asking them to come where STEM education is currently provided. The activities enacted through the Community STEM Center will focus on enduring problems experienced by the communities, where students, community residents, teachers, and experts from higher education, industry and other community-based entities can come together to work on understanding them and developing evidenced centered advocacy as a means for addressing them. To facilitate the work at the Community STEM Center, the project creates a Community Ambassadors Program (CAP), leveraging participation across alliance members in partnership with the community. This Design and Development Launch Pilot will cultivate the necessary knowledgebase to develop a scalable model for implementation across diverse urban communities.
Technical Summary
This Design and Development Launch Pilot focuses on shifting the narrative of STEM education away from a solitary focus on formalized educational experiences and targets STEM content. This project develops and facilitates a parallel set of activities designed to engage under-represented students in learning how and why STEM is relevant to their lives, and approached through new and non-traditional educational dimensions. The five main objectives of this proposed pilot are to: (1) Develop a pilot alliance of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and industry;(2)Establish a physical Community STEM Advocacy Center as an anchoring institution for change embedded within the community that the pilot alliance serves; (3) Leverage interdisciplinary spaces in curricula, across academic levels, particularly the humanities and social sciences, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life; (4) Create a Community Ambassadors Program (CAP), leveraging participation across higher education pilot alliance members in partnership with the community; and (5)Conduct an evaluation of project initiatives and research regarding the usability and feasibility of a systemic approach to developing community-based, interdisciplinary pathways to broaden STEM participation pathways. Efforts to examine the impact of this community-based, interdisciplinary approach concentrates on the proximal outcomes related to STEM interest, self-efficacy and identity. Data will be collected in pre/post format across our three constituent samples: 1) Community STEM Advocacy Center participants; 2) k-12 students; and, 3) postsecondary students. Analysis of data will be conducted through MANCOVAs to account for potential co-variation among construct scores. Qualitative data will also be collected to contextualize findings and enable the development of a rich case study. At least two observations will be conducted in the Community STEM Advocacy Center and the two classroom implementations to document engagement, participant interactions and level of STEM content.
DATE:
-
TEAM MEMBERS:
Kimberly LawlessDonald WinkLudwig Carlos NitscheAixa AlfonsoJeremiah Abiade
While the term 'failure' brings to mind negative associations, there is a current focus on failure as a driver of innovation and development in many professional fields. It is also emerging from prior research that for STEM professionals and educators, failure plays an important role in designing and making to increase learning, persistence and other noncognitive skills such as self-efficacy and independence. By investigating how youth and educators attend to moments of failure, how they interpret what this means, and how they respond, we will be better able to understand the dynamics of each part of the experience. The research team will be working with youth from urban, suburban and rural settings, students from Title I schools or who qualify for free/reduced-price lunches, those from racial and ethnic minority groups, as well as students who are learning English as a second language. These youth are from groups traditionally underrepresented in STEM and in making, and research indicates they are more likely to experience negative outcomes when they experience failure.
The intellectual merit of this project centers on establishing a baseline understanding of how failure in making is triggered and experienced by youth, what role educators play in the process, and what can be done to increase persistence and learning, rather than failure being an end-state. The research team will investigate these issues through the use of qualitative and quantitative research methods. In particular, the team will design and evaluate the effectiveness of interventions on increasing the abilities of youth and educators in noticing and responding to failures and increasing positive (e.g., resilience) outcomes. Research sites are selected because they will allow collection of data on youth from a wide range of backgrounds. The research team will also work to test and revise their hypothesized model of the influence of factors on persistence through failures in making. This project is a part of NSF's Maker Dear Colleague Letter (DCL) portfolio (NSF 15-086), a collaborative investment of Directorates for Computer & Information Science & Engineering (CISE), Education and Human Resources (EHR) and Engineering (ENG).