In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
In this article I critically examine the historical context of science education in a natural history museum and its relevance to using museum resources to teach science today. I begin with a discussion of the historical display of race and its relevance to my practice of using the Museum’s resources to teach science. I continue with a critical review of the history of the education department in a natural history museum to demonstrate the historical constitution of current practices of the education department. Using sociocultural constructs around identity formation and transformation, I
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
In this case study, we highlight the work of the Bay Area STEM Ecosystem, which aims to increase equity and access to STEM learning opportunities in underserved communities. First, we lay out the problems they are trying to solve and give a high level overview of the Bay Area STEM Ecosystem’s approach to addressing them. Then, based on field observations and interviews, we highlight both the successes and some missed opportunities from the first collaborative program of this Ecosystem. Both the successes of The Bay Area STEM Ecosystem--as well as the partners’ willingness to share and examine
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater program and hands-on group activities. Multimedia Research, an independent evaluation firm, implemented a summative evaluation with low income, inner-city
In the United States, African Americans are underrepresented in science careers and underserved in pre-collegiate science education. This project engaged African American elementary students in culturally relevant science education through archaeology and thereby increased positive dispositions toward science. While imagining what the lives of their ancestors were like, students practiced scientific inquiry and used natural sciences to analyze archaeological sites. The project helped to improve science literacy among African American elementary students through archaeological inquiry and
Serial Passage: AIDS, Race, and Culture. is a 3-4 hour documentary film series and curriculum enhancement that examines the process of scientific inquiry in the development of the serial passage/contaminated needle theory of the origin of HIV/AIDS as well as the disproportionate impact of the pandemic upon Africans and African-Americans. The long term objective of the documentary film series/curriculum enhancement is to foster a heightened awareness of the need for HIV prevention among African-Americans, particularly teenagers, who are at high risk for contracting HIV, and who have often proved unresponsive to traditional HIV prevention messages. African-Americans constitute 12.1 % of the US population but account for almost 50% of the new HIV/AIDS cases. The documentary film series is being made with a small cohort of 20 inner-city African-American high school students in Pittsburgh, Pennsylvania. The students work on the documentary series as footage evaluators, apprentice filmmakers, and will ultimately be its narrative voice. They are also research subjects. An interim evaluation report showed a dramatic increase in the students' perceived knowledge of HIV/AIDS, and a substantial decrease in their reported sexual activity. A widespread and scientifically significant Phase II evaluation of this project would be conducted via pre and post anonymous surveys administered to African-American teenagers, (high school students), and matching control groups. The ABC and PBS networks have already agreed to screen the documentary series for broadcast consideration. The Phase II application proposes to 1) complete editing and postproduction of the documentary series, and 2) work with curriculum writers and an educational video distribution company on the development and dissemination of the documentary series/curriculum enhancement.
Serial Passage: AIDS, Race, and Culture is a multi-part documentary series. The Long-term goals are: 1) to produce a documentary series exploring the specific and devastating impact of H.I.V./AIDS upon Africans and African-Americans; and 2) to create a heightened understanding of the need for H.I.V. prevention among the high-risk group of young, inner-city African-Americans who've so far proved unresponsive to available public health information. Specific Aims: 1) To deconstruct the racial stigma of AIDS, and scientifically confront the conspiracy theories which are firmly linked to the disease in black America, and in Africa; and 2) to work with an inner-city high school science class, actively involving them in the making of the series. Research Design and Methods: 1) To document on film the process of scientific inquiry which led two prominent researchers to their theory on the origin of AIDS; 2) To document on film the social impact of H.I.V/AIDS upon specific African countries, including Uganda and South Africa, and upon African-American communities in the United States; 3) To periodically screen footage of the documentary for the high school class and conduct videotaped discussions between the students and the scientists throughout one academic year; and 4) To give the students a videotaped questionnaire at the beginning and end of the year designed to measure how much they learn about AIDS and its impact upon their particular community.