In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
In this article I critically examine the historical context of science education in a natural history museum and its relevance to using museum resources to teach science today. I begin with a discussion of the historical display of race and its relevance to my practice of using the Museum’s resources to teach science. I continue with a critical review of the history of the education department in a natural history museum to demonstrate the historical constitution of current practices of the education department. Using sociocultural constructs around identity formation and transformation, I
In this study, we explored how science teacher candidates construct ideas about science teaching and learning in the context of partnerships with urban community-based organizations. We used a case study design focusing on a group of 10 preservice teachers' participation in educational programming that focused on environmental racism and connected science to larger social issues in an economically dispossessed Mexican community in Chicago. Using theoretical lenses of humanistic science education, justice-centered science pedagogy, and structure-agency dialectic, we studied how preservice high
DATE:
TEAM MEMBERS:
Maria VarelasDaniel Morales-DoyleSyeda RazaDavid SeguraKaren CanalesCarole Mitchener
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
In this case study, we highlight the work of the Bay Area STEM Ecosystem, which aims to increase equity and access to STEM learning opportunities in underserved communities. First, we lay out the problems they are trying to solve and give a high level overview of the Bay Area STEM Ecosystem’s approach to addressing them. Then, based on field observations and interviews, we highlight both the successes and some missed opportunities from the first collaborative program of this Ecosystem. Both the successes of The Bay Area STEM Ecosystem--as well as the partners’ willingness to share and examine
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater program and hands-on group activities. Multimedia Research, an independent evaluation firm, implemented a summative evaluation with low income, inner-city
Capitalizing on the appeal of the PBS KIDS project PLUM LANDING, PLUM RX will research and develop resources to help families and educators infuse environmental science learning into outdoor prescription programs, while ensuring they are appropriate for broad use in other informal settings. The growing outdoor prescription movement is designed to increase the amount of time children spend outside in nature. Programs are structured so that health care providers write "prescriptions" for children to engage in outdoor activity, and informal educators "fill" these prescriptions by facilitating youth and family participation in outdoor activities. There is preliminary evidence that these programs are getting kids outside, but best practices for transitioning "get outside" programs to become "get outside and learn about the environment" programs remain unidentified. PLUM RX is designed to build this knowledge and create resources that are responsive to the needs of both English and Spanish-speaking urban families. The project will work with informal educators and families through multiple cycles of implementation and revision, testing and refining PLUM LANDING resources (animations, videos, games, hands-on science activities, and support materials for informal educators and families), with the goal of designing an effective and accessible PLUM RX Toolkit for national dissemination. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (Science, Technology, Engineering, Mathematics) learning in informal environments. The proposed research is designed to ensure that the PLUM RX Toolkit--the resources and support materials--will meet the needs of educators working in non-specialized urban settings. Education Development Center (EDC) and WGBH developers will collaborate on design-based research at three urban outdoor prescription programs serving low-income families: Philadelphia Nature Rx in Philadelphia, PA; Outdoors Rx in Boston, MA; and Portland Rx Play in Portland, OR. Moving through cycles of implementation, observation, analysis, and revision, the research team will work closely with educators, families, and developers to determine how the programmatic and structural features of the learning environment, the actions of the educators, and the intervention itself can most effectively support children and families' outdoor exploration in urban contexts. Toolkit materials will include resources for kids and families (including Spanish-speaking families) and informal educators (including those who work with families and directly with children in out-of-school settings). Directors from the three urban outdoor prescription programs will contribute to every phase of the research process, including recruiting families and youth who will participate in a weekly sequence of activities. The overarching focus of the analysis process will be on systematically describing the interaction between two dimensions of implementation: What happened during pilot implementations, and the factors that constrained or supported implementation as planned; and the quality of what happened, which will be defined with reference to the intended impacts. EDC will use a structured descriptive coding process to analyze the qualitative evidence gathered through interviews and observations during design and testing periods. Products of the research activities will include: a series of formative memos to the development team; a report mapping changes made to PLUM RX Toolkit materials in response to formative input and the intended impact of those changes; and findings regarding commonalities and differences across sites in the interaction of local contextual factors and the implementation success of the PLUM RX Toolkit. Concord Evaluation Group (CEG) will provide independent, summative evaluation of the project. Through this process, PLUM RX will build broader knowledge about how to design educational resources, geared for both families and informal educators, which respond to the unique challenges of exploring environmental science in urban environments.