In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
Described by Wohlwend, Peppler, Keune and Thompson (2017) as “a range of activities that blend design and technology, including textile crafts, robotics, electronics, digital fabrication, mechanical repair or creation, tinkering with everyday appliances, digital storytelling, arts and crafts—in short, fabricating with new technologies to create almost anything” (p. 445), making can open new possibilities for applied, interdisciplinary learning in science, technology, engineering and mathematics (Martin, 2015), in ways that decenter and democratize access to ideas, and promote the construction
DATE:
TEAM MEMBERS:
Jill CastekMichelle Schira HagermanRebecca Woodland
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
In this case study, we highlight the work of the Bay Area STEM Ecosystem, which aims to increase equity and access to STEM learning opportunities in underserved communities. First, we lay out the problems they are trying to solve and give a high level overview of the Bay Area STEM Ecosystem’s approach to addressing them. Then, based on field observations and interviews, we highlight both the successes and some missed opportunities from the first collaborative program of this Ecosystem. Both the successes of The Bay Area STEM Ecosystem--as well as the partners’ willingness to share and examine
Chemistry is an important and widely relevant field of science. However, when compared with other STEM content areas, chemistry is under-represented in U.S. science museums and other informal educational environments. This project will build, and build knowledge about, innovative approaches to delivering informal science learning activities in chemistry. The project will not only increase public interest and understanding of chemistry but also increase public perception of chemistry's relevance and increase the public's self-efficacy with respect to chemistry. This project outcomes will include a guide for practitioners along with activity materials that will be packaged into a kit, distributed, and replicated for use by informal science educators, chemists, and chemistry students at 250 sites across the U.S. The project team will reach out to organizations that serve diverse audiences and diverse geographic locations, including organizations in rural and inner-city areas. The kits will provide guidance on engaging girls, people with various abilities, Spanish speakers, and other diverse audiences, and include materials in Spanish. Written guides, training videos, and training slides will be included to support training in science communication in general, as well as chemistry in particular. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
This project will take an innovative approach to develop informal educational activities and materials about chemistry. Rather than starting with content goals, the project will start with a theoretical framework drawn from research about affecting attitudes about science related to interest, relevance, and self-efficacy. A design-based research approach (DBR) will be used to apply that framework to the development of hands-on educational activities about chemistry, while also testing and modifying the framework itself. (DBR blends empirical educational research with the theory-driven design of learning environments.) Existing or new educational activities that appear to embody key characteristics defined in the framework will be tested with public audiences for their impact on visitors. Researchers and educators will determine how different characteristics of the educational activities defined in the framework affect the outcomes. The activities will be modified and tested iteratively until the investigators achieve close alignment between framework and impacts.. The project team will continue the design-based research approach both to examine groups of activities in which synergies can have impacts beyond single interactions as well as to examine varied ways of training facilitators who can also significantly affect outcomes. In this way, the project will generate knowledge about how kits of hands-on informal learning activities can stimulate attitudes of interest, relevance, and self-efficacy with respect to the neglected field of chemistry. The project teams will broadly disseminate project outcomes within the educational research, science and informal Science, Technology, Engineering and Mathematics (STEM) education communities. While this project will focus on chemistry, the strategies it will develop and test through a design-based research process will provide valuable insight into effective approaches for informal STEM education more broadly.
The Exploratorium, in collaboration with the Boys and Girls Club Columbia Park (BGC) in the Mission District of San Francisco, is implementing a two-year exploratory project designed to support informal education in science, technology, engineering, and mathematics (STEM) within underserved Latino communities. Building off of and expanding on non-STEM-related efforts in a few major U.S. cities and Europe, the Exploratorium, BGC, and residents of the District will engage in a STEM exhibit and program co-development process that will physically convert metered parking spaces in front of the Club into transformative public places called "parklets." The BGC parklet will feature interactive, bilingual science and technology exhibits, programs and events targeting audiences including youth ages 8 - 17 and intergenerational families and groups primarily in the Mission District and users of the BGC. Parklet exhibits and programs will focus on STEM content related to "Observing the Urban Environment," with a focus on community sustainability. The project explores one approach to working with and engaging the public in their everyday environment with relevant STEM learning experiences. The development and evaluation processes are being positioned as a model for possible expansion throughout the city and to other cities.
This paper sketches the context for participation in science by girls from historically underrepresented populations and offers a detailed description of Sisters4Science (S4S) and its personalized, girl-centered pedagogy. The S4S example suggests a need to complement current out-of-school science programs with lessons from girl-centered practice and research.
The article assesses professional development in the field of science through curricular and instructive methods in the museum. The National Science Education Standards, along with independent researchers, confirm and stress the importance of quality professional development for elementary science educators which can be provided by museum services and models. The study involved participants from two different elementary schools within the same urban district serving a Latino student body, which were recognized as bottom tiers in the academic performance index of California's Department of
The Discovery Center is a "hands-on" science museum with a mission to provide the public with a basic science literacy. The proposed HOFPP project is an outreach program that will take an informal science education activity to disadvantaged parents and children in the facilities of four (first year) collaborating "parents": The Urban League, the Spanish Action League, the North American Indian Club and Girls Inc. of Central NY. The purpose of the program is to encourage and enable parents of disadvantaged school children to play an active role in their child child's education. Phase I of the program is implemented as a series of ten weekly classes in which parents and children will work together on hands-on science activities; Phase 2 follows with a science club program. Graduates will be informally channeled into an inner-city magnet school for science and math. Past Discovery Center outreach programs have already demonstrated ability to attract disadvantaged parents. The proposed program will touch 1,000 disadvantaged persons during the initial three-year period. During the third year the HOFPP project will be transported and implemented at a Science museum in another New York State community. A three year cost-shared NSF project is proposed that will be later sustained by The Discovery Center operating budget with local donations. A professional outside evaluation will be performed to measure program success. Program reports, materials and consultation will be propagated to other interested organizations to gain maximum impact.
DATE:
-
TEAM MEMBERS:
Rachel NettletonMary StebbinsAnnette SalsberyElizabeth Kneale
Building Demand for Math Literacy is a comprehensive project designed to increase arithmetic and algebraic mathematical competency among underserved youth, as well as high school and college students trained as Math Literacy Workers. This project builds on the success of the nationally renowned Algebra Project that is designed to foster mathematics achievement among inner city youth. Math Literacy Workers will deliver after school activities to African-American and Hispanic youth in grades 3-6. In addition to offering weekly math literacy workshops, Math Literacy Workers will also develop and implement Community Events for Mathematics Literacy and activities for families in the following cities: Boston, MA; Chicago, IL; Jackson, MS; Miami, FL; Yuma, AZ; New Orleans, LA; San Francisco, CA and Newark, DE. The strategic impact will be demonstrated in the knowledge gained about the impact of diverse learning environments on mathematics literacy, effective strategies for family support of math learning, and the impact of culturally relevant software. Collaborators include the Algebra Project, the TIZ Media Foundation, and the Illinois Institute of Technology, as well as a host of community-based and educational partners. The project deliverables consist of a corps of trained Math Literacy Workers, workshops for youth, training materials and multimedia learning modules. It is anticipated this project will impact over 4,000 youth in grades 3-6, 700 high school and college students, and almost 4,000 family and community participants.
The Children's Museum of Houston seeks to develop a 1,500 sq ft bilingual traveling exhibition based on their bilingual "Magnificent Math Moments" activities. This project simultaneously addresses two very important needs: the relative lack of mathematics exhibits for young children and for Spanish-speaking audiences. The exhibition is based on Patron (Pattern) Point where the visitor meets math superheroes, Subtracta, Capt. Mas in the settings of Subtracta's Puzzle Parlor; Capt. Mas's Marina; and Formas (Shapes) Family Shipping Yard. It will provide an inviting setting for introducing the target audiences to mathematics through the use of characters, environments and puzzles. BROADER IMPACT: Fabrication of a second version of the traveling exhibition will extend the number of institutions reached through two national tours. These exhibitions, which target children ages 5-10 and adults, are projected to reach some 1.4 million visitors in 24 museums over five years; sites will be selected to reach Hispanic audiences in smaller, low-income urban and rural areas. For further impact CMH is forming another network of museums that will benefit from this project, even though the institutions will not be able to host the traveling exhibition. CMH also is developing ancillary materials and services to accompany the exhibition that include activity kits and cart, character costumes, training guides, parent materials and other resources.