In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
Science identity has been shown to be a necessary precondition to academic success and persistence in science trajectories. Further, science identities are formed, in large part, due to the kinds of access, real or perceived, that (racialized) learners have to science spaces. For Black and Latinx youth, in particular, mainstream ideas of science as a discipline and as a culture in the US recognize and support certain learners and marginalize others. Without developing identities as learners who can do science, or can become future scientists, these young people are not likely to pursue careers in any scientific field. There are demonstrable links between positive science identities and the material and social resources provided by particular places. Thus, whether young people can see themselves as scientists, or even feel that they have access to science practices, also depends on where they are learning it. The overarching goal of this project is to broaden participation of Black and Latinx youth in science by deepening our understanding of both science identities and how science learning spaces may be better designed to support the development of positive science identities of these learners. By deepening the field’s knowledge of how science learning spaces shape science identities, science educators can design more equitable learning spaces that leverage the spatial aspects of program location, culturally relevant curriculum, and participants’ lived experiences. A more expansive understanding of positive science identities allows educators to recognize these in Black and Latinx learners, and direct their continued science engagements accordingly, as positive identities lead to greater persistence in science. This project is a collaboration between researchers at New York University and those at a New York City informal science organization, BioBus. It is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This participatory design research project will compare three different formats, in different settings, of afterschool science programming for middle schoolers: one located in a lab space on the campus of a nearby university, one located in the public middle school building of participating students, and one aboard a mobile science lab. For purposes of this study, the construct of “setting” refers to the dimensions of geographic location, built physical environment, and material resources. Setting is not static, but instead social and relational: it is dynamically (co)constructed and experienced in activity by individuals and in interaction by groups of individuals. Therefore, the three BioBus programming types allow for productive comparison not only because of their different geographic locations, built environments, and material resources (e.g., scientific tools), but also the existing relationships learners may have with these places, as well as the instructional designs and pedagogical practices that BioBus teaching scientists use in each. This project uses a design-based research approach to answer the following research questions: (1) How do the settings of science learning shape science identity development? What are different positive science identities that may emerge from these relationships? And (2) What are ways to leverage different spatial aspects of informal science programming and instruction to support positive science identities? The study uses ethnographic and micro-analytic methods to develop better understandings of the relationships between setting and science identity development, uncover a broad range of types of positive science identities taken up by our Black and Latinx students, and inform informal science education to design for and leverage spatial aspects of programming and instruction. Findings will contribute to a systematic knowledge base bringing together spatial aspects of informal science education and science identity and identity development, and provide new tools for informal science educators, including design principles for incorporating spatial factors into program and lesson planning.
DATE:
-
TEAM MEMBERS:
Jasmine MaLatasha WrightRoya Heydari
The Lewis H. Latimer House Museum will develop a more cohesive education program that reflects both the museum's resources and the needs of local schools. The museum's deputy director and Tinkering Lab educator will work together to design a curriculum that meets current New York State and city standards, enabling the museum to more effectively serve schools in the community with object-based learning experiences. Packets of educational materials will be developed and made available for school teachers to download and use in their classrooms prior to and following visits to the museum. Target schools will be actively involved in the process of testing and utilizing the products. Project results will be shared with internal and external stakeholders to sustain long-term improvement and enhance institutional capacity.
In this paper, we report ethnicity trends in student participation and experience in high school science and engineering fair (SEFs). SEF participation showed significant ethnic diversity. For survey students, the approximate distribution was Asian-32%; Black-11%; Hispanic-20%; White-33%; Other-3%. Comparing the SEF level at which students competed from school to district to region to state levels, we observed that black students made up only 4.5% of the students who participated in SEF beyond the school level, whereas students from other ethnic groups were more equally represented at all
The call for more science, technology, engineering, and mathematics (STEM) education taking place in informal settings has the potential to shape future generations, drive new innovations and expand opportunities. Yet, its power remains to be fully realized in many communities of color. However, research has shown that using creative embodied activities to explore science phenomena is a promising approach to supporting understanding and engagement, particularly for youth who have experienced marginalization. Prior pilot work by the principal investigator found that authentic inquiries into science through embodied learning approaches can provide rich opportunities for sense-making through kinesthetic experience, embodied imagining, and the representation of physics concepts for Black and Latinx teens when learning approaches focused on dance and dance-making. This Research in Service to Practice project builds on prior work to better understand the unique opportunities for learning, engagement, and identity development for these youth when physics is explored in the context of the Embodied Physics Learning Lab Model. The model is conceptualized as a set of components that (1) allow youth to experience and utilize their intersectional identities; (2) impact engagement with physics ideas, concepts and phenomena; and (3) lead to the development of physics knowledge and other skills. The project aims to contribute to more expansive definitions of physics and physics learning in informal spaces. While the study focuses primarily on Black and Latinx youth, the methods and discoveries have the potential to impact the teaching of physics for a much broader audience including middle- and high-school children, adults who may have been turned off to physics at an earlier age, and undergraduate physical science majors who are struggling with difficult concepts. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The research is grounded in sociocultural perspectives on learning and identity, embodied interaction and enactive cognition, and responsive design. The design is also informed by the notion of “ArtScience” which highlights commonalities between the thinking and making practices used by artists and by scientists and builds on the theoretical philosophy that all things can be understood through art or through science but integrating the two lenses allows for more complete understandings. Research will investigate the relationship between embodied learning approaches, design principles, and structures of the Embodied Physics Learning Lab model using the lenses of physics, dance, and integrated ArtScience to better understand the model. The project employs design-based research to address two overarching research questions: (1) What unique opportunities for learning, engagement, and identity development for Black and Latinx youth occur when physics is explored in the context of the Embodied Physics Learning Lab Model? and (2) How do variations in site demographics and site implementation influence the impact and scalability of the Learning Lab model? Further, the inquiry will consider (a) how youth experience and utilize their intersectional various identities in the context of the activities, structures, and essential elements of the embodied physics learning lab; (b) how youth's level of physics engagement changes depending on which embodied learning approaches and essential element structures are used; (c) the physics knowledge and other skills youth attain through the set of activities; and (d) how, if at all, the embodied learning approaches engage youth in thinking about their own agency as STEM doers. An interdisciplinary team of researchers, choreographers, and youth along with community organizations will co-design and implement project activities across four sites. Approximately 200 high school youth will be engaged; 24 will have the role of Teen Thought Partner. Through three iterative design cycles of implementation, the project will refine the model to investigate which elements most affect successful implementation and to identify the conditions necessary for scale-up. Data will be collected in the form of video, field notes, pre- and post- interviews, pre- and post- surveys, and artifacts created by the youth. Analyses will include a combination of interaction analysis, descriptive data analysis, and movement analysis. In addition to the research findings and explication of the affordances and constraints of the model, the project will also create a curricular resource, including narrative text and video demonstrations of physics concepts led by the teen thought partners, video case training modules, and assessment tools.
DATE:
-
TEAM MEMBERS:
Folashade Cromwell SolomonDionne Champion
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Research shows that Black girls and women, regardless of their academic achievements and STEM interests, often encounter academic under-preparation, social isolation, exclusion, and race-gender discrimination that negatively impacts their ongoing engagement and retention in STEM. This project will provide innovative, culturally relevant learning environments to middle and high school Black girls to counter these negative trends. Using hands-on coding and robotics activities, project participants will develop positive attitudes toward science, technology, engineering, and mathematics (STEM). The project emphasizes peer-mentoring by providing opportunities for Black female high school (assistant coaches) and Black college students (coaches) to serve as counselors and mentors to participants. Additionally, engineers, scientists, and executives from STEM industries will serve as mentors and share their experiences to broaden participants’ STEM career aspirations. The project is a three-year collaborative effort between the University of California Davis C-STEM Center, the Umoja Community Education Foundation, and the 66 affiliated California community colleges, industry partners, and school districts in California. Over three years, nearly 2,000 females will participate in the project.
Learning environments for Black girls and women led by other Black girls and women are referred to as “counterspaces” where they are free to engage in STEM in ways that value their identities while promoting STEM engagement, interests, and career aspirations. The project’s curriculum will follow a research-based, culturally relevant multi-tiered mentoring approach. The curriculum is designed to develop participants’ STEM content knowledge, critical thinking, and logical reasoning capabilities through meaningful connections to real-life applications using hands-on coding and robotics. A mixed-method longitudinal study will examine the impact on participants’ STEM outcomes, emphasizing contributing new knowledge on the viability of multi-tiered, culturally relevant mentoring for increasing equity in informal STEM learning (ISL). The program's effectiveness will be evaluated using longitudinal assessments of mathematics standards, computer science and robotics conceptual knowledge, logical and critical thinking skills, STEM school achievements, interests and attitudes toward STEM subjects, advanced STEM course-taking, involvement in other ISL opportunities, and leadership in STEM in one’s school/university and community. The project will test a locally based informal learning model with projects hosted by other K-12 and college partners.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Black Girls Create (BGC) is a program that uses maker pedagogy, social history (i.e., Black women’s contributions in STEM), culturally responsive pedagogy, and mentoring to engage Black girls in STEM. For the project, culturally responsive making is operationally defined as the use of cultural knowledge and maker technologies to create, design, and produce artifacts that are related to a particular concept, theme, or person. The project will conduct a feasibility research study that investigates how engagement in BGC affects participants' STEM interest, STEM confidence, and racial and gender identities. In the project, participants will discover how Black women have made an impact in STEM fields and will learn how to digitally create cultural artifacts/wearable art related to their discoveries. Approximately 120 middle school girls in grades 6-8 (8 groups of 15 participants each) from underserved neighborhoods will be recruited for participation in this two-year study. Each group will meet for 3 hours per week over an 8-week period. Instructional materials from this research will be made freely available online so that they can be adapted and used at other formal and informal educational institutions that seek to garner interest and access to STEM learning for Black girls and women.
A pre- and post-test, quasi-experimental design will be used to research the program’s influence on participants’ self-efficacy, racial identity, and gender identity. Lagged regression models that control for students’ age, race/ethnicity, and pre-survey scores will be used to examine growth in each of the four outcomes. Once all of the participants in the groups have completed BGC, data from all groups will be combined to increase power and thereby detect statistically meaningful differences in pre- and post-survey scores. In addition, variables representing attendance and program engagement will be entered into the model to examine whether students who are highly engaged in BGC programming exhibit more growth in the four outcomes. Qualitative data will be derived from students' journal entries as well as focus group interviews. Weekly journals will be used to gather data about the context and experiences of participants as they unfold throughout the program. Semi-structured focus groups will center around the usefulness of skills and knowledge gained from the program activities, significant experiences with peers and program staff, the opportunity to learn about Black women STEM progenitors, and learning how to make digitally fabricated artifacts. NVIVO, a computer software program, will be used as a tool to support the analysis of the rich, text-based information resulting from the journals and focus group narratives.
This feasibilty research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
In this article I critically examine the historical context of science education in a natural history museum and its relevance to using museum resources to teach science today. I begin with a discussion of the historical display of race and its relevance to my practice of using the Museum’s resources to teach science. I continue with a critical review of the history of the education department in a natural history museum to demonstrate the historical constitution of current practices of the education department. Using sociocultural constructs around identity formation and transformation, I
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
resourceresearchPark, Outdoor, and Garden Programs
Science in the Learning Gardens (henceforth, SciLG) program was designed to address two well-documented, inter-related educational problems: under-representation in science of students from racial and ethnic minority groups and inadequacies of curriculum and pedagogy to address their cultural and motivational needs. Funded by the National Science Foundation, SciLG is a partnership between Portland Public Schools and Portland State University. The sixth- through eighth-grade SciLG curriculum aligns with Next Generation Science Standards and uses school gardens as the milieu for learning. This
DATE:
TEAM MEMBERS:
Dilafruz WilliamsHeather Anne BruleSybil Schantz KelleyEllen A. Skinner
resourceresearchProfessional Development, Conferences, and Networks
In our efforts to sustain U.S. productivity and economic strength, underrepresented minorities (URM) (for the purpose of this paper defined as persons of African American, Hispanic American, and Native American racial/ethnic descent), provide an untapped reservoir of talent that could be used to fill technical jobs. Over the past 25 years, educational diversity programs have encouraged and supported URM pursuing STEM degrees. Yet, their representation in STEM still lags far behind that of White, non-Hispanic men.
To understand the reasons why this is occurring, the American Association for
DATE:
TEAM MEMBERS:
Yolanda S. GeorgeVirginia Van HorneShirley M. Malcom
Concord Evaluation Group (CEG) conducted an outreach partner evaluation for Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another