In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
This study collected data from seven planetarium email lists (one per planetarium regional organization in the United States), as well as online survey panel data from residents in each area, to describe and compare those who do and do not visit planetariums.
This project engages pre-college Latinx, Black, and Indigenous learners, educators, and collaborating undergraduates in an international, project-based learning and media-making community in areas of science, technology, engineering, and mathematics (STEM). The project addresses key challenges including broadening participation in informal STEM learning, developing capacity for leading informal STEM programs, and building stronger connections between STEM learning and personal and social identity formation during adolescence. The project’s community of participants is an asset-based learning environment that treats each participant, their background, skills, and interests as uniquely beneficial to the whole. Led by mentors at each hub (teachers, leaders from science organizations, or other out-of-school learning environments), participants collaborate with peers from the US and from other countries. The collaborations encompass a broad spectrum of STEM projects. Participants also create digital media to communicate their projects. The project activities reflect a focus on STEM content, collaboration, and communication, in a global context that includes school-age learners from the US and peers from Central and South America, the Middle East, Asia, and Sub-Sahara. The combination of the sophisticated STEM competencies skills for collaborating across international and cultural boundaries, and media-savvy communication abilities are essential to the nation’s future STEM workforce and to building a scientifically vibrant citizenry.
The project addresses two primary research questions co-developed with teachers and other informal science providers. The first research question involves understanding and optimizing conditions for broadening participation through this type of distributed or virtual collaboration across boundaries of culture, race, gender, ability, nationality, and socioeconomic status. The project features a design experiment by which the overall community of participants comprises four separate hubs, each hosted by the different project partners (primarily teachers). Educators devise, test, and revise alternative designs for organizing STEM collaborations. Publication of these teacher-led designs and their evaluation are among the primary outputs of the project. The designs modify and improve a template developed under this project’s proof-of-concept precursor (NSF1612824). The second research question addresses how growth in STEM abilities, collaboration, and communication mutually reinforce adolescent personal and social identity formation. Participating students in the US will intentionally reflect heterogeneous backgrounds. The project analysis will focus on whether cultural and national cross-boundary collaboration can strengthen the development of learners' personal identity and academic performance. The project methodology relies heavily on quantitative ethnography and epistemic network analysis. This approach enables the creation of visual models that highlight the presence or absence of connections between constructs relevant to each research question, along with changes between and within groups. The constructs include variations of autonomy, competence, and connection (pillars of self-determination theory) in tracing identity formation and STEM abilities. The quantitative ethnography approach provides statistically reliable scaffolding and insights about the hub designs and their efficacy in promoting goals of broadening participation and fostering mutually reinforcing STEM competencies and identity formation. This type of virtual collaboration, crossing boundaries of culture, nationality, ethnicity, age, gender, economic strata, or ability, can realistically be expected to play a significant role in next-generation learning environments, especially through out-of-school activities. The project is expected to reach 120 U.S. and 80 non-U.S. students annually. Research findings, design principles and curricula will be widely disseminated to researchers, designers, program developers, informal science institutions and community organizations.
DATE:
-
TEAM MEMBERS:
Eric HamiltonNastassia JonesDanielle EspinoSeung Lee
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.
The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
This Innovations in Development project supports racially and ethnically diverse youth in learning about climate resilience in informal settings, including community centers, afterschool programs, and museums. The project aims to: (1) build the capacity of community organizations to implement youth programming on climate resilience; (2) increase youth knowledge, skills, and self-efficacy associated with climate resilience (also referred to as environmental health literacy for climate resilience); and (3) explore how collaborating research universities and community organizations engage diverse youth in informal STEM learning. Project partners include the UNC Institute for the Environment, the University of Washington-Interdisciplinary Center for Exposures, Diseases, Genomics and Environment, the North Carolina Museum of Natural Sciences, Juntos NC, and the Duwamish River Community Coalition (DRCC). Juntos NC and DRCC actively engage Latino and Indigenous youth in their programming and seek to implement resilience-focused programming that supports youth science learning and leadership development.
Together, informal educators and participating youth will develop locally relevant solutions to climate impacts in their communities. Youth will interact with university-based climate scientists and educators to collect and analyze data and will participate in resilience-focused dialogue, planning, and actions in their communities. Youth will share what they learn with their families and peers through family events and teen summits. The project will engage dozens of educators in community organizations and at least 250 youth, who will share what they learn with their families and communities, reaching hundreds more people through communications and local action projects. Mixed-methods assessment will provide insight into the extent participating youth (a) develop environmental health literacy for climate resilience, and (b) take action to address resilience in their home communities. The team will assess how these outcomes vary by location, and the implications of any variation on potential for project replication. A participatory evaluation, led by an external evaluator, will provide insight into empowerment outcomes. Findings will be disseminated to professional audiences at local and national conferences; and curricular materials from this project will be disseminated through the project website.
Making as a term has gained attention in the educational field. It signals many different meanings to many different groups, yet is not clearly defined. This project’s researchers refer to making as a term that bears social and cultural impact but with a broader more sociocultural association than definitions that center making in STEM learning. Using the theoretical lenses of critical relationality and embodiment, our research team position curriculum as a set of locally situated activities that are culturally, linguistically, socially, and politically influenced. We argue that curriculum
DATE:
TEAM MEMBERS:
Veronica OguilveWen WenEm BowenYousra AbourehabAmanda BermudezElizabeth GaxiolaJill Castek
resourceresearchProfessional Development, Conferences, and Networks
The ChemAttitudes project recieved supplemental funding to create materials for train-the-trainer workshops in order to inoculate the chemistry outreach community with members who have the knowledge and resources to train others on strategies for stimulating interest, sense of relevance, and feelings of self-efficacy that were tested in the earlier work of the project. The project team recruited participants from minority serving professional organizations as a strategy for broadening participation. Can it work? Did it work?
This poster was presented at the 2021 NSF AISL Awardee Meeting.
To advance justice, equity, diversity, and inclusion in science, we must first understand and improve the dominant-culture frameworks that impede progress and, second, we must intentionally create more equitable models. The present authors call ourselves the ICBOs and Allies Workgroup (ICBOs stands for independent community-based organizations), and we represent communities historically excluded from the sciences. Together with institutional allies and advisors, we began our research because we wanted our voices to be heard, and we hoped to bring a different perspective to doing science with
DATE:
TEAM MEMBERS:
María Cecilia Alvarez RicaldeJuan Flores ValadezCatherine CrumJohn AnnoniRick BonneyMateo Luna CastelliMarilú López FrettsBrigid LuceyKaren PurcellJ. Marcelo BontaPatricia CampbellMakeda CheatomBerenice RodriguezYao Augustine FoliJosé GonzálezJosé Miguel Hernández HurtadoSister Sharon HoraceKaren KitchenPepe Marcos-IgaTanya SchuhPhyllis Edwards TurnerBobby WilsonFanny Villarreal
With support from rural communities and their libraries in the Four Corners Region in the Southwestern U.S., We are Water creates a place to meet and share stories about water, and explore and learn about water together. Designed for rural, Indigenous, and Latinx communities, stories, community voices and multiple ways of knowing are highlighted and woven throughout the exhibit and programs.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
ChemAttitudes: Using Design-Based Research to Develop and Disseminate Strategies and Materials to Support Chemistry Interest, Relevance, and Self-Efficacy (ChemAttitudes, NSF DRL-1612482) is a collaborative project between the Museum of Science, Boston (MOS), the National Informal STEM Education Network (NISE Net), and the American Chemical Society (ACS) among others. As a part of this project, researchers and educators from MOS and the Science Museum of Minnesota (SMM) used design-based research to create chemistry hands-on activities meant to positively impact visitors’ attitudes towards
Communities with the highest risk of climate change impacts may also be least able to respond and adapt to climate change, which highlights a specific need for inclusive Science, Technology, Engineering, and Mathematics (STEM) strategies. This Pilot and Feasibility project builds on the success of US Cooperative Extension Service programs that empower volunteers to conduct outreach in their own communities. It focuses on climate change, and seeks to co-design an informal STEM climate science curriculum, called Climate Stewards, in collaboration with community members from groups often underrepresented in STEM, including indigenous and Latinx communities, as well as rural women. The project is designed to strengthen community awareness as well as prioritize community voices in climate change conversations. The knowledge and skills obtained by Climate Stewards and their communities will allow for more involvement in decisions related to climate adaptation and mitigation in their communities and beyond. After establishing a proof of concept, the project seeks to expand this work to more rural and urban communities, other communities of color, and additional socioeconomically disadvantaged communities.
Grounded in the theory of diffusion of innovation as a means for volunteers to communicate information to members of a social system, this project seeks co-create a retooled Climate Stewards curriculum using inclusive and adaptive strategies. Community collaboration and involvement through new and existing partnerships, focus groups, and meetings will determine what each community needs. During the program design phase, community members can share their concerns regarding climate change as well as the unique characteristics and cultural perspectives that should be addressed. The collaboration between extension and education leverage resources that are important for developing a robust implementation and evaluation process. This project is expected to have a significant influence on local and national programs that are looking to incorporate climate change topics into their programming and/or broaden their reach to underrepresented communities. The hypotheses tested in this project describe how inclusion-based approaches may influence competencies in STEM topics and their impact on communities, specifically willingness to take action. Hypothesis 1: STEM competencies in climate issues increase with interactive and peer learning approaches. Hypothesis 2: Community participation in the co-creation of knowledge about climate change, by integrating their values and objectives into the climate change education program, increases people's motivation to become engaged in climate change adaptation and mitigation strategies.
This Pilot and Feasibility project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Patricia TownsendRoslynn McCannMelissa KreyeArthur Nash