Overview
In 2021, we worked with the Smithsonian Institution’s American Women’s History Initiative (AWHI) to design and implement a baseline study that would measure the long-term impacts of the Because of Her Story (BOHS) internship program on participants. The program is a cross-Smithsonian initiative that matches interns with museum projects meant to amplify women's stories to tell a more complete American history, reach a diverse audience, and empower and inspire people from all walks of life.
Together, we articulated clear and measurable mid- and long-term outcomes for internship
Growth in the US Latinx population has outpaced the Latinx growth in science, technology, engineering, and math (STEM) degrees and occupation, further widening the ethnic gap in STEM. Mathematics has often identified as a bottleneck keeping many youth, especially minoritized youth, from pursuing STEM studies. Unequal opportunities to develop powerful math assets explain differences in math skills and understanding often experienced by minoritized youth. Implementing culturally responsive practices (CRP) in afterschool programs has the potential to promote math skills and motivation for youth from minoritized groups. However, extensive research is needed to understand which culturally responsive informal pedagogical practices (CIPPs) are most impactful and why. This project aims to identify and document such practices, shed light on the challenges faced by afterschool staff in implementing them, and develop training resources for afterschool staff to address these challenges. This project is funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The fundamental research questions addressed by the project focus on (1) which CIPPs matter most in the context of a STEM university-community partnership engaging Latinx youth, and (2) in what context(s) and under what conditions do these CIPPs relate to positive outcomes for both youth participants and college mentor/facilitator. A third aim is to build capacity of afterschool staff for implementing CIPPs in informal STEM afterschool programs. The first two aims are addressed through a mixed-methods research study which includes quantitative surveys and qualitative in-depth interviews with five cohorts of adolescent participants, parents, and undergraduate mentors. Each year, surveys will be collected from adolescents and mentors at four time points during the year; the in-depth interviews will be collected from adolescents, parents, and mentors in the spring. In total, 840 adolescents and 210 mentors will be surveyed; and 87 adolescents, 87 parents, and 87 mentors will be interviewed. The third aim will be addressed by leveraging the research findings and the collective knowledge developed by practitioners and researchers to create a public archive containing documentation of CIPPs for informal STEM afterschool programs and training modules for afterschool staff. The team will disseminate these resources extensively with informal afterschool practitioners in California and beyond. Ultimately, this project will lead to improved outcomes for minoritized youth in informal STEM afterschool programs across the nation, and increased representation of minoritized youth in STEM pursuits.
DATE:
-
TEAM MEMBERS:
Alessandra PantanoSandra SimpkinsCynthia Sanchez Tapia
resourceprojectProfessional Development, Conferences, and Networks
Developing solutions to large-scale collective problems -- such as resilience to environmental challenges -- requires scientifically literate communities. However, the predominant conception of scientific literacy has focused on individuals, and there is not consensus as to what community level scientific literacy is or how to measure it. Thus, a 2016 National Academies of Sciences, Engineering, and Medicine report, “Science Literacy: Concepts, Contexts, and Consequences,” stated that community level scientific literacy is undertheorized and understudied. More specifically, the committee recommended that research is needed to understand both the i) contexts (e.g., a community’s physical and social setting) and ii) features of community organization (e.g., relationships within the community) that support community level science literacy and influence successful group action. This CAREER award responds to this nationally identified need by iteratively refining a model to conceptualize and measure community level scientific literacy. The model and metrics developed in this project may be applied to a wide range of topics (e.g., vaccination, pandemic response, genetically-modified foods, pollution control, and land-use decisions) to improve a community’s capacity to make scientifically-sound collective decisions. This CAREER award is funded by the Advancing Informal STEM Learning (AISL) and the EHR CORE Research (ECR) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the ECR program goal to advance relevant research knowledge pertaining to STEM learning and learning environments.
The proposed research will conceptualize, operationalize, and measure community level scientific literacy. This project will use a comparative multiple case study research design. Three coastal communities, faced with the need to make scientifically-informed land-use decisions, will be studied sequentially. A convergent mixed methods design will be employed, in which qualitative and quantitative data collection and analyses are performed concurrently. To describe the i) context of each community case, this project will use qualitative research methods, including document analysis, observation, focus groups, and interviews. To measure the ii) features of community organization for each community case, social network analysis will be used. The results from this research will be disseminated throughout and at the culmination of the project through professional publications and conference presentations as well as with community stakeholders and the general public. The integrated education activities include a professional learning certificate for informal science education professionals and STEM graduate students. This certificate emphasizes high-quality community-engaged scholarship, placing students with partners such as museums, farmer’s markets, and libraries, to offer informal learning programs in their communities. This professional learning program will be tested as a model to provide training for STEM graduate students who would like to communicate their research to the public through outreach and extension activities.
Millions of Latinx youth, aged 14 to 18, work formal or informal jobs to provide income for themselves or their families. In the context of these workplaces, Latinx youth demonstrate numerous skills that are essential to industrial engineering, such as minimizing workplace injuries or optimizing processes to maximize efficiency. However, their workplace ingenuity and skills are often underrecognized by educational systems. To counter this lack of recognition, the purpose of this project is to iteratively develop and research an out-of-school engineering program for working Latinx youth. This program is designed to recognize and build from youths’ workplace experiences by connecting them with industrial engineering concepts and practices, such as those used to promote worker safety. This program is also designed for youth to articulate transformational visions of industrial engineering, which expand current goals, values, and methods commonly embraced within this discipline. This year-long program will be facilitated by educators of existing out-of-school programs (e.g., Mathematics, Engineering, and Science Achievement), in partnership with undergraduate mentors from the Society for Professional Hispanic Engineers and other local organizations that serve Latinx youth (e.g., Latinos in Action). Approximately 220 youth are expected to participate in the programming. Researchers will explore whether and how youth participants develop identities in engineering, as well as how the educators and mentors understand and enact assets-based, out-of-school engineering education grounded in youths’ experiences. Researchers will also identify the individual, institutional, and systemic factors that support or inhibit sustained implementation of the program over time in different sites and contexts. This project will result in a set of empirically tested, bilingual program materials that will be disseminated widely to professional organizations dedicated to out-of-school programming and to serving Latinx youth.
This project will result in a localizable, transferable, and sustainable model for an out-of-school time program that recognizes and amplifies Latinx youths’ workplace funds of knowledge and leverages them toward youth-driven visions and applications of engineering. This program, which will connect with other people and sites in youths’ learning ecosystems, is grounded in principles of translanguaging, transformational mentorship, and educational dignity and recognition. In partnership with youth participants, researchers will use a social design experiment to explore the following research questions: What are the engineering identity trajectories of working high school youth, and how do specific moments of identity negotiation and recognition relate to broader patterns across program sessions and identity trajectories for individual participants over time? To answer these questions, a pre-, mid- and post-program Engineering Identity Scale; recordings of program implementations; interviews; and youth artifacts will be analyzed using various methods such as critical multimodal discourse analysis. After implementations of the program across multiple sites, researchers will use design-based implementation research to answer the following questions: How do educators and mentors understand and enact assets-based pedagogies designed to foster recognition across sites? What institutional and systemic features (designed or naturalistic) support or inhibit productive adaptations and implementations of the program? These questions will be answered using constant comparative analyses of data sources such as interviews with the program educators and mentors, observations of program implementations, observations of professional development sessions, and public documents. Culturally responsive, educative evaluation will be used to iteratively improve the program. The resulting research and program materials will be disseminated widely through professional organizations dedicated to Latinx youth, engineering education, and out-of-school learning.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Amy Wilson-LopezAlfonso Torres-RuaMarisela Martinez-ColaColby Tofel-GrehlAlfonso Torres-Rua
From 2018 to 2020, the Emerging Research on Identity, Representation & Inclusion in Museums project team set out to document graduate-level research on identity in the museum field, and support professionals’ ongoing research and publishing on these topics. Researchers at Knology synthesized over 90 graduate student theses about identity and museums from 2000 to 2018. In parallel, we interviewed a sample of the authors whose work appeared in the literature review, to understand how identity research has played a role in their careers. To support new and ongoing identity research, we hosted a
We present an assessment of the Engage program, a graduate-student-created and led training program at the University of Washington. Using a pre-course/post-course study design, we examined student ability to deliver a short presentation appropriate for a public audience. Based on both self-assessments and assessments by external reviewers, we show that Engage trainees had an increase in their ability to employ effective communication techniques.
DATE:
TEAM MEMBERS:
Melissa ClarksonJuliana HoughtonWilliam ChenJessica Rodhe
The employment demands in STEM fields grew twice as fast as employment in non-STEM fields in the last decade, making it a matter of national importance to educate the next generation about science, engineering and the scientific process. The need to educate students about STEM is particularly pronounced in low-income, rural communities where: i) students may perceive that STEM learning has little relevance to their lives; ii) there are little, if any, STEM-related resources and infrastructure available at their schools or in their immediate areas; and iii) STEM teachers, usually one per school, often teach out of their area expertise, and lack a network from which they can learn and with which they can share experiences. Through the proposed project, middle school teachers in low-income, rural communities will partner with Dartmouth faculty and graduate students and professional science educators at the Montshire Museum of Science to develop sustainable STEM curricular units for their schools. These crosscutting units will include a series of hands-on, investigative, active learning, and standards-aligned lessons based in part on engineering design principles that may be used annually for the betterment of student learning. Once developed and tested in a classroom setting in our four pilot schools, the units will be made available to other partner schools in NH and VT and finally to any school wishing to adopt them. In addition, A STEM rural educator network, through which crosscutting units may be disseminated and teachers may share and support each other, will be created to enhance the teachers’ ability to network, seek advice, share information, etc.
This application requests support to enable a team of experienced science educators and biomedical and behavioral health network scientists to develop and implement the Worlds of Connections curriculum. Most middle school students are familiar with patient care-related health careers (e.g., nurses, dentists, surgeons), but few know about emerging careers in network science that can be leveraged to improve population health. This innovative and research-based science program is strategically designed to increase awareness of, understanding of, and interest in the important role of network science for health. This project will design learning activities that incite interest in network science applications to biomedical and public health research. The long- term goal is to enhance the diversity of the bio-behavioral and biomedical workforce by increasing interest in network science among members of underrepresented minority communities and to promote public understanding of the benefits of NIH-funded research for public health. The goal of this application is to identify and create resources that will overcome barriers to network science uptake among underserved minority middle school youth. The central hypothesis is that the technology-rich field of network science will attract segments of today’s youth who remain uninterested in conventional, bio-centric health fields. Project activities are designed to improve understanding of how informal STEM experiences with network science in health research can increase STEM identities, STEM possible selves, and STEM career aspirations among youth from groups historically underrepresented in STEM disciplines at the center of health science research (Aim 1) and create emerging media resources via augmented reality technologies to stimulate broad interest in and understanding of the role of network science in biomedical and public health research (Aim 2). A team led by University of Nebraska-Lincoln sociologists will partner with the University of Nebraska at Omaha; state museums; centers for math, science, and emerging media arts; NIH-funded network scientists; educators; community learning centers at local public schools; learning researchers; undergraduates; software professionals; artists; augmented reality professionals; storytellers; and evaluation experts to accomplish these goals and ensure out of school learning will reinforce Next Generation Science Standards. The Worlds of Connections project is expected to impact 35,250 youth and 20,570 educators in Lincoln and Omaha, Nebraska by: adding network science modules to ongoing 6th-8th-grade afterschool STEM clubs in community learning centers; adding network science for health resources to a summer graduate course on “activating youth STEM identities” for sixth to twelfth grade STEM teachers; connecting teachers with local network scientists; creating free, downloadable, high-quality emerging media arts-enhanced stories; and publishing peer-reviewed research on the potential of network science to attract youth to health careers. Coupled with the dissemination plan, the project design and activities will be replicable, allowing this project to serve as a model to guide other projects in STEM communication.
PUBLIC HEALTH RELEVANCE:
The lack of public understanding about the role of network science in the basic biological and social health sciences limits career options and support for historically underrepresented groups whose diverse viewpoints and questions will be needed to solve the next generation of health problems. The Worlds of Connections project will combine network science, social science, learning research, biology, computer science, mathematics, emerging media arts, and informal science learning expertise to build a series of monitored and evaluated dissemination experiments for middle school science education in high poverty schools. Broad dissemination of the curriculum and project impacts will employ virtual reality technologies to bring new and younger publics into health-related STEM careers.
DATE:
-
TEAM MEMBERS:
Julia McquilanGrace Stallworth
resourceprojectProfessional Development, Conferences, and Networks
The Teen Science Cafe Network is an adaptation for teens, of the popular adult science cafe model, which brings people together in a social setting to have an animated conversation with a scientist on some interesting and timely topic. Since its inception in 2012, the Network has grown at a rapid rate: it is now in 130 sites in 45 states, the District of Columbia, and British Columbia. Multiple evaluations have documented its impact. Teens are shown to have increased STEM literacy, a more realistic picture of scientists as real people leading interesting lives, and a better understanding of the nature of science. This two-and-a-half-day conference is designed to review the state of this model of teen engagement in science and science communication. Participants will examine lessons learned from this and similar networks to consider the features needed to expand this model to other audiences (e.g., rural teens, teenage college students, teenagers on military bases, and teens served by local chapters of professional societies based on ethnicity and gender).
Leaders of the Teen Science Cafe Network, along with an advisory committee comprised of individuals who are successfully managing networks, will explore these fundamental questions: 1) How can the field best take advantage of this large and growing network? 2) How can the current community of practice be leveraged for growth? 3) What are some of the most effective strategies for achieving and maintaining effective, long-term partnerships with organizations such as 4-H, science centers, networks of afterschool providers, science festivals, professional societies, and libraries? 4) What are possible outcomes for promoting discipline-specific cafes in areas such as ocean science, astrophysics, geoscience, and polar science? Outputs from the conference include a refined set of guiding principles for the current network and a white paper describing the features of strong and effective networks and recommendations for scaling.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Michelle HallJanice MokrosMichael Mayhew
Research on how museum staff are trained continues to emerge. Training varies considerably across institutions and typically includes observations, shadowing, and trial and error. While museum educators put high value on increasing visitor-centered participatory experiences, engagement based on acquisition-based theories of learning is still common among floor staff, even after training. Facilitating learning about science, technology, engineering, and mathematics (STEM) topics in ways that support visitors in constructing their own understanding is difficult, especially since floor staff/facilitators may be working simultaneously with children and adults of a range of ages, backgrounds, and goals. This project will advance understanding of how to facilitate open-ended learning experiences in ways that engage visitors in practices that align with the STEM disciplines. The project will result in an evidence-based facilitation framework and training modules for training informal science educators. The work is grounded in constructivist theories of learning and identity work and focuses on visitors constructing understanding of STEM topics through active engagement in the practices of STEM. This model also results in learning experiences in informal settings that are mutually reinforcing with the goals of schools. This research is being conducted through an established researcher-practitioner partnership between MOXI, the Wolf Museum of Exploration + Innovation and the University of California at Santa Barbara (UCSB).
The two primary goals of the work are to (1) enable visitors to better engage in STEM practices (practice-based learning) and (2) investigate the role of training in helping facilitators develop the practice-based facilitation strategies needed to support visitors' learning. STEM content in this study is physical science. Prior work resulted in two tools that constitute part of a facilitation framework (a practices-by-engagement matrix and three facilitation pathways) which help educators identify appropriate goals based on how the visitor is engaging with exhibits. The development of the final tool in the framework, facilitation strategies, and the refinement of the first two tools will be done using a design-based implementation research (DBIR) approach. Data collection and analysis will be directed and completed by research-practitioner teams of UCSB graduate students (researchers) and MOXI educators (practitioners); MOXI educators will be both participants and researchers. Data collection activities include: video data using point-of-view cameras worn by visitors and educators; interviews of educators and visitors; observations of the training program; and educator reflections. In the final year, a small field test will be done at six sites, representing different types of museums. Interviews and reflections comprise the data collection at the field sites.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Consideration of the needs of individuals with a wide range of disabilities is not always considered in the early design stages of an informal STEM learning (ISL) activity or program. The primary access approach for people with disabilities becomes the provision of accommodations once the ISL product or environment is created. In contrast, the Universal Design approach considers users with a wide range of characteristics throughout the design process and works to create products and environments that are accessible, usable, and inclusive. This project, called AccessISL, led by the University of Washington's DO-IT (Disabilities, Opportunities, Internetworking and Technology) Center and Museology Program, includes an academic museology program and local ISL sites, representing museums, zoos, aquariums, makerspaces, science centers, and other sites of informal STEM learning. Insights will be gained through the engagement of people with disabilities, museology graduate students and faculty, and ISL practitioners. The AccessISL project model, composed of a set of approaches and interventions, builds on existing research and theory in the fields of education science, change management, effective ISL practices, and inclusive design processes. The project will collect evidence of policies and practices (or lack thereof) that improve the inclusiveness of ISL with respect to a wide range of disabilities and considers approaches for the design and development of new strategies; explores what stakeholders need to make change happen; uncovers challenges to the adoption of inclusive practices in public ISL settings and explores ways to overcome them; and proposes relevant content that might be included in museology curriculum. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project addresses the following two objectives:
For ISL personnel and museology faculty: to increase knowledge, skills, and actions to make ISL programs, facilities, courses, and resources more welcoming and accessible to participants with disabilities and embed relevant practices within their work.
For postsecondary STEM students with disabilities and museology students: to increase knowledge and skills in advocating for ISL offerings that are welcoming and accessible to everyone, including those with a wide variety of disabilities, and to encourage individuals with disabilities to pursue careers in ISL.
The project employs a student-centered approach and a set of practices that embrace the social model of disability, social justice education, disability as a diversity issue, intersectionality, and Universal Design. A leadership team of interns--each member a STEM student with a disability or a museology graduate student--along with project staff will engage with the University of Washington's Museology Program to identify and implement strategies for making ISL activities and courses more welcoming and accessible to individuals with disabilities. An online community of practice will be developed from project partners and others nationwide. A one-day capacity building institute will be held to include presentations, student/personnel panels for sharing project and related experiences, and group discussions to explore issues and further identify systemic changes to make ISL programs more welcoming and accessible to individuals with disabilities. As prototypes of the AccessISL Model are developed, evaluation activities will primarily be formative (looking for strengths and weaknesses) and remedial (identifying/implementing changes that could be made to improve the model). The model will continue to be fine-tuned through formative evaluation. Evaluation of the model components will focus on the experience of a range of stakeholders in the project. Specifically, quantitative data collected will include levels and quality of engagement, accessibility recommendations and products developed, and delivery of ISL services. Qualitative data will be collected through observations, surveys, focus groups, interviews, and case studies.
AccessISL project products will include proceedings of an end-of-project capacity building institute, promising practices, case studies, a video, and other online resources to help ISL practitioners and museology faculty that will result in making future ISL opportunities more inclusive of people with disabilities. AccessISL will advance knowledge and ensure long-term impact using multiple strategies:
broadening the STEM participation of people with disabilities as well as women, racial/ethnic minorities, and other underrepresented groups through the application of universal design
strengthening associations and creating synergy and durable relationships among stakeholders,
encouraging teaching about disability, accessibility, and universal design in museology courses,
empowering students with disabilities and current and future ISL practitioners to advocate for accessible ISL and develops an infrastructure to promote accessible ISL programs nationwide, and
contributing to the body of promising practices with products that will (a) enhance understanding of issues related to the inclusion of people with disabilities in ISL programs and (b) promote inclusive practices.
Outcomes will benefit society by making STEM opportunities available to more people and enhancing STEM fields with the talents and perspectives of people with disabilities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.