As science communication programs grow worldwide, effective evaluation and assessment metrics lag. While there is no consensus on evaluation protocols specifically for science communication training, there is agreement on elements of effective training: listening, empathy, and knowing your audience — core tenets of improvisation. We designed an evaluation protocol, tested over three years, based on validated and newly developed scales for an improvisation-based communication training at the Alan Alda Center for Communicating Science. Initial results suggest that ‘knowing your audience’ should
DATE:
TEAM MEMBERS:
Christine O’ConnellMerryn McKinnonJordan Labouff
Many studies have examined the impression that the general public has of science and how this can prevent girls from choosing science fields. Using an online questionnaire, we investigated whether the public perception of several academic fields was gender-biased in Japan. First, we found the gender-bias gap in public perceptions was largest in nursing and mechanical engineering. Second, people who have a low level of egalitarian attitudes toward gender roles perceived that nursing was suitable for women. Third, people who have a low level of egalitarian attitudes perceived that many STEM
DATE:
TEAM MEMBERS:
Yuko IkkataiAzusa MinamizakiKei KanoAtsushi InoueEuan McKayHiromi M. Yokoyama
Overlaying Computer Science (CS) courses on top of inequitable schooling systems will not move us toward “CS for All.” This paper prioritizes the perspectives of minoritized students enrolled in high school CS classrooms across a large, urban school district in the Western United States, to help inform how CS can truly be for all.
DATE:
TEAM MEMBERS:
Jean RyooTiera TanksleyCynthia EstradaJane Margolis
This award takes an innovative approach to an ongoing, pervasive, and persistent societal issue: women are still drastically underrepresented in computing careers. This project targets middle school-aged girls because it is a time when many of them lose interest and confidence in pursuing technical education and computing careers. This project will design, develop, and deploy a one-week experience focused on middle school girls that targets this issue with a novel combination of teaching techniques and technology. The project will use wearable computing devices to support girls' social interactions as they learn computing and solve technical challenges together. The goals of the project are to raise interest, perceived competence, and involvement in the computational ability of girls. Additionally, the project aims to increase a sense of computational community for girls that makes pursuing computational skills more relevant to their identities and lives, and that helps continued participation in computing. The project will deploy a one-week experience four times per year with a socioeconomically diverse range of campers. The project will also develop a 'program in a box' kit that can be broadly used by others wishing to deliver a similar experience for girls.
The planned research will determine if a one-week experience that uses social wearable construction in the context of live-action role play can use the mediating process of computational community formation to positively impact middle school girls' engagement with and interest in computation. Computational community is defined as girls engaging together in the process of learning computation, trading resources and knowledge, and supporting growth. Research participants will include 100 6th to 9th-grade girls. At least 75% of the participants will be either low income, first-generation college-bound, or underrepresented in higher education. Students will be recruited through the longstanding partnerships with title one schools in the Salinas Valley, the Educational Partnership Center, and in the Pajaro Valley Unified School district, where 82% of the students are Hispanic/Latinx, 42% are English Learners, and 73% are eligible for free or reduced lunch. The research questions are: 1) Does the proposed experience increase girls' self-reported competence, self-efficacy, and interest in computational skills and careers? and 2) Will the proposed experience lead to activity-based evidence of learning and integration of computational skills at the group social level? The project will use a mixed-methods, design-based research approach which is an iterative design process to rapidly collect and analyze data, and regularly discuss the implications for practice with the design team. Data will be collected using observations, interviews, focus groups, surveys, and staff logs. Quantitative data will be analyzed using frequencies, means, and measures of dispersion will be applied to survey data from both time points. Pearson correlation coefficients will be used to describe the bivariate relationship between continuous factors. ANOVAs will assess whether there are significant differences in continuous measures across groups. Qualitative data will be analyzed using a constant comparison method.
This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Katherine Isbister
resourceprojectProfessional Development, Conferences, and Networks
The National Science Teachers Association will convene a conference that will bring together STEM researchers and practitioners to review the growing connected science learning movement. A connected science learning environment has been described as a robust science ecology containing a wide variety of programs, across a range of institutions and places, allowing youth different and multiple ways to engage with STEM. Such environments can include small partnerships, such as a science museum and K-12 schools, or a large, community-wide network of a variety of organizations such as K-12 schools, museums, universities, government agencies, and community organizations. The conference will bring together over forty participants, who will meet in a series of several online meetings. The conference will result in a series of papers, articles in the online Connected Science Learning journal and other publications, a series of webinars and online forums where participants can engage with themes identified in the conference, and conference presentations at the annual meetings of organizations including the National Science Teachers Association, the Association of Science-Technology Centers, and others. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The conference will: (1) document the research foundation that supports and demonstrates the impact and value of high-quality connected science learning experiences; (2) identify areas for which future research is recommended; and (3) provide effective, practitioner-focused resources that advance connected STEM learning. The conference will include participants that represent a wide range of researchers and practitioners in informal and formal STEM education, as well as representing gender, racial/ethnic and geographical diversity. The results and products of the conference will be instrumental in developing the understanding and appreciation for connecting STEM learning and ultimately improving connected STEM learning for K-12 youth. The importance of emphasizing diversity, equity, and accessibility will be strongly represented in the key evidence identified through the conference and will be reflected in the resources that will be disseminated to a broader audience.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Background. STEM identity has emerged as an important research topic and a predictor of how youth engage with STEM inside and outside of school. Although there is a growing body of literature in this area, less work has been done specific to engineering, especially in out-of-school learning contexts.
Methods. To address this need, we conducted a qualitative investigation of five adolescent youth participating in a four-month afterschool engineering program. The study focused on how participants negotiated engineering-related identities through ongoing interactions with activities, peers
Informal STEM field trip programming is a large, yet under-researched area of the education landscape. Informal STEM education providers are often serving a more privileged section of society, leading to a risk of perpetuating inequalities seen throughout the education landscape. In an attempt to address the lack of research, this thesis explores the relationship between educational equity and informal STEM field trips. The intention was to collect data using a critical ethnography approach to the methods of qualitative questionnaire and interviews of informal STEM educators. A change in
For the SciGirls Strategies supplemental activity, ten educators were trained to be SciGirls Strategies trainers during June 2019. During that time, they developed action plans for their local teacher training. The goal was for each Trainer to train ten or more teachers in their local schools/districts. Trainers could plan and schedule their workshops to fit their local context in order to accomplish the objectives of building teacher’s confidence and skills in using gender equitable and culturally responsive teaching strategies.
After the training workshop, the trainers met once a month
For the SciGirls Strategies project supplement, ten educators were trained to be SciGirls Strategies Trainers through a four-day in person workshop in June 2019. During the workshop, educators learned about the Gender Equitable Teaching and Advising Strategies (GETAS) course content, the research-based SciGirls Strategies framework and instructional strategies and began to develop plans for their localized professional development for STEM and CTE educators.
The goal of the Train-the-Trainer program was for each Trainer to train 10 teachers in their school and/or school district. Trainers
The NIH Science Education Partnership Award (SEPA) program of Emory University endeavors to use an over-arching theme of citizen science principles to:
develop an innovative curriculum based on citizen science and experiential learning to evaluate the efficacy of informal science education in after-school settings;
promote biomedical scientific careers in under-represented groups targeting females for Girls for Science summer research experiences;
train teachers in Title I schools to implement this citizen science based curriculum; and
disseminate the citizen science principles through outreach.
This novel, experiential science and engineering program, termed Experiential Citizen Science Training for the Next Generation (ExCiTNG), encompasses community-identified topics reflecting NIH research priorities. The curriculum is mapped to Next Generation Science Standards.
A comprehensive evaluation plan accompanies each program component, composed of short- and/or longer-term outcome measures. We will use our existing outreach program (Students for Science) along with scientific community partnerships (Atlanta Science Festival) to implement key aspects of the program throughout the state of Georgia. These efforts will be overseen by a central Steering Committee composed of leadership of the Community Education Research Program of the Emory/Morehouse/Georgia Institute of Technology Atlanta Clinical Translational Science Institute (NIH CTSA), the Principal Investigators, representatives of each program component, and an independent K–12 STEM evaluator from the Georgia Department of Education.
The Community Advisory Board, including educators, parents, and community members, will help guide the program’s implementation and monitor progress. A committee of NIH-funded investigators, representing multiple NIH institutes along with experienced science writers, will lead the effort for dissemination and assure that on-going and new NIH research priorities are integrated into the program’s curriculum over time.
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by engaging in hands-on field experience, laboratory/project-based entrepreneurship tasks and mentorship experiences.
Twin Cities Public Television project on Gender Equitable Teaching Practices in Career and Technical Education Pathways for High School Girls is designed to help career and technical education educators and guidance counselors recruit and retain more high school girls from diverse backgrounds in science, technology, engineering and math (STEM) pathways, specifically in technology and engineering. The project's goals are: 1) To increase the number of high school girls, including ethnic minorities, recruited and retained in traditionally male -STEM pathways; 2) To enhance the teaching and coaching practices of Career and Technical Education educators, counselors and role models with gender equitable and culturally responsive strategies; 3) To research the impacts of strategies and role model experiences on girls' interest in STEM careers; 4) To evaluate the effectiveness of training in these strategies for educators, counselors and role models; and 5) To develop training that can easily be scaled up to reach a much larger audience. The research hypothesis is that girls will develop more positive STEM identities and interests when their educators employ research-based, gender-equitable and culturally responsive teaching practices enhanced with female STEM role models. Instructional modules and media-based online resources for Minnesota high school Career and Technical Education programs will be developed in the Twin Cities of Minneapolis and St. Paul and piloted in districts with strong community college and industry partnerships. Twin Cities Public Television will partner with STEM and gender equity researchers from St. Catherine University in St. Paul, the National Girls Collaborative, the University of Colorado-Boulder (CU-Boulder), the Minnesota Department of Education and the Minnesota State Colleges and Universities System.
The project will examine girls' personal experiences with equitable strategies embedded into classroom STEM content and complementary mentoring experiences, both live and video-based. It will explore how these experiences contribute to girls' STEM-related identity construction against gender-based stereotypes. It will also determine the extent girls' exposure to female STEM role models impact their Career and Technical Education studies and STEM career aspirations. The study will employ and examine short-form autobiographical videos created and shared by participating girls to gain insight into their STEM classroom and role model experiences. Empowering girls to respond to the ways their Career and Technical Education educators and guidance counselors guide them toward technology and engineering careers will provide a valuable perspective on educational practice and advance the STEM education field.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This exploratory Pilot study project brings together a diverse set of partners that include the Watertown Children's Theatre (WCT) which is west of Boston, and, from Boston College a team of science educators, learning science researchers, and positive youth development experts. The goal is to design and develop a project for middle school-aged youth. The pilot project, which integrates hands-on science learning experiences, experiments, and field trips with the student-led production of short plays, will engage youth in expressing their beliefs, passions, and their own identities about STEM by examining how the intersection of skills and practices used in both domains (science and theatre) can enable them to learn about science concepts, principles and methods as well as to develop science-focused identities. Middle-school youth will be engaged in a three-week summer program where they will be led by science teachers, playwrights, and high school students to conduct hands-on investigations in science in conjunction with developing original, ten-minute plays around a specific scientific theme relevant to their life experience, for example, the potential impact on their lives of heavy metals in water and poor air quality. After a science theme is chosen, the principal investigators will identify the big ideas that are important for youth to understand and be able to explain. Upon identification of the key science ideas, youth will then engage in pertinent science activities, visits to local sites, reading current news articles and then in identifying the local impacts and how the underlying science relates to those local impacts. The youth will perform their ten-minute plays at the end of the summer program. Following this showcase event, they will engage in additional science learning experiences and also revise their productions throughout the academic year in preparation for a youth science festival, where their creations will be performed by professional adult actors as a part of the Cambridge Science Festival taking place in the spring. The broader impact of the work focuses on broadening participation in STEM, specifically, the engagement of youth from under-represented populations in the sciences, such as African-Americans, Latinxs, and women with partner Boston Public Schools. The Pilot study will investigate the student learning and organizational dimensions of the model being developed.
The Boston College researchers will study youth's sense of purpose and identity toward science, particularly how youth's identity discrepancy changes through participation in the project. The work places youth voice at the center of the creation of STEM-based theatre plays. The theoretical foundation of the work is grounded in part in the concept of "path to purpose." The major research questions are: How do youth perceptions (interest, science anxiety, identity) toward science shift as they participate in the project? What is the residual impact on parents (family members) and youth on their discussions about science, and how does participation in the project impact those discussions? Research methods include surveys, interviews and observations. The external evaluation study will focus on understanding project implementation and progress toward meeting the project goals, in particular, how well the initiative works to establish a model for the informal STEM learning field that the team and others can apply beyond the Pilot study.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.