The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluation firm Knight Williams, Inc. administered an online survey to educators from 16 SciGirls CONNECT2 partner organizations to gather information about their anticipated use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the original SciGirls Seven strategies – to complete the survey about the draft updated strategies after they were shared by TPT in March 2018 via an online webinar and a
The independent evaluation firm, Knight Williams, Inc., administered an online survey and conducted follow-up interviews with educators from 14 SciGirls CONNECT2 partner organizations to gather information about their use of, reflections on, and recommendations relating to the SciGirls Seven strategies. The evaluation aimed for two educators from each partner organization – specifically the program leader and one educator who was familiar with the SciGirls Seven – to share reflections on the strategies after they completed their Year 1 programs. In all, 24 educators from 13 partners completed
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
The goal for this research study was to determine the role of the SciGirls gender-equitable strategies on participating youths’ STEM identity changes in 16 participating SciGirls’ programs across the nation. The definition of STEM identity was based on Eccles (2007), Carlone and Johnson (2007) and Calabrese Barton and colleagues (2013). According to these researchers, individuals must have a positive STEM identity in order to persist in STEM careers. This positive STEM identity is affected by an individual’s expectations of success in STEM and the value they see in STEM and STEM careers
For nearly 20 years, the UAB Center for Community OutReach Development (CORD) has conducted SEPA funded research that has greatly enhanced the number of minority students entering the pipeline to college and biomedical careers, e.g., nearly all of CORD’s Summer Research Interns since 1998 (>300) have completed/are completing college and most of them are continuing on to graduate biomedical research and/or clinical training and careers. CORD’s programs that focused on high and middle school students have drawn many minority students into biomedical careers, but a low percentage of minority students benefit from these programs because far too many are already left behind academically in grades 4-6, due, at least in part, to a significant drop in science grades between grades 4 and 6, a drop from which most students never recover. A major contributor to this effect is that most grade 4-6 teachers in predominantly minority schools lack significant formal training in science and often are not fully aware of the great opportunities offered by biomedical careers.
In SEEC II, CORD will deliver intensive inquiry-based science training to grade 4-6 teachers, providing them with science content and hands-on science experiences that will afford their student both content and skills that will make them excited about, and competitive for, the advanced courses needed to move into biomedical research careers. SEEC II will also link teachers together across the elementary/middle school divide and bring the teachers together with administrators and parents, who will experience firsthand the excitement that inquiry learning brings and the significant advancement it provides in science and in reading and math. At monthly meetings and large annual celebrations, the parents, teachers and administrators will learn about the opportunities that biomedical careers can provide for the student who is well prepared. They will also consider the financial and educational steps required to ensure that students have the ability to reach these professions.
SEEC II will also expand CORD’s middle school LabWorks and Summer Science Camps to include grade 4-5 students and provide the teachers with professional learning in informal settings. During summer training, in small groups, the teachers will expand one of the inquiry-based science activities that they complete in the training, and they will use these in their classrooms and communicate with the others in their group to perfect these experiences in the school year. Finally, the teachers and grade 4-5 students will develop science and engineering fair-type research projects with which they will compete both on the school level and at the annual meeting. Thus, the students will share with their parents the excitement that science brings. The Intellectual Merit of SEEC II will be to test a model to enhance grade 4-6 teacher development and vertical alignment, providing science content, exposure to biomedical scientists and training in participatory science experiments, thus positioning teachers to succeed. The Broader Impacts will include the translation and testing of a science education model to assist minority students to avoid the middle school plunge and reach biomedical careers.
Hopa Mountain, working in partnership with Montana State University (MSU), will develop innovative and coordinated opportunities for Montana youth to strengthen their STEM (Science, Technology, Engineering and Mathematics) skills and knowledge while preparing them for higher education and careers in health sciences. The overall project goal of HealthMakers is to support rural and tribal youth’s interest and exposure to careers in the sciences while giving them the skills and resources to play leadership roles in increasing healthy family practices in their homes and communities. HealthMakers will achieve meaningful impacts annually through four strategies: (1) Health-focused college preparation programs for 50 teens; (2) Summer academic enrichment programs for 20 teens; (3) Community-based science literacy events for 2,000 children and their families, and (4) Professional development for educators, community members, and parents. Hopa Mountain and MSU will engage youth, educators, community leaders, and parents in training opportunities through HealthMakers. Participants will take part in community-based workshops, college tours, and summer institutes led by MSU faculty, healthcare professionals, Hopa Mountain staff, and their peers. Through these strategic aims, HealthMakers will help create a stronger workforce and inspire students to pursue careers in the sciences.
PUBLIC HEALTH RELEVANCE:
HealthMakers will support the development of health-related outreach and college preparation programs and training resources to create a better-informed workforce for Montana and inspire students to pursue careers in the sciences. These strategic aims and deliverables benefiting rural and tribal families and children, will help create a stronger workforce and inspire students to pursue careers in the sciences. Working together, Hopa Mountain and Montana State University will support rural and tribal youth’s interest and exposure to careers in the health sciences while giving them the skills and resources to play leadership roles in increasing healthy family practices in their communities.
Underrepresented minorities (URMs) represent 33% of the US college age population and this will continue to increase (1). In contrast, only 26% of college students are URMs. In the area of Science Technology, Engineering and Mathematics (STEM), only 15% of college students completing a STEM major are URMs (2). While there have been gains in the percent of Hispanic and Black/African Americans pursuing college degrees, the number of Native American college students remains alarmingly low. In 2013, Native Americans represented only 1% of entering college students and less than 50% finished their degree. Moreover, 1% of students pursuing advanced degrees in STEM-related fields are Native American/Alaska Native. With regards to high school graduation rates, the percent of Native American/Alaska Native students completing high school has decreased with only 51% of students completing high school in 2010 compared to 62 % and 68% for Black and Latino students respectively. While identifying ways to retain students from all underrepresented groups is important, developing programs targeting Native American students is crucial. In collaboration with the Hopi community, a three-week summer course for Native American high school students at Harvard was initiated in 2001. Within three years, the program expanded to include three additional Native American communities. 225 students participated in the program over a 10-year period; and 98% of those responding to the evaluation completed high school or obtained a GED and 98% entered two or four year colleges including 6 students who entered Harvard. This program was reinitiated in 2015 and we plan to build on the existing structure and content of this successful program. Specifically, in collaboration with two Native American communities, the goal of the program is 1) to increase participants’ knowledge of STEM disciplines and their relevance to issues in participants’ communities via a three week case-based summer course for Native American high school students; 2) to help enhance secondary school STEM education in Native American communities by providing opportunities for curriculum development and classroom enhancement for secondary school teachers in the participating Native American communities; and 3) to familiarize students with the college experience and application process and enhance their readiness for college through workshops, college courses and internships. Through these activities we hope to 1) increase the number of Native American students completing high school; 2) increase the number of Native American students applying and being accepted to college; 3) increase the number of Native American students pursuing STEM degrees and careers; 4) increase the perception among Native American students that attending and Ivy plus institution is attainable; 5) increase the feeling of empowerment that they can help their community by pursuing advanced degrees in STEM.
PUBLIC HEALTH RELEVANCE:
This proposal supports a summer program for high school students and teachers from Native American communities. The program goals are to encourage students to complete high school and prepare them for college and to also consider degrees in science, technology, engineering, and math.
The goals of this proposal are: 1) to provide opportunities for underrepresented students to consider careers in basic or clinical research by exciting them through an educational Citizen Science research project; 2) to provide teachers with professional development in science content and teaching skills using research projects as the infrastructure; and 3) to improve the environments and behaviors in early childcare and education settings related to healthy lifestyles across the state through HSTA students Citizen Science projects. The project will complement or enhance the training of a workforce to meet the nation’s biomedical, behavioral and clinical research needs. It will encourage interactive partnerships between biomedical and clinical researchers,in-service teachers and early childcare and education facilities to prevent obesity.
Specific Aim I is the Biomedical Summer Institute for Teachers led by university faculty. This component is a one week university based component. The focus is to enhance teacher knowledge of biomedical characteristics and problems associated with childhood obesity, simple statistics, ethics and HIPAA compliance, and the principles of Citizen Science using Community Based Participatory Research (CBPR). The teachers, together with the university faculty and staff, will develop the curriculum and activities for Specific Aim II.
Specific Aim II is the Biomedical Summer Institute for Students, led by HSTA teachers guided by university faculty. This experience will expose 11th grade HSTA students to the biomedical characteristics and problems associated with obesity with a focus on early childhood. Students will be trained on Key 2 a Healthy Start, which aims to improve nutrition and physical activity best practices, policies and environments in West Virginia’s early child care and education programs. The students will develop a meaningful project related to childhood obesity and an aspect of its prevention so that the summer institute bridges seamlessly into Specific Aim III.
Specific Aim III is the Community Based After School Club Experiences. The students and teachers from the summer experience will lead additional interested 9th–12th grade students in their clubs to examine their communities and to engage community members in conducting public health intervention research in topics surrounding childhood obesity prevention through Citizen Science. Students and teachers will work collaboratively with the Key 2 a Healthy Start team on community projects that will be focused on providing on-going technical assistance that will ultimately move the early childcare settings towards achieving best practices related to nutrition and physical activity in young children.
The purpose of the proposed project, Community of Bilingual English-Spanish Speakers Exploring Issues in Science and Health (CBESS), is to increase linguistic diversity in science, technology, engineering, and math (STEM)-healthcare fields, including biomedical, behavioral, and clinical research careers. With support of the large group of Spanish-English bilingual (SEB), STEM-healthcare professionals that was formed during this proposal preparation, CBESS will contribute to the pipeline between K–12 and higher education/career.
CBESS will recruit Spanish-English bilingual (SEB) high-school students at the end of tenth grade and implement several language-supported STEM-healthcare interventions during the eleventh and twelfth grade (17 months): family-engaged career exploration; Next Generation Science Standards (NGSS)-aligned, inquiry-based, youth-led summer research residential program; community outreach/dissemination, internships, and mentoring.
Applying methods that are known to be effective with the target population, CBESS will also train undergraduate, near-peer instructor-mentors—STEM-healthcare Leadership Trainees (LT)—in inquiry-based instruction and strategies for positioning K–12 bilingual students as “insiders” in STEM-healthcare, as well as in the responsible conduct of research and mentoring skills, followed by practical application with SR.
CBESS will develop and expand the nascent SEB STEM-healthcare community of practice (CoP) that was created during CBESS proposal preparation. Committed academic, clinical, research, and community partners will contribute to research and evaluation efforts, and support the pipeline between K–12 and higher education/career through Community Based Participatory Research (CBPR), framing priority community health issues to be addressed by each cohort of SR from among issues identified by the SR during the application process. Finally, the CoP will target long-term institutional sustainability for linguistically diverse students in STEM-healthcare education and careers.
The National Building Museum contracted RK&A to conduct an evaluation Investigating Where We Live (IWWL), a long-running program that has brought together creative youth in the Washington, D.C. area every summer since 1996 to explore, document, and interpret the local built environment. The study goal was to examine program strengths and challenges to help NBM strategically plan for the program’s future.
How did we approach this study?
To hear a variety of perspectives on the program, RK&A conducted in-depth telephone interviews with a number of stakeholders with different
Increased exposure to STEM content and career pathways during out-of-school time contexts can significantly extend STEM learning and aspirational interests among middle and high school youth. Using a collective impact approach, the STEM CareerLaunch pilot project tests the feasibility of redesigning a widely used, national youth and career focused program for and by the National Boys & Girls Clubs of America to extend STEM learning and promote awareness, interest, and readiness for STEM-related occupations among youth. STEM CareerLaunch integrates extant STEM programs, such as First Robotics, Girls Who Code and Jason Learning, with newly developed STEM content and opportunities to create and test a comprehensive STEM learning and career program for youth. The results of this pilot will inform a more expansive effort to bring STEM CareerLaunch to an already networked 4,000 Boys & Girls Clubs, reaching over four million youth from predominately underrepresented groups in STEM, and youth participating in other afterschool/summer program throughout the United States.
Approximately 100 youth and informal educators in Boys & Girls Clubs in Fitchburg and Leominster, Massachusetts will participate in this pilot feasibility study. A five-pronged approach will be instituted including: (1) high quality out of school time STEM programming, (2) connected STEM career education, (3) mentorship, (4) professional development for the informal educators, and (5) incentives such as internships and field experiences for youth participants. The developmental evaluation will focus on program implementation, participant outcomes, and scale-up. Data collection methods will include quantitative and qualitative approaches such as baseline student data, project tracking logs, retrospective surveys, focus groups, staff interviews, and observations. A summative evaluation will also be conducted.
This endeavor is led by a collaborative partnership between the National Boys & Girls Clubs of America, Worcester Polytechnic Institute STEM Center, the Fitchburg and Leominster Public School Districts, and others. It is primarily funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It is also co-funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program which is committed to better understanding and promoting practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, and or mathematics (STEM).
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.