Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
DATE:
TEAM MEMBERS:
Ginger Fitzwater
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
resourceevaluationProfessional Development, Conferences, and Networks
The Summative Study of the Nano Mini-exhibition took place during the spring and summer of 2012. After being observed during their Mini-exhibition experience, 455 visitors across six different partner institutions participated in surveys and interviews with NISE Net evaluation team members. This report begins by describing the key findings of the study in detail, with additional information about study methods, instruments, and two exploratory sub-studies found in the Appendices.
This paper introduces an ongoing research project on the use of electronics workshops in engaging underprivileged Latino middle and high school students in STEM – Science, Technology, Engineering and Mathematics. The project focuses on the practice of circuit bending – taking apart and creatively manipulating the circuits of children's toys to produce novel sound output. The main goal of the project is to design, develop and test curricula and materials that inspire learning in adolescents. Second hand, discarded or low cost electronics are used in the workshops as a low cost platform for
DATE:
TEAM MEMBERS:
Garnet HertzGillian HayesAmelia Guimarin
This pathways project will design, develop and test Do-It-Yourself, (DIY), hands-on workshops to introduce and teach middle school females in underserved Latino communities computing and design by customizing and repurposing e-waste media technology, such as old cell phones or appliances -- items found in the students homes or neighborhoods. The major outcome of the project will be the creation of a workshop kit that covers the processes of DIY electronics learning taking place in the workshops for distribution of the curriculum to after school programs and other informal science venues. The PIs have implemented three pilot projects over the last three years that demonstrate the ability of hands-on DIY electronics curricula to motivate and encourage students and to enable them to acquire a deeper understanding of core engineering, mathematics and science concepts. This project would extend the approach to underserved Latino youth, particular girls of middle school age. This audience was identified because of the historically low rate of participation in STEM fields by people in this group and the particular challenges that females have in acquiring knowledge in technical STEM areas. The proposal suggests that the approach of using hands-on workshops that rely on low technical requirements -- essentially obsolete or discarded electronic equipment, primarily from homes of participants -- will encourage the target audience to experiment with items they are familiar with and that are culturally relevant. The hypothesis of the project is that this approach will lower barriers to experimenting with "circuit bending" - the hand-modifying of battery-powered children's toys to build custom electronic instruments and lead to greater participation and success of females in the target group. The project will provide free workshops in two neighborhood locations and be supported by undergraduate student mentors and volunteers and staff of two community groups that are part of the project, Machine Project and Girls, Inc. Participants will demonstrate the finished projects to the workshop group, mentors and parents. Each participant will receive a copy of the workshop handbook in both English and Spanish to take home so that parents, members of the community and caregivers can supervise and participate in future projects.
DATE:
-
TEAM MEMBERS:
Garnet HertzGillian HayesRebecca Black
The Exploratorium, in collaboration with the Boys and Girls Club Columbia Park (BGC) in the Mission District of San Francisco, is implementing a two-year exploratory project designed to support informal education in science, technology, engineering, and mathematics (STEM) within underserved Latino communities. Building off of and expanding on non-STEM-related efforts in a few major U.S. cities and Europe, the Exploratorium, BGC, and residents of the District will engage in a STEM exhibit and program co-development process that will physically convert metered parking spaces in front of the Club into transformative public places called "parklets." The BGC parklet will feature interactive, bilingual science and technology exhibits, programs and events targeting audiences including youth ages 8 - 17 and intergenerational families and groups primarily in the Mission District and users of the BGC. Parklet exhibits and programs will focus on STEM content related to "Observing the Urban Environment," with a focus on community sustainability. The project explores one approach to working with and engaging the public in their everyday environment with relevant STEM learning experiences. The development and evaluation processes are being positioned as a model for possible expansion throughout the city and to other cities.
This article focuses on three approaches to STEM in out-of-school time that would be instructive for any organization seeking to develop STEM opportunities for teen girls. While Techbridge and Queens Community House focused on reaching populations most underrepresented in STEM—girls of color and those from immigrant and low-income families—the strategies they used could be applied to any population of adolescent girls.
DATE:
TEAM MEMBERS:
Harriet MosatcheSusan Matloff-NievesLinda KekelisElizabeth Lawner
This article reflects on the author's experience leading the 21st Century Community Learning Center (21st CCLC) program, which aimed to create a "culture of STEM" for both participants and staff. The author describes the experience of the children, the training of staff, and places for improvement.
This presentation given at the 2013 Materials Research Society (MRS) Spring Meeting examines evidence for the effectiveness of STEM education programs at the National High Magnetic Field Laboratory.
Funded by the National Science Foundation (NSF),The STEM Pathways project focused on exploring strategies through which at-risk and incarcerated Hispanic youth could be engaged around STEM careers, understand the education, training, and skills they would need to attain them, and think that such a path was a future possibility. To this end, the project and evaluation teams collaborated on a literature review, the development of a logic model, and the design, implementation, and evaluation of a diverse set of program activities that included media, art, and flash mentoring with STEM role models
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.