The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
Informal STEM education institutions seek to engage broader cross sections of their communities to address inequities in STEM participation and remain relevant in a multicultural society. In this chapter, we advance the role that evaluation can play in helping the field adopt more inclusive practices and achieve greater equity than at present through evaluation that addresses sociopolitical contexts and reflects the perspectives and values of non-dominant communities. To do this for specific projects, we argue that evaluation should privilege the voices and lived experiences of non-dominant
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project will research the educational impact of social robots in informal learning environments, with applications to how social robots can improve participation and engagement of middle-school girls in out-of-school computer science programs in under-resourced rural and urban areas. The use of robots to improve STEM outcomes has focused on having learners program robots as tools to accomplish tasks (e.g., play soccer). An alternate approach views robots as social actors that can respond intelligently to users. By designing a programmable robot with social characteristics, the project aims to create a culturally-responsive curriculum for Latina, African American, and Native American girls who have been excluded by approaches that separate technical skill and social interaction. The knowledge produced by this project related to the use and benefits of social programmable robots has the potential to impact the many after-school and weekend programs that attempt to engage learners in STEM ideas using programmable robot curricula.
The project robot, named Cozmo, will be programmed using a visual programming language and will convey emotion with facial expressions, sounds, and movements. Middle school girls will engage in programming activities, collaborative reflection, and interact with college women mentors trained to facilitate the course. The project will investigate whether the socially expressive Cozmo improves computer science outcomes such as attitudes, self-efficacy, and knowledge among the middle school female participants differently than the non-social version. The project will also investigate whether adding rapport-building dialogue to Cozmo enhances these outcomes (e.g., when a learner succeeds in getting Cozmo to move, Cozmo can celebrate, saying "I can move! You're amazing!"). These questions will be examined research conducted with participants in multi-session after-school courses facilitated by Girl Scout troops in Arizona. The project will disseminate project research and resources widely by sharing research findings in educational and learning science journals; creating a website with open source code for programming social robots; and making project curriculum and related guidelines available to Girl Scouts and other educational programs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The purpose of this study is to thoroughly describe a program designed to strengthen the pipeline of Latino students into post-secondary science, technology, engineering, and mathematics (STEM) education, and present evaluation data to assess multiyear effectiveness. The program includes a suite of interventions aimed at students and families, and was implemented in a low-income school cluster with a high Latino population in metro Atlanta. Our intervention includes a high school and middle school mentoring program, STEM-focused extracurricular activities (summer camps, research and community
DATE:
TEAM MEMBERS:
Diley HernandezMarion UsselmanShaheen RanaMeltem AlemdarAnalia Rao
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
Young people learn about science, technology, engineering, and math (STEM) in a variety of ways and from many sources, including school, the media, personal experiences, and friends and family. Yet STEM participation and identification by youth are not equal across social, economic, and cultural communities. This project will study a long-term, out-of-school program for high school-age youth, who are from groups under-represented in STEM academics and careers: girls, youth from low-income households, and youth of color. Located in the urban context of the Science Museum of Minnesota, the Kitty Andersen Youth Science Center (KAYSC) engages youth in applying culturally rich STEM content to work toward social justice and community building. Specifically, this project will examine how the learning practices of the KAYSC model support youth in identifying with, engaging in, and participating in STEM. Through studying the KAYSC's STEM Justice model, which centers youth as learners, teachers, and leaders who address critical community issues through STEM, this project will develop resources that informal science educators in a variety of contexts and programs can use to promote positive social change, equity, inclusion, and applied STEM learning.
The Science Museum of Minnesota will use design-based implementation research to study this model. This research will draw on and further the emerging theoretical framework of science capital. Science capital attempts to capture multiple aspects of science learning and application, including science knowledge, social and cultural resources, and science-related behaviors and practices. Empirically developing the theory of science capital has the potential to build concrete understanding of how to address inequalities in science participation. Four teams will work independently and collaboratively to do so: an adult research team, a high school youth research team, a practitioner team, and a co-design team composed of representatives from the other three teams. Research teams will collect data in the form of observations, semi-structured interviews, practitioner activity reports, artifacts, and the experience sampling method. Initial cycles of design will occur at the Science Museum of Minnesota as researchers and practitioners document, analyze, and iteratively design learning practices within the STEM Justice model. In the second half of the grant, the team will work with an external out-of-school time youth leadership site to implement the redesigned model. Participatory research and design methods involving both youth and adults can advance understanding of what makes out-of-school time STEM learning meaningful, relevant, and successful for marginalized youth and their communities. Grounded in culturally and socially relevant, community-based resources and programming, this project will study how leveraging STEM out-of-school time learning connected to social justice can broaden access to STEM as well as develop workforce, and leadership, and STEM skills by under-represented youth. The project also builds staff capacity for promoting equity and access in informal learning settings.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This paper sketches the context for participation in science by girls from historically underrepresented populations and offers a detailed description of Sisters4Science (S4S) and its personalized, girl-centered pedagogy. The S4S example suggests a need to complement current out-of-school science programs with lessons from girl-centered practice and research.
The youth-based ITEST proposal, Invention, Design, Engineering and Art Cooperative (IDEA), will provide 100 students in grades 8-12 from the East Side of St. Paul, Minnesota with IT experiences in engineering and design. The content focus is mechanical and electrical engineering, such as product design, electronics, and robotics with an emphasis on 21st century job skills, including skills in advanced areas of microcontrollers, sensors, 3-D modeling software, and web software development for sharing iterative engineering product design ideas and maintaining progress on student product development. These technologies are practical and specific to careers in engineering and standards for technological literacy. During the three-year project period, a scaffolding process will be used to move students from exploratory activities in Design Teams in the 8th and 9th grades to paid employment experiences in grades 10-12 as part of Invention Crews. All design and product invention work will be directly connected to solving problems for local communities, including families and local businesses. For grades 8 and 9, students will receive 170 total contact hours per year and for grades 10-12, 280 contact hours per year. The participant target goal is 75% participation by girls, and African-American and Latino youth. Students participating in this project are situated within the country's most diverse urban districts with students speaking more than 103 languages and dialects. The schools targeted by this project average 84% of students receiving free or reduced price lunches, and have a population with 81% falling below proficiency in the Grade 8/11 Math MCA-II Test. To achieve the project goals of recruiting underrepresented students, and supporting academic transitions from middle and high school to college and university, the project team aggregated an impressive group of project partners that include schools, colleges, universities, and highly experienced youth and community groups, technology businesses that will provide mentoring of students and extensive involvement by parent and family services. Every partner committed to the project has a longstanding and abiding commitment to serving students from economically challenged areas.
DATE:
-
TEAM MEMBERS:
Anika WardKristen MurrayRachel GatesDavid Gundale
Building Demand for Math Literacy is a comprehensive project designed to increase arithmetic and algebraic mathematical competency among underserved youth, as well as high school and college students trained as Math Literacy Workers. This project builds on the success of the nationally renowned Algebra Project that is designed to foster mathematics achievement among inner city youth. Math Literacy Workers will deliver after school activities to African-American and Hispanic youth in grades 3-6. In addition to offering weekly math literacy workshops, Math Literacy Workers will also develop and implement Community Events for Mathematics Literacy and activities for families in the following cities: Boston, MA; Chicago, IL; Jackson, MS; Miami, FL; Yuma, AZ; New Orleans, LA; San Francisco, CA and Newark, DE. The strategic impact will be demonstrated in the knowledge gained about the impact of diverse learning environments on mathematics literacy, effective strategies for family support of math learning, and the impact of culturally relevant software. Collaborators include the Algebra Project, the TIZ Media Foundation, and the Illinois Institute of Technology, as well as a host of community-based and educational partners. The project deliverables consist of a corps of trained Math Literacy Workers, workshops for youth, training materials and multimedia learning modules. It is anticipated this project will impact over 4,000 youth in grades 3-6, 700 high school and college students, and almost 4,000 family and community participants.