Concord Evaluation Group (CEG) conducted an outreach partner evaluation for Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
This project seeks to prepare female Hispanic students for leadership in the STEM workforce. The project seeks to determine if a blended set of STEM engagement activities including summer intensive laboratory-based experiential learning and out-of-school STEM activities, peer support, mentoring, and financial assistance can help to take target students through a traditional leaky workforce and educational pipeline resulting in matriculation to and graduation from undergraduate STEM programs. If successful, the work will increase participation and leadership of Hispanic women in the STEM workforce. To accomplish these goals, the PIs will: (1) work with partners to identify, recruit, and screen bright, energetic Hispanic females in their freshman year of high school who show promise and interest in STEM disciplines; (2) engage selected students and their families in formal and informal STEM learning both throughout the school year and during summer residential experiences to enable the students to further develop and clarify their STEM calling; (3)prepare the students to matriculate to undergraduate college; (4) provide program participants with full-tuition scholarships to ensure undergraduate education is attainable; and (5) at our institution and partner colleges, provide dedicated advisors and mentors and cohort activities to ensure undergraduate persistence and success.
Technical Summary
The PIs seek to prepare female Hispanic students for leadership in the STEM workforce. To compete in the global economy, maintain national security, and meet serious environmental challenges, more skilled graduates are needed to fill STEM jobs. An untapped source of talent exists in those populations that continue to be underrepresented in STEM fields, including women and people of color. This work will help to determine if a blended set of STEM engagement activities including summer intensive laboratory-based experiential learning and out-of-school STEM activities, peer support, mentoring, and financial assistance can help to take target students through a traditional leaky pipeline resulting in matriculation to and graduation from undergraduate STEM education. The work builds on research that shows that mentored research opportunities and peer support and interaction improves persistence in female students. It also builds on regional models of collective impact whereby a variety of corporate, nonprofit, and foundation organizations successfully join together for large-impact projects. If successful, the work will increase participation and leadership of Hispanic women in the STEM workforce.
DATE:
-
TEAM MEMBERS:
April MarchettiCharles EnglishRebecca MichelsenRachele DominguezLaurie Massery
Currently, many young people - especially girls and youth of color - lose confidence and interest in science, technology, engineering and math (STEM) pathways due to a perceived disconnect between their own identity and STEM fields. To address this challenge, Twin Cities PBS (TPT) is implementing SciGirls CONNECT2. This three-year Research in Service to Practice award examines how gender equitable and culturally responsive teaching strategies influence middle school girls' confidence, interest and motivation around STEM studies, and their choices around STEM careers. A set of research-based strategies, called the SciGirls Seven, are currently employed in SciGirls, an NSF-funded informal STEM educational outreach program serving 125+ educational partner organizations nationwide. The goal is to update and enrich the SciGirls Seven, providing educators with a critical, current, and more effective resource to motivate girls in STEM studies and careers. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Florida State University will conduct a formal research study investigating the hypothesis that STEM programs that use gender equitable and culturally responsive strategies contribute to girls' positive STEM identity development, including their sense of self-efficacy, persistence and aspirations around future STEM careers. This research will include a literature review and a study of girls' STEM identity creation. The mixed methods study will include quantitative and qualitative data collection and analysis measuring changes in students' STEM identity and teachers' confidence in STEM teaching. The quantitative data will come from the student, parent and teacher pre/post surveys. The qualitative research will be conducted via case studies at four sites and the qualitative data will include observations, focus groups and interviews. Girls at all partner sites will create videos that will allow the research team to gather additional insight. The independent firm Knight Williams, Inc. will conduct the project's external evaluation.
The project will work with a subset of 16 current SciGirls partners. These geographically diverse partners will reach youth in all-girls and co-ed informal STEM education programs in a variety of settings. More than half serve Hispanic or other minority populations. The updated strategies will be disseminated to the 2,500 educators within the SciGirls partner network and the 18,800 STEM education organizations of the National Girls Collaborative Project (NGCP) network. Dissemination of the strategies and literature review will focus on the informal STEM education field through publications and presentations, posts at PBS LearningMedia, a free online space reaching 1.5 million teachers and educators.
Young people learn about science, technology, engineering, and math (STEM) in a variety of ways and from many sources, including school, the media, personal experiences, and friends and family. Yet STEM participation and identification by youth are not equal across social, economic, and cultural communities. This project will study a long-term, out-of-school program for high school-age youth, who are from groups under-represented in STEM academics and careers: girls, youth from low-income households, and youth of color. Located in the urban context of the Science Museum of Minnesota, the Kitty Andersen Youth Science Center (KAYSC) engages youth in applying culturally rich STEM content to work toward social justice and community building. Specifically, this project will examine how the learning practices of the KAYSC model support youth in identifying with, engaging in, and participating in STEM. Through studying the KAYSC's STEM Justice model, which centers youth as learners, teachers, and leaders who address critical community issues through STEM, this project will develop resources that informal science educators in a variety of contexts and programs can use to promote positive social change, equity, inclusion, and applied STEM learning.
The Science Museum of Minnesota will use design-based implementation research to study this model. This research will draw on and further the emerging theoretical framework of science capital. Science capital attempts to capture multiple aspects of science learning and application, including science knowledge, social and cultural resources, and science-related behaviors and practices. Empirically developing the theory of science capital has the potential to build concrete understanding of how to address inequalities in science participation. Four teams will work independently and collaboratively to do so: an adult research team, a high school youth research team, a practitioner team, and a co-design team composed of representatives from the other three teams. Research teams will collect data in the form of observations, semi-structured interviews, practitioner activity reports, artifacts, and the experience sampling method. Initial cycles of design will occur at the Science Museum of Minnesota as researchers and practitioners document, analyze, and iteratively design learning practices within the STEM Justice model. In the second half of the grant, the team will work with an external out-of-school time youth leadership site to implement the redesigned model. Participatory research and design methods involving both youth and adults can advance understanding of what makes out-of-school time STEM learning meaningful, relevant, and successful for marginalized youth and their communities. Grounded in culturally and socially relevant, community-based resources and programming, this project will study how leveraging STEM out-of-school time learning connected to social justice can broaden access to STEM as well as develop workforce, and leadership, and STEM skills by under-represented youth. The project also builds staff capacity for promoting equity and access in informal learning settings.
This project is being funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. CHISPA is a national network of science museums and afterschool programs affiliated with ASPIRA and National Council of La Raza (NCLR), working together to build stronger communities and increase the engagement of Hispanic children and their families with science and local science resources. The project period is October 2013 through September 2017.
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. 'Be a Scientist!' is a full-scale development project that examines the impact of a scalable, STEM afterschool program which trains engineers to develop and teach inquiry-based Family Science Workshops (FSWs) in underserved communities.
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
In Defense of Food (IDOF) is a media and outreach project based on Michael Pollan's best-selling book of the same title. Through the lens of food science, IDOF is designed to engage diverse audiences in learning about: (1) how science research is conducted, (2) how research findings are used in media, marketing, and public policy, and (3) how to apply food science research in everyday life. IDOF will be created by Kikim Media, an independent production company, broadcast and distributed by PBS and supported by an extensive outreach campaign and interactive website. The project's educational materials will be developed, in part, by the Teacher's College at Columbia University's Center for Food and Nutrition, with dissemination supported by the Coalition for Science After School and by Tufts University's Healthy Kids Out of School initiative, which involves nine of the leading out of school time (OST) organizations, such as Girl Scouts USA, and the National Urban League. The project advisory committee includes highly respected researchers in food, nutrition, and health. IDOF will use an integrated strategy of learning resources, combining a television documentary with online/social media, community outreach, and youth activities. Knight Williams Research Communications will conduct formative and summative evaluation of all major components of the project. The results will advance the informal science community's understanding of how the combination of a documentary with outreach, website/social media, and afterschool activities impacts motivation and learning. The evaluation study will pay special attention to the degree to which participation in the community events, social media/website, and afterschool activities motivates deeper or extended engagement with the subject. Project evaluation results and educational resources will be widely disseminated to the informal science community. IDOF includes a two-hour documentary film that will be produced in both English and Spanish; a community-level outreach campaign focused on reaching underserved audiences who may not watch public television; a set of activities for use in afterschool programs, youth programs and schools; and an interactive and content-rich website with tightly integrated social media tools. IDOF will be nationally broadcast by PBS; the Spanish-language version of IDOF will be broadcast by Vme Television. The ambitious IDOF educational materials and outreach campaign, combined with interactive web and social media, will reach large and diverse audiences. The intended impacts on audiences include increased knowledge and understanding of the scientific process by learning what food scientists do, what techniques they use, and how scientists arrive at their conclusions; the development of critical thinking skills audiences can use when evaluating messages about food and nutrition in media and advertising and when making decisions about what food to buy and eat; and becoming active learners and consumers regarding food. Evaluation results will be widely disseminated to science media producers and the informal science community via professional publications and presentations at conferences. The ultimate value of the In Defense of Food documentary and learning initiative will be to enhance public understanding of the crucial importance of science in people's everyday lives and in shaping dozens of daily decisions.
This pathways project will design, develop and test Do-It-Yourself, (DIY), hands-on workshops to introduce and teach middle school females in underserved Latino communities computing and design by customizing and repurposing e-waste media technology, such as old cell phones or appliances -- items found in the students homes or neighborhoods. The major outcome of the project will be the creation of a workshop kit that covers the processes of DIY electronics learning taking place in the workshops for distribution of the curriculum to after school programs and other informal science venues. The PIs have implemented three pilot projects over the last three years that demonstrate the ability of hands-on DIY electronics curricula to motivate and encourage students and to enable them to acquire a deeper understanding of core engineering, mathematics and science concepts. This project would extend the approach to underserved Latino youth, particular girls of middle school age. This audience was identified because of the historically low rate of participation in STEM fields by people in this group and the particular challenges that females have in acquiring knowledge in technical STEM areas. The proposal suggests that the approach of using hands-on workshops that rely on low technical requirements -- essentially obsolete or discarded electronic equipment, primarily from homes of participants -- will encourage the target audience to experiment with items they are familiar with and that are culturally relevant. The hypothesis of the project is that this approach will lower barriers to experimenting with "circuit bending" - the hand-modifying of battery-powered children's toys to build custom electronic instruments and lead to greater participation and success of females in the target group. The project will provide free workshops in two neighborhood locations and be supported by undergraduate student mentors and volunteers and staff of two community groups that are part of the project, Machine Project and Girls, Inc. Participants will demonstrate the finished projects to the workshop group, mentors and parents. Each participant will receive a copy of the workshop handbook in both English and Spanish to take home so that parents, members of the community and caregivers can supervise and participate in future projects.
DATE:
-
TEAM MEMBERS:
Garnet HertzGillian HayesRebecca Black
Math off the Shelf (MotS) was designed to help those who work in public libraries put math into what they do with grades K-6 children and their families. Public libraries exist in virtually every community in the nation, and increasingly, families rely on them as a free, safe place for children to spend time in the absence of other care. As such, they are an ideal venue for reaching a large and diverse population with math. MotS has: (1) developed research-based English/Spanish materials for informal educators working in public libraries, available for free online (2) supported implementation and institutionalization at libraries across the nation (3) engaged informal educators working in libraries in conducting outreach via state and national library association meetings, webinars, and community and youth agencies (4) conducted evaluation on project impact, as described in the summative evaluation report attached. Dissemination to professional communities will constitute the remaining project work. External evaluation, conducted by Char Associates, identified dramatic changes in attitudes about math and its role in the library, in the amount of math that librarians offer to children and families, and in librarians' communication about math with patrons and peers. Development partners include the library systems of Queens NY, San Jose CA, St Louis MO, Westchester County NY, and dozens of libraries in AZ, CT, FL, and MA.
Poster presented at the 2014 AISL PI Meeting in Washington, DC. It describes a project that is designed to engage Hispanic students in grades K-5 in STEM in afterschool programs within community-based organizations (CBOs).
DATE:
TEAM MEMBERS:
Patricial and Phillip Frost Museum of ScienceCheryl Juarez