Skip to main content

Community Repository Search Results

resource evaluation Public Programs
This white paper examined the process of evaluating a new Growth Mindset youth program developed for youth in Grades 3-5 in the Northwest suburb communities in Dundee Township, IL.
DATE:
TEAM MEMBERS: Luci Hanstedt Drew Glassford Mike LoPresti Mallory Namoff Robert Tai
resource project Informal/Formal Connections
Mentoring is a widely accepted strategy for helping youth see how their interests and abilities fit with education and career pathways; however, more research is needed to better understand how different approaches to mentoring impact youth participants. Near-peer mentoring can be a particularly impactful approach, particularly when youth can identify with their mentors. This project investigates three approaches to near-peer mentoring of high-school-aged Hispanic youth by Hispanic undergraduate mathematics majors. Mentoring approaches include undergraduates' visits to high school classrooms, mathematics social media, and a summer math research camp. These three components of the intervention are aimed at facilitating enjoyment of advanced mathematics through dynamic, experiential learning and helping high school aged youth to align themselves with other doers of mathematics on the academic stage just beyond them, i.e., college.

Using a Design-Based Research approach that involves mixed methods, the research investigates how the three different near-peer mentoring approaches impact youth participants' attitudes and interests related to studying mathematics and pursuing a career in mathematics, the youth's sense of whether they themselves are doers of mathematics, and the youth's academic progress in mathematics. The project design and research study focus on the development of mathematical identity, where a mathematics identity encompasses a person's self-understanding of himself or herself in the context of doing mathematics, and is grounded in Anderson (2007)'s four faces of identity: Engage, Imagine, Achieve, and Nature. The study findings have the potential to uncover associations between informal interactions involving the near-peer groups of high school aged youth and undergraduates seen to impact attitudes, achievement, course selection choices, and identities relative to mathematics. It also responds to an important gap in current understandings regarding effective communication of mathematics through social media outlets, and results will describe the value of in-person mathematical interactions as well as online interactions through social media. The study will result in a model for using informal near-peer mentoring and social media applications for attracting young people to study and pursue careers in STEM. This project will also result in a body of scripted MathShow presentations and materials and Math Social Media content that will be publicly available to audiences internationally via YouTube and Instagram.

This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Aaron Wilson Sergey Grigorian Xiaohui Wang Mayra Ortiz
resource project Media and Technology
This award takes an innovative approach to an ongoing, pervasive, and persistent societal issue: women are still drastically underrepresented in computing careers. This project targets middle school-aged girls because it is a time when many of them lose interest and confidence in pursuing technical education and computing careers. This project will design, develop, and deploy a one-week experience focused on middle school girls that targets this issue with a novel combination of teaching techniques and technology. The project will use wearable computing devices to support girls' social interactions as they learn computing and solve technical challenges together. The goals of the project are to raise interest, perceived competence, and involvement in the computational ability of girls. Additionally, the project aims to increase a sense of computational community for girls that makes pursuing computational skills more relevant to their identities and lives, and that helps continued participation in computing. The project will deploy a one-week experience four times per year with a socioeconomically diverse range of campers. The project will also develop a 'program in a box' kit that can be broadly used by others wishing to deliver a similar experience for girls.

The planned research will determine if a one-week experience that uses social wearable construction in the context of live-action role play can use the mediating process of computational community formation to positively impact middle school girls' engagement with and interest in computation. Computational community is defined as girls engaging together in the process of learning computation, trading resources and knowledge, and supporting growth. Research participants will include 100 6th to 9th-grade girls. At least 75% of the participants will be either low income, first-generation college-bound, or underrepresented in higher education. Students will be recruited through the longstanding partnerships with title one schools in the Salinas Valley, the Educational Partnership Center, and in the Pajaro Valley Unified School district, where 82% of the students are Hispanic/Latinx, 42% are English Learners, and 73% are eligible for free or reduced lunch. The research questions are: 1) Does the proposed experience increase girls' self-reported competence, self-efficacy, and interest in computational skills and careers? and 2) Will the proposed experience lead to activity-based evidence of learning and integration of computational skills at the group social level? The project will use a mixed-methods, design-based research approach which is an iterative design process to rapidly collect and analyze data, and regularly discuss the implications for practice with the design team. Data will be collected using observations, interviews, focus groups, surveys, and staff logs. Quantitative data will be analyzed using frequencies, means, and measures of dispersion will be applied to survey data from both time points. Pearson correlation coefficients will be used to describe the bivariate relationship between continuous factors. ANOVAs will assess whether there are significant differences in continuous measures across groups. Qualitative data will be analyzed using a constant comparison method.

This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Katherine Isbister
resource evaluation Media and Technology
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
DATE:
resource evaluation Public Programs
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
DATE:
resource project Public Programs
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This exploratory Pilot study project brings together a diverse set of partners that include the Watertown Children's Theatre (WCT) which is west of Boston, and, from Boston College a team of science educators, learning science researchers, and positive youth development experts. The goal is to design and develop a project for middle school-aged youth. The pilot project, which integrates hands-on science learning experiences, experiments, and field trips with the student-led production of short plays, will engage youth in expressing their beliefs, passions, and their own identities about STEM by examining how the intersection of skills and practices used in both domains (science and theatre) can enable them to learn about science concepts, principles and methods as well as to develop science-focused identities. Middle-school youth will be engaged in a three-week summer program where they will be led by science teachers, playwrights, and high school students to conduct hands-on investigations in science in conjunction with developing original, ten-minute plays around a specific scientific theme relevant to their life experience, for example, the potential impact on their lives of heavy metals in water and poor air quality. After a science theme is chosen, the principal investigators will identify the big ideas that are important for youth to understand and be able to explain. Upon identification of the key science ideas, youth will then engage in pertinent science activities, visits to local sites, reading current news articles and then in identifying the local impacts and how the underlying science relates to those local impacts. The youth will perform their ten-minute plays at the end of the summer program. Following this showcase event, they will engage in additional science learning experiences and also revise their productions throughout the academic year in preparation for a youth science festival, where their creations will be performed by professional adult actors as a part of the Cambridge Science Festival taking place in the spring. The broader impact of the work focuses on broadening participation in STEM, specifically, the engagement of youth from under-represented populations in the sciences, such as African-Americans, Latinxs, and women with partner Boston Public Schools. The Pilot study will investigate the student learning and organizational dimensions of the model being developed.

The Boston College researchers will study youth's sense of purpose and identity toward science, particularly how youth's identity discrepancy changes through participation in the project. The work places youth voice at the center of the creation of STEM-based theatre plays. The theoretical foundation of the work is grounded in part in the concept of "path to purpose." The major research questions are: How do youth perceptions (interest, science anxiety, identity) toward science shift as they participate in the project? What is the residual impact on parents (family members) and youth on their discussions about science, and how does participation in the project impact those discussions? Research methods include surveys, interviews and observations. The external evaluation study will focus on understanding project implementation and progress toward meeting the project goals, in particular, how well the initiative works to establish a model for the informal STEM learning field that the team and others can apply beyond the Pilot study.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Meghan Hill
resource research Public Programs
The purpose of this study is to thoroughly describe a program designed to strengthen the pipeline of Latino students into post-secondary science, technology, engineering, and mathematics (STEM) education, and present evaluation data to assess multiyear effectiveness. The program includes a suite of interventions aimed at students and families, and was implemented in a low-income school cluster with a high Latino population in metro Atlanta. Our intervention includes a high school and middle school mentoring program, STEM-focused extracurricular activities (summer camps, research and community
DATE:
TEAM MEMBERS: Diley Hernandez Marion Usselman Shaheen Rana Meltem Alemdar Analia Rao
resource research Games, Simulations, and Interactives
It is a well-documented fact that women and minorities are currently underrepresented in STEM higher education degree programs and careers. As an outreach measure to these populations, we established the Hexacago Health Academy (HHA), an ongoing summer program. Structured as an informal learning environment with a strong youth initiated mentoring component, HHA uses game-based learning as both a means of health education and stimulating interest in careers in medicine among adolescents from underrepresented minority populations. In this article, we describe the 2015 session of the Hexacago
DATE:
TEAM MEMBERS: Megan Macklin Patrick Jagoda Ian B. Jones Melissa Gilliam
resource research Public Programs
The lack of equitable access to science learning for marginalized groups is now a significant concern in the science education community (Bell et al. 2009). In our commitment to addressing these concerns, we (the HERP Project staff) have spent four years exploring different ways to increase diverse student participation in our informal science programs called herpetology research experiences (HREs). We wanted the demographics of participants to mirror the racial, ethnic, cultural, linguistic, and socioeconomic demographics of the areas where our HREs are held. To achieve this, project staff
DATE:
TEAM MEMBERS: Aerin Benavides Amy Germuth Catherine Matthews Lacey Huffling Mary Ash
resource project Public Programs
General Summary

This project seeks to prepare female Hispanic students for leadership in the STEM workforce. The project seeks to determine if a blended set of STEM engagement activities including summer intensive laboratory-based experiential learning and out-of-school STEM activities, peer support, mentoring, and financial assistance can help to take target students through a traditional leaky workforce and educational pipeline resulting in matriculation to and graduation from undergraduate STEM programs. If successful, the work will increase participation and leadership of Hispanic women in the STEM workforce. To accomplish these goals, the PIs will: (1) work with partners to identify, recruit, and screen bright, energetic Hispanic females in their freshman year of high school who show promise and interest in STEM disciplines; (2) engage selected students and their families in formal and informal STEM learning both throughout the school year and during summer residential experiences to enable the students to further develop and clarify their STEM calling; (3)prepare the students to matriculate to undergraduate college; (4) provide program participants with full-tuition scholarships to ensure undergraduate education is attainable; and (5) at our institution and partner colleges, provide dedicated advisors and mentors and cohort activities to ensure undergraduate persistence and success.

Technical Summary

The PIs seek to prepare female Hispanic students for leadership in the STEM workforce. To compete in the global economy, maintain national security, and meet serious environmental challenges, more skilled graduates are needed to fill STEM jobs. An untapped source of talent exists in those populations that continue to be underrepresented in STEM fields, including women and people of color. This work will help to determine if a blended set of STEM engagement activities including summer intensive laboratory-based experiential learning and out-of-school STEM activities, peer support, mentoring, and financial assistance can help to take target students through a traditional leaky pipeline resulting in matriculation to and graduation from undergraduate STEM education. The work builds on research that shows that mentored research opportunities and peer support and interaction improves persistence in female students. It also builds on regional models of collective impact whereby a variety of corporate, nonprofit, and foundation organizations successfully join together for large-impact projects. If successful, the work will increase participation and leadership of Hispanic women in the STEM workforce.
DATE: -
TEAM MEMBERS: April Marchetti Charles English Rebecca Michelsen Rachele Dominguez Laurie Massery
resource project Public Programs
The University of Alaska Fairbanks will partner with the National Optical and Astronomy Observatory, the University of Alaska Museum of the North, and the University of Washington-Bothell to bring biomaterials, optics, photonics, and nanotechnology content, art infused experiences, and career awareness to art-interested girls. This full scale development project, Project STEAM, will explore the intersections between biology, physics, and art using advanced technologies at the nano to macro scale levels. Middle school girls from predominately underrepresented Alaskan Native, Native American (Tohono O'odham, Pascula Yaqui) and Hispanic groups, their families, teachers, and Girl Scout Troop Leaders in two site locations- Anchorage, Alaska and Tucson, Arizona will participate in the project. Centered on the theme "Colors of Nature," Project STEAM will engage girls in science activities designed to enhance STEM learning and visual-spatial skills. Using advanced technologies, approximately 240 girls enrolled in the Summer Academy over the project duration will work with women scientist mentors, teachers, and Girl Scout Troop Leaders to create artistic representations of natural objects observed at the nano and macro scale levels. Forty girls will participate in the Summer Academy in year one (20 girls per site- Alaska and Arizona). In consequent years, approximately180 girls will participate in the Academy (30 girls per site). Another 1,500 girls are expected to be reached through their Girl Scout Troop Leaders (n=15) who will be trained to deliver a modified version of the program using specialized curriculum kits. In addition, over 6,000 girls and their families are expected to attend Project STEAM Science Cafe events held at local informal science education institutions at each site during the academic year. In conjunction with the programmatic activities, a research investigation will be conducted to study the impact of the program on girls' science identity. Participant discourse, pre and post assessments, and observed engagement with the scientific and artistic ideas and tools presented will be examined and analyzed. A mixed methods approach will also be employed for the formative and summative evaluations, which will be conducted by The Goldstream Group. Ultimately, the project endeavors to increase STEM learning and interest through art, build capacity through professional development, advance the research base on girls' science identity and inspire and interest girls in STEM careers.
DATE: -
TEAM MEMBERS: Laura Conner Stephen Pompea Mareca Guthrie Carrie Tzou
resource research Public Programs
Deals with the success of the Rural Girls in Science Program at the University of Washington in Seattle, Washington State, which uses science to address local issues through long-term research projects. Source of funding for the program; Components of the research projects; Factors which contributed to the success of the program.
DATE:
TEAM MEMBERS: Angela Ginorio Janice Fournier Katie Frevert