In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
Improving retention rates in postsecondary engineering degree programs is the single most effective approach for addressing the national shortage of skilled engineers. Both mathematics course placement and performance are strong graduation predictors in engineering, even after controlling for demographic characteristics. Underrepresented students (e.g., rural students, low-income students, first-generation students, and students of color) are disproportionately represented in cohorts that enter engineering programs not yet calculus-ready. Frequently, the time and cost of obtaining an engineering degree is increased, and the likelihood of obtaining the degree is also reduced. This educational problem is particularly acute for African American students who attended select high schools in South Carolina, with extremely high-poverty rates. As a result, the investigators proposed an NSF INCLUDES Launch Pilot project to develop a statewide consortium in South Carolina - comprising all of the public four-year institutions with ABET-approved engineering degree programs, all of the technical colleges, and 118 high schools with 70% or higher poverty rates, to pinpoint and address the barriers that prevent these students from being calculus ready in engineering.
This NSF INCLUDES Launch Pilot project will map completion/attrition pathways of students by collecting robust cross-sectional data to identify and understand the complex linkages between and behind critical decisions. Such data have not been available to this extent, especially focused on diverse populations. Further, by developing structural equation models (SEMs), the investigators will be able to build on extant research, contributing directly to understanding the relative impact of a range of latent variables on the development of engineering identity, particularly among African American, rural, low-income, and first-generation engineering students. Results of the pilot interventions are likely to contribute to the empirical and theoretical literature that focus on engineering persistence among underrepresented populations. Project plans also include developing a centralized database compatible to the Multiple Institution Database for Investigation of Engineering Longitudinal Development (MIDFIELD) project to share institutional data with K-12 and postsecondary administrators, engineering educators, and education researchers with NSF INCLUDES projects and beyond.
DATE:
-
TEAM MEMBERS:
Anand GramopadhyeDerek BrownEliza GallagherKristin Frady
Community colleges play a vital role in educating undergraduate students. These higher education institutions educate nearly half of the nation's undergraduate students, particularly among low-income and first-generation students and students of color. Because of the rich diversity that currently exists at these institutional-types, there are immense opportunities to broadening participation throughout the engineering enterprise. To this end, the investigator outlines a joint collaboration with five community colleges, three school systems, two college career academies, and a state partner in Georgia - referred as the Georgia Science, Technology, and Engineering Partnerships for Success (GA STEPS) - to provide dual enrollment classes in career pathways for Georgia high school students in grades 9-12, thereby allowing secondary students to earn college credit. The Georgia STEPS program proposes to leverage mechatronics engineering as a means for broadening engineering participation for community colleges and underserved, underrepresented populations in 48 rural counties to increase engineering awareness, skills training and college and career readiness. The project builds on an existing collaboration that has developed successful engineering opportunities at the community college level, by including a wider regional network of rural Georgia counties and high schools. Further, this project has immense potential to transform engineering education and course-taking for students at the secondary and postsecondary level in Georgia and beyond. It has potential great potential to be scaled and replicated at other placed around the United States.
The project's intellectual merit and innovation is that it leverages a successful mechatronics engineering curriculum that supports engineering skills that support local industry as well as supporting innovations in the mechatronics field. The project includes a collective impact framework, involving various stakeholders and aligning quantitative and qualitative metrics and measurable objectives. The broader impacts of this project is that it increases the engineering knowledge and skills of underserved, underrepresented students that are enrolled in community colleges. Also, the impact to rural communities in Georgia support the fact that this project would meet broader groups that can be positively impacted by this type of collaborative. The ability to provide different parts of this engineering discipline across broad audiences in community colleges - that support underrepresented groups understanding of mechatronics engineering - is broadly useful to the field of engineering.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).
How do afterschool programs view their local public libraries? Are they working with them, and in what ways? These are the questions that the Afterschool Alliance, along with its partners at the Space Science Institute’s National Center for Interactive Learning (NCIL) and the American Library Association, wanted to answer. Overall, our goal is to build bridges between the afterschool and library fields, so that both can share knowledge and resources to better serve our youth. While our work together has primarily focused on science, technology, engineering, and math (STEM) education through
Environmental education is about creating healthier communities for all—with ecological integrity, shared prosperity, and social equity as our long-term goals. Environmental educators have been working in, with, and for communities for decades. As communities have evolved, so has the field of environmental education. In creating the Community Engagement: Guidelines for Excellence, NAAEE brings the field’s professional standards to environmental educators’ dynamic work in today’s communities.
Why are these guidelines important? Environmental educators everywhere work in a constantly shifting
DATE:
TEAM MEMBERS:
North American Association for Environmental Education (NAAEE)Michele ArchieSusan ClarkJudy Braus
Abstract: We aim to disrupt the multigenerational cycle of poverty in our rural indigenous (18% Native American and 82% Hispanic) community by training our successful college students to serve as role models in our schools. Poverty has led to low educational aspirations and expectations that plague our entire community. As such, its disruption requires a collective effort from our entire community. Our Collective unites two local public colleges, 3 school systems, 2 libraries, 1 museum, 1 national laboratory and four local organizations devoted to youth development. Together we will focus on raising aspirations and expectations in STEM (Science, Technology, Engineering and Mathematics) topics, for STEM deficiencies among 9th graders place them at risk of dropping out while STEM deficiencies among 11th and 12th graders preclude them from pursuing STEM majors in college and therefore from pursuing well paid STEM careers. We will accomplish this by training, placing, supporting, and assessing the impact of, an indigenous STEM mentor corps of successful undergraduate role models. By changing STEM aspirations and expectations while heightening their own sense of self-efficacy, we expect this corps to replenish itself and so permanently increase the flow of the state's indigenous populations into STEM majors and careers in line with NSF's mission to promote the progress of science while advancing the national health, prosperity and welfare.
Our broader goal is to focus the talents and energies of a diverse collective of community stakeholders on the empowerment of its local college population to address and solve a STEM disparity that bears directly on the community's well-being in a fashion that is generalizable to other marginalized communities. The scope of our project is defined by six tightly coupled new programs: three bringing indigenous STEM mentors to students, one training mentors, one training mentees to value and grow their network of mentors, and one training teachers to partner with us in STEM. The intellectual merit of our project lies not only in its assertion that authentic STEM mentors will exert an outsize influence in their communities while increasing their own sense of self-efficacy, but in the creation and careful application of instruments that assess the factors that determine teens' attitudes, career interests, and behaviors toward a STEM future; and mentors' sense of self development and progress through STEM programs. More precisely, evaluation of the programs has the potential to clarify two important questions about the role of college-age mentors in schools: (1) To what degree is the protege's academic performance and perceived scholastic competence mediated by the mentor's impact on (a) the quality of the protege's parental relationship and (b) the social capital of the allied classroom teacher; (2) To what degree does the quality of the student mentor's relationships with faculty and peers mediate the impact of her serving as mentor on her self-efficacy, academic performance, and leadership skills?
While the term 'failure' brings to mind negative associations, there is a current focus on failure as a driver of innovation and development in many professional fields. It is also emerging from prior research that for STEM professionals and educators, failure plays an important role in designing and making to increase learning, persistence and other noncognitive skills such as self-efficacy and independence. By investigating how youth and educators attend to moments of failure, how they interpret what this means, and how they respond, we will be better able to understand the dynamics of each part of the experience. The research team will be working with youth from urban, suburban and rural settings, students from Title I schools or who qualify for free/reduced-price lunches, those from racial and ethnic minority groups, as well as students who are learning English as a second language. These youth are from groups traditionally underrepresented in STEM and in making, and research indicates they are more likely to experience negative outcomes when they experience failure.
The intellectual merit of this project centers on establishing a baseline understanding of how failure in making is triggered and experienced by youth, what role educators play in the process, and what can be done to increase persistence and learning, rather than failure being an end-state. The research team will investigate these issues through the use of qualitative and quantitative research methods. In particular, the team will design and evaluate the effectiveness of interventions on increasing the abilities of youth and educators in noticing and responding to failures and increasing positive (e.g., resilience) outcomes. Research sites are selected because they will allow collection of data on youth from a wide range of backgrounds. The research team will also work to test and revise their hypothesized model of the influence of factors on persistence through failures in making. This project is a part of NSF's Maker Dear Colleague Letter (DCL) portfolio (NSF 15-086), a collaborative investment of Directorates for Computer & Information Science & Engineering (CISE), Education and Human Resources (EHR) and Engineering (ENG).
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program supports new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This project will meet this goal through rigorous research and the broad implementation of an environmental science literacy professional development and learning program for informal educators and youth engaged in outdoor science programs (OSP). With growing support from the literature and the Next Generation Science Standards (NGSS), much attention has been placed on creating and leveraging interdisciplinary science learning opportunities beyond science classrooms. As such, an estimated 300 residential OSPs currently exist in the United States. Unfortunately, the informal educators often charged with facilitating these deep and impactful science learning experiences often lack robust formal training in evidenced-based, age-appropriate environmental science content knowledge and pedagogy specific for the youth in their programs. This issue is often more pronounced in under-resourced and under-served programs and communities. This project will directly address these pervasive challenges in the field by not only providing much needed science focused professional development and resources to informal educators but also by specifically targeting and training informal leaders and educators serving youth in predominately rural areas, low-income communities, and underrepresented communities.
Approximately 200 OSP leaders at 100 OSPs around the country will participate in a week-long, intensive training in the professional development model at one of five regional residential leadership institutes. OSP leaders will then redeliver the training to the approximately 1,500 OSP educators/field instructors in their home institutions. The OSP educators/field instructors will then use what they learn through the professional development to facilitate the environmental science learning program (i.e., curriculum, field experiences, resources, pedagogy) to over 1 million youth (grades 3-8) enrolled in their residential outdoor science programs. In addition, a rigorous implementation study, efficacy study and evaluation will be conducted. The implementation study will investigate: (a) Which of the professional learning model practices were implemented and (b) What successes and challenges the programs faced implementing the model. The mixed methods efficacy study will explore: (a) if outdoor science programs contribute to the development of science learning activation and environmental literacy? and (b) what are the features of these experiences that are correlated with increases in science learning activation and environmental literacy. Approximately 25-35 youth will be randomly selected from each of 50 randomly selected sites to participate in the efficacy study. The data and findings from the research and evaluation produced by this project will contribute to a relatively sparse knowledge and research base specific to youth efficacy and implementation processes and practices across nearly 1/3 of the estimated 300 existing residential outdoor science programs in the United States.