Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. In the fall of 2014, Techbridge Girls began offering after-school programming at five elementary and two middle schools in the Highline Public School district, located near Seattle, WA.
Education Development Center is conducting the formative and summative evaluation of the
The 5-year longitudinal study on Iridescent's Family Science Learning model was conducted with 2,173 participants from 9 schools and museum sites in Los Angeles and New York City. Participants were underserved elementary school students and their parents. Families met once a week for 5 weeks in a row. Five families (~20 participants) came for all 5 years.
Each program implementation was coordinated by Iridescent team members. The goal of this study was to:
* To identify scalable methods of engaging underserved audiences in STEM.
* To identify sustainable methods of supporting long-term
The State University of New York (SUNY) and the New York Academy of Sciences (NYAS) are collaborating to implement the SUNY/NYAS STEM Mentoring Program, a full scale development project designed to improve the science and math literacy of middle school youth. Building upon lessons learned through the implementation of national initiatives such as NSF's Graduate STEM Fellows in K-12 Education (GK-12) Program, university initiatives such as the UTeach model, and locally-run programs, this project's goals are to: 1) increase access to high quality, hands-on STEM programs in informal environments, 2) improve teaching and outreach skills of scientists in training (graduate and postdoctoral fellows), and 3) test hypotheses around scalable program elements. Together, SUNY and NYAS propose to carry out a comprehensive, systemic science education initiative to recruit graduate students and postdoctoral fellows studying science, technology, engineering, and mathematics (STEM) disciplines at colleges and universities statewide to serve as mentors in afterschool programs. SUNY campuses will partner with a community-based organization (CBO) to place mentors in afterschool programs serving middle school students in high-need, low-resource urban and rural communities. Project deliverables include a three-credit online graduate course for mentor training, six pilot sites, a best practices guide, and a model for national dissemination. The online course will prepare graduate and postdoctoral fellows to spend 12-15 weeks in afterschool programs, introducing students to life science, earth science, mathematics and engineering using curriculum modules that are aligned with the New York State standards. The project design includes three pre-selected sites (College of Nanoscale Science & Engineering at the University of Albany, SUNY Institute of Technology, and SUNY Downstate Medical Center) and three future sites to be selected through a competitive process, each of which will be paired with a CBO to create a locally designed STEM mentoring program. As a result, a minimum of 192 mentors will provide informal STEM education to 2,880 middle school students throughout New York State. The comprehensive, mixed-methods evaluation will address the following questions: 1) Does student participation in an afterschool model of informal education lead to an increase in STEM content knowledge, attitudes, self-efficacy, and interest in pursuing further STEM education and career pathways? 2) Do young scientists who participate in the program develop effective teaching and mentoring skills, and develop interest in teaching or mentoring career options that result in STEM retention? 3) What are the attributes of an effective STEM afterschool program and the elements of local adaptation and innovation that are necessary to achieve a successful scale-up to geographically diverse locations? 4) What is the role of the afterschool model in delivering informal STEM education? This innovative model includes a commitment to scale across the 64 SUNY campuses and 122 Councils of the Girl Scouts of the USA, use an online platform to deliver training, and place scientists-in-training in informal learning environments. It is hypothesized that as a result of greater access to STEM education in an informal setting, participating middle school youth will develop increased levels of STEM content knowledge, self-efficacy, confidence in STEM learning, and interest in STEM careers. Scientist mentors will: 1) gain an understanding of the context and characteristics of informal science education, 2) develop skills in mentoring and interpersonal communication, 3) learn and apply best practices of inquiry instruction, and 4) potentially develop interest in teaching as a viable career option. It is anticipated that the project will add to the research literature in several areas such as the effectiveness of incentives for graduate students; the design of mentor support systems; and the structure of pilot site programs in local communities. Findings and materials from this project will be disseminated through presentations at local, regional, and national conferences, publications in peer-reviewed journals focused on informal science education, and briefings sent to more than 25,000 NYAS members around the world.
During middle school, many young people disengage from and consequently do not achieve in school-based STEM subjects. This phenomenon is more pronounced among young people in low-income communities than elsewhere. Many summer, out-of-school STEM programs are designed to offer young people opportunities to engage in hands-on, inquiry-based learning that promote interest and engagement in STEM. Research on the effect of these types of programs is limited, however. This research project seeks to fill this gap by identifying and studying practices that promote interest and engagement in STEM-related topics. The central goal of the summer STEM Interest and Engagement Study is to identify instructional practices associated with cultivating and sustaining young people's interest and engagement in out-of-school STEM summer learning programs for middle school youth. The project is based on a model of change developed from existing theory and empirical research on the cultivation of youths' interest and engagement in STEM. The project is a descriptive study that will apply multiple data collection and analytic methods, including the Experience Sampling Method (ESM), to determine instructional practices and the resulting interest, engagement, and perceptions of youth as they participate in STEM activities. In addition, survey data provided by program participants will allow the researchers to account for individual differences in preexisting interest and background factors, such as gender and ethnicity, and to measure changes in dispositions toward STEM. By better understanding these connections, practitioners can better understand how the design of their programs may influence the outcome of the participants' experience, including their education and career decisions.
DATE:
-
TEAM MEMBERS:
Deborah MoroneyNeil NaftzgerLee ShumowJennifer Schmidt
The Cyberlearning and Future Learning Technologies Program funds efforts that will help in envisioning the next generation of learning technologies and advancing what we know about how people learn in technology-rich environments. Development and Implementation (DIP) Projects build on proof-of-concept work that showed the possibilities of the proposed new type of learning technology, and project teams build and refine a minimally-viable example of their proposed innovation that allows them to understand how such technology should be designed and used in the future and answer questions about how people learn with technology. Although for years researchers have believed technology could afford anytime-anywhere learning, we still don't understand how learners behave differently across contexts, such as home, school, and in the community, and how to get youth to identify as learners across those contexts. This proposal aims to use mobile devices and strategically placed shared kiosks to 'scientize' youth in two low-income communities. Through strategic partnerships with community organizations, educators, and families, the innovation is to get primary and middle-school students engaging in scientific inquiry in the context of their neighborhoods. Research will help determine how the technology can best be deployed, but also answer important questions about how communities can provide support to help kids think like scientists and identify with science. This project will design and implement ubiquitous technology tools that include mobile social media and tangible, community displays (collectively called ScienceKit) that are deeply embedded into two urban neighborhoods, and demonstrate how such ubiquitous technologies and related cyberlearning strategies are vital to improve information flow and coordination across a neighborhood ecosystem, in order to create environments where children can connect their science learning across contexts and time (e.g. scientizing). A program called ScienceEverywhere comprised of partnerships between tightly connected neighborhood organizations with mentors, teachers, parents, and researchers will help learners develop scientifically literate practices both in and out of school, and will demonstrate students' learning to their communities. Research will consist of mixed methods studies of use of the tools, including iterative design-based research, ethnography, and the use of participant observers from the community; these will be triangulated with usage logs of the technologies and content analysis of microblogs by the learners on their identities and interests. Discourse analysis of interviews with focal learners will orient the qualitative work on identity development, and analysis using activity theory will inform the influences of the social practices and sociotechnical systems on learner trajectories. Formative evaluation will help shed light on if and how the sociotechnical system promotes STEM literacy and STEM identity development.
Many communities across the country are developing "maker spaces," environments that combine physical fabrication equipment, social communities of people working together, and educational activities for learning how to design and create objects. Increasingly, maker spaces and maker technologies are being designed to provide extended learning opportunities for school-aged young people. Unfortunately, few youth from under-represented populations have had the opportunity to participate in these maker spaces, and many communities do not have the resources to establish facilities dedicated to making activities. This project, a collaboration of faculty at California State University, San Marcos and San Diego County Office of Education, the Vista Unified School District, and the San Diego Fab Lab, is a feasibility study that will work to address these needs by implementing and evaluating a pilot Mobile Making program in an underserved youth population. It will bring Making to four after-school programs in underserved communities in San Diego by using a van to take both equipment and undergraduate student mentors to program sites. At these sites, between 50% and 90% of the students are Hispanic or Latino and between 40% and 90% are eligible for free or reduced price lunch. The project employs a research-based approach to the design and implementation of the Mobile Making program, coupled with an evidenced-based plan for developing a model for future dissemination. Project objectives are: increasing the participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life; identifying and overcoming challenges associated with a Mobile Making program; developing a model for implementing and assessing Mobile Making in underserved communities; and disseminating materials and guides for practitioners. Development will be guided by five research-based principles for design of out-of-school time programs in underserved communities: access to resources; ethnically diverse near-peer leaders; authentic activities; legitimacy within the community; and ongoing input from participants. To inform program development and implementation, including continuous monitoring and adjustment throughout the two-year initiative, the evaluation component will use a mixed methods approach to study outcomes with respect to the students, their parents and the undergraduate mentors. Future work will apply the lessons learned in the project to guide implementations and study the model's applicability in other informal education settings. The dissemination plan will include publication of project findings, activities, practitioner's guides, and the model for implementing making programs in underserved communities.
Our goal is to demonstrate an educational model fully commensurate with the demands of the 21st Century workforce, and more specifically, with the emerging “green-tech” economy. We recognize a pressing need creating more sustainable solutions for the (human) built-environment and of stabilizing economic patterns that uphold sustainable systems. to prepare citizens for the challenges of The ASCEND model is designed to encourage these societal shifts, but at the same time, it is an attempt to put theory into practice - activating educational practices aligned with research on human development and cognition. For some time now strong recommendations for apprenticeship learning have emphasized the function of legitimate peripheral participation – the possibility of which becomes more prevalent in robust communities of practice. As compared to top-down approaches (typical of formal education settings) these "learning communities" are seen as being more closely aligned with our natural propensities for learning and cognition. ASCEND represents a design-experiment -an attempt to learn how we can create and sustain opportunities for apprenticeship learning in an interdisciplinary arena at the leading edge of technical innovation. In addition, the ASCEND model introduces and examines the efficacy of “digital storytelling” as an alternative to more traditional forms of apprenticeship learning and as a means to engage and advance this and future generations in STEM. A further goal is to develop innovative measures of assessment commensurate with this new model of apprenticeship learning. Finally ASCEND explore how informal learning organizations (museums, libraries, preserves etc.) can use digital storytelling to develop community-driven programs inclusive of at-risk youth and other hard to reach audiences.
This Pathways project from the Ocean Discovery Institute (ODI) seeks to develop and pilot a program model designed to fill an identified gap in citizen science research and practice literature: how to effectively engage and better understand how to foster participation among people from under-represented groups in citizen science research. The ODI model is designed around six principles: (1) leaders who are reflective of the community, (2) science that is locally relevant, (3) guided, as opposed to self-guided, experiences, (4) direct interactions with scientists, (5) progressively increasing responsibilities for participants who express interest, and (6) removing barriers to participation, such as transportation, language, family involvement and access to technology. The project addresses environmentally degraded, crime-ridden local canyons, a locally relevant STEM-related issue, and leverages the Southern California Coastal Water Research Project's (SCCWRP) regional citizen science effort focused on identifying the sources and pathways of trash through regional watersheds. The scientific research components of the project focus on four canyons in the area, employing sampling methods developed by SCCWRP. Youth who are part of other ODI programs and who have demonstrated leadership and interest in science, work with the project team to scaffold family and youth participation in project activities taking place during afterschool and weekend time. Based on continued participation in the project, community participants can become more involved in the project, starting as "new scientists" and moving through "returning scientists" to "expert scientists" roles. The project evaluation seeks to identify the role and importance of the components of the proposed model with respect to participation, retention, and learning by participants from groups under-represented in STEM. The dissemination products of this Pathways project include a white paper describing the model and lessons learned as well as presentations to community groups and education and citizen science practitioners. Based on insights from the iterative approach to the model during this Pathways study, a subsequent full-scale development project would seek to engage citizen science projects around the nation in adapting the model to increase participation of individuals from groups underrepresented in STEM, including building out ODI's citizen science programming.
DATE:
-
TEAM MEMBERS:
Lindsay GoodwinRoxanne RuzicTheresa Sinicrope Talley
This full-scale project addresses the need for more youth, especially girls, to pursue an interest in engineering and eventually fill a critical workforce need. The project leverages museum-based exhibits, girls' activity groups, and social media to enhance participants' engineering-related interests and identities. The project includes the following bilingual deliverables: (1) Creative Solutions programming will engage girls in group oriented engineering activities at partner community-based organizations, where the activities highlight altruistic, personally relevant, and social aspects of engineering. Existing community groups will use the activities in their regular meeting structure. Visits to the museum exhibits, titled Design Your World will reinforce messages; (2) Design Your World Exhibits will serve as a community hub at two ISE institutions (Oregon Museum of Science and Industry and the Hatfield Marine Science Center). They will leverage existing NSF-funded Engineer It! (DRL-9803989) exhibits redesigned to attract, engage, and mobilize a more diverse population by showcasing altruistic, personally relevant, and social aspects of engineering; (3) Digital engagement through targeted use of social media will complement program and exhibit content and be an online portal for groups engaged in the project; (4) A community action group (CAG) will provide professional development opportunities to stakeholders interested in girls' STEM identity (e.g. parents, STEM-based business professionals) to promote effective engineering messaging throughout the community and engage them in supporting project participants; and (5) Longitudinal research will explore how girls construct and negotiate engineering-related identities through discourse across the project activities and over time.
The Chicago Zoological Society (CZS) in collaboration with Eden Place Nature Center, the Fuller Park Community Corporation, and the University of Illinois at Chicago (UIC) will implement the SCIENCES Program, Supporting a Community's Informal Education Needs: Confidence and Empowerment in STEM. The primary goals of this Full Scale Development project are to broaden access to and participation in environmental science, strengthen partnerships between CZS, Eden Place, and UIC, and gain insights into the 'ecosystemic' learning model which promotes scientific literacy and agency in the community. The project targets a low-resource community with a minority audience while the secondary audience is informal science learning organizations and researchers who will advance research in informal learning. The theoretical framework for the project design draws on conservation psychology, informal science learning, civic ecology education, and urban science education to create an ecosystematic, geographically centered approach. The deliverables include research, curriculum, and engaging hands-on programs for youth, families, adults, and teachers, reaching both in-school and out-of-school audiences, in addition to the SCIENCES Implementation Network. Three potential curriculum themes to be explored are water conservation and protection, pollinators for healthy ecosystems, and community resilience to climate change. The SCIENCES project offers a comprehensive suite of engaging programs for community audiences. For example, the year-long Zoo Adventure Passport (ZAP) program for families includes hands-on experiments and field trips, while project-based learning experiences enable teens to create wetlands, design interpretive signage, and develop associated public programming. School-based programs include professional development for teachers on the Great Lakes ecosystem and invasive species. Existing programs that have been previously evaluated and demonstrated to show learning impacts will be adapted and modified to meet the goals of the ecosystemic learning model by providing multiple learning opportunities. New learning resources will also be created to support the content themes and provide continuity. The result will be a comprehensive approach that ensures deep community engagement by individuals, families, and organizations, with cohesiveness provided by the overarching content themes which broaden access to STEM learning resources and leverages partnerships. The project includes both a research and evaluation plan. The primary research question to be addressed is: How does a large informal science learning institution work with a community-based organization to support environmental scientific literacy and agency at all levels of the community? A sociocultural framework will be used for this mixed-methods case study research. Study participants include community leaders, youth, parents, teachers, and staff from Eden Place. The case study sample will include 20 focal individuals drawn from the participant groups and approximately 300 survey participants. Case study data will be triangulated with evaluation data and analyzed using a grounded theory approach. By examining changes from the baseline following the implementation of the community programs, the findings may provide insight on agency and science literacy among community members. The comprehensive, mixed-methods evaluation plan employs a quasi-experimental design and incorporates front-end, formative, and summative evaluation components. The evaluation questions address the quality of the processes and products, access to environmental science learning opportunities, environmental science literacy, sustainability, and barriers to implementation. An extensive dissemination plan is proposed with a dual emphasis on meeting stakeholders' needs at multiple levels. The evaluation and research teams will emphasize publication in peer reviewed journals and presentations at conferences for informal science education professionals. Findings will be shared with the Fuller Park community stakeholders using creative methods such as one-page research briefs written in layperson's language, videos, and recorded interviews with participants. The local project Advisory Board will also be actively involved in the dissemination of findings to community constituents. The SCIENCES National Amplification Network will be created and work collaboratively with the American Association of Zoos and Aquariums and the Metropolitan Green Spaces Alliance to disseminate the model. Collectively, the activities and deliverables outlined in this proposal will advance the discovery of sustainable models of community-based learning while the research will advance the understanding of informal learning support for science literacy and agency.
This broader implementation project will create a professional network of individuals and institutions increasing their capacity to develop, implement, and evaluate the impact of large scale community science festivals. The project builds on a previous award that supported the implementation of science festivals in Cambridge, MA; San Francisco, San Diego, and Philadelphia. Each festival reached 50-70,000 attendees, many of them families from low-income, ethnic communities. Festival organizers and participants include science center practitioners, Science, Technology, Engineering and Mathematics (STEM) researchers, STEM related businesses, public television STEM producers, universities, K-12 schools, and government and foundation stakeholders. The summative evaluation indicated significant impacts on participant's STEM interest, learning, and connections to STEM resources in their community. The number of science festivals across the country is increasing. Consequently this new project will create a professional network with numerous benefits to professionals in the Informal Science Education (ISE) field and other stakeholders including: timely access to information, knowledge and experience related to science festivals; rich relationships to draw on when facing challenges; credibility of the festival concept; ability to partner with multiple festivals and magnify the reach of existing ISE institutions and program; diffusion of knowledge and innovation; and collective intelligence and inclusive consultation. It is expected that the network will involve supporting approximately 50 science festivals during the grant period. A business plan will be developed for long term sustainability of the network and the subsequent growth of science festivals. This is a collaborative proposal with 4 project partners who have distinct roles in creating and sustaining the network: MIT, University of California at San Francisco, University of North Carolina/Morehead Planetarium and Science Center, and The Franklin Institute. MIT's project deliverables include hosting the central management and administrative functions of the network and providing conferences, workshops, individual mentoring of new science festival champions, maintaining the network website, etc. UCSF will develop tools, resources, and linkages to increase participation of scientists in festivals. UNC/Morehead Planetarium and Science Center will provide expertise in statewide festival organizing. The Franklin Institute will help network participants build capacity for engaging low-income families with programming examples, community asset analysis tools, and webinars. This multi-hub approach is a new innovative strategy for creating and sustaining the first ever professional network for science festival organizers. The project evaluation will focus on the network\'s vibrancy, connectivity and effect. Network vibrancy impact data will be collected on how members share goals, enhance leadership, and expand geographic and model diversity. Network connectivity evaluation will study the strength and growth of the relationships within the SFA network. Network effects will study the ways the Science Festival Alliance (SFA) network is achieving science festival organizational capacity looking at increases in the number of science festivals, geographic spread, science festival innovations, and the presence of a SFA sustainability plan. This project will add new knowledge about the impact of networks on the development and impact of science festivals throughout the country.
Most students who pursue math have chosen to do so by high school. Elementary and middle school experiences are thus vitally important in attracting students to STEM. Research consistently points to after-school as a golden opportunity to increase students' exposure to high-quality math learning opportunities and to develop the key influencers of math participation and persistence: interest and identity. However, more research on how and under what conditions after-school programs can foster these factors is needed. The role of identity in math education has been particularly neglected. The proposed research project addresses this gap by studying the implementation and outcomes of After-School Math PLUS (ASM+), an after-school math program designed to address all aspects of math identity and thus have a positive effect on this key influencer of math participation and achievement. "Improving Math Identity" is a Research-in-Service to Practice project funded by the Advancing Informal STEM Learning (AISL) Program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. The team will study the impact of ASM+ through a rigorous randomized controlled trial of 30 elementary-level after-school sites in South Carolina serving predominately low-income and minority students (15 treatment using ASM+; 15 control using Mixing in Math). Sites selected into the study must serve fourth and fifth graders and must operate five days a week. Through an implementation study, data will be collected in order to assess the program and understand the experiences of group leaders and students in the ASM+ program and at comparison sites. Data sources include surveys, interviews, observations, and administrative data collected from the treatment and control sites. The study will investigate how and to what extent ASM+ develops fourth and fifth grade students' math identity and increases math engagement and interest. It will explore whether increasing identity, engagement, and interest leads to greater skill development and academic achievement. This research is being conducted by IMPAQ International LLC, a social science and public policy research and evaluation firm in collaboration with Educational Equity at FHI 360, a global development and education organization. The research addresses the need to enhance students' math identity at an early age and, as a result, change students' educational and career aspirations. The ultimate goal is to broaden participation in STEM by underrepresented groups. Results will inform the development of interventions designed to motivate and retain students in STEM, particularly in informal settings. Knowledge gained from this research will be broadly disseminated to practitioners, researchers, program developers, and policy makers.
DATE:
-
TEAM MEMBERS:
Cheri FancsaliMerle FroschlBarbara Sprung