This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
This is a project to offer the Forum on Inclusive STEMM Entrepreneurship (FISE), a novel effort to broaden the participation of underrepresented minority women in STEMM entrepreneurship and to enhance the diversity of the science and engineering workforce. Through a convening of educators, entrepreneurs, aspiring entrepreneurs, industry leaders, investors and policy experts, entrepreneurial education thought leaders, and intersectionality scholars the PI proposes to use this conference as a platform for building capacity in the preparation and development of future entrepreneurs from underrepresented groups. The PI also seeks to contribute to the emerging field of research that bridges tech entrepreneurship and education policy.
The proposed forum has the potential to advance knowledge in the field of entrepreneurship education and engineering education. Given the dearth of research-based interventions to broaden participation in tech entrepreneurship, this conference offers an opportunity for participants to contribute to the leading edge of research and interventions in this field.
The convening and associated activities will leverage the social capital of knowledgeable experts in the academy and industry, investors, entrepreneurs and aspiring entrepreneurs to address critical needs of the nation that relate to enhanced global competitiveness, an improved national economy, and the participation of underrepresented cohorts in entrepreneurship and commercialization.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will conduct research designed to deepen our fundamental knowledge about culture, experience, and ecosystems cognition and to develop innovative practices and approaches to support learning about changing ecological systems and environmental decision making. Work on cultural differences in the production of complex systems knowledge is severely lacking. This gap in knowledge may contribute to the continued reproduction of inequities in science education. More broadly findings from this project will have clear implications for theories of cognitive development, especially those pertaining to how knowledge is shaped by culture and experience. Focusing on ecosystems may represent an opportunity to not only increase engagement and achievement in science among non-dominant communities and Native youth specifically, but also advance effective learning for all communities. The primary deliverables for the project are conference presentations and research publications. However, the project will also develop additional resources freely available to researchers, educators, and the general public. These will include summer curricular materials and teaching tools, professional development workshops, practitioner briefs about research findings that can be used in professional development workshops and shared share more broadly, and evaluation reports.
A deeper understanding of cultural influences on conceptions of the natural world can serve to advance the educational needs of children, including children from diverse linguistic and cultural backgrounds. Project research will include two interrelated series of studies designed to expand knowledge about human cognition of complex ecosystems and the affordances of informal STEM learning environments in developing and supporting the critical 21st century skill of ecological systems level reasoning. The first consists of a series of experiments focused on ecological cognition and the role of humans in nature. The second consists of design-based research interventions in informal settings, summer workshops for youth and the communities, focused on ecological systems level thinking and socio-environmental decision making. The project will recruit and engage both child and adult participants from two broad cultural communities, Native Americans and European Americans living in urban and suburban communities, in part because it affords a sharp test of human-nature relations. Sampling from two different urban communities will avoid simple Native-non-Native comparative binaries and to conduct Native-to-Native comparative analysis. Based on results from this, the project will result in: 1) foundational knowledge about human learning and reasoning and ecosystems and environmental decision making, 2) culturally responsive models of learning and practice about complex ecosystems for indoors and outdoors informal learning environments, and 3) insights about research-practice-community partnerships. One important objective of the research is to broaden participation and close opportunity gaps for under-represented groups in STEM fields broadly and more specifically for Indigenous people. Members of Indigenous communities, who provide strong role models for other aspiring scholars, will be involved as postdoctoral fellows, research assistants and graduate fellows.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will embed public engagement with science (PES) into the cultures and practices of two Long-Term Ecological Research (LTER) sites: the Hubbard Brook Experimental Forest in New Hampshire and the Harvard Forest in Massachusetts. The goals are 1) to build knowledge about the mutual learning between scientists and adult stakeholders in face-to-face engagement setting and 2) to develop evidence-based practices in the content of place-based ecosystem research. This is a collaborative project of 3 universities (Michigan State University, Harvard, and CUNY) and the two LTERs. Two primary research questions guide this work. First, how willing are participating scientists to take part in PES? What are their attitudes and beliefs about whether engagement can be effective and whether they have the necessary skills? Second, how willing are participating scientists to build relationships with stakeholders using normed tactics? Both qualitative and quantitative methods will be used to collect evidence including semi-structured interviews and surveys. A general set of hypothesis include that there will be positive changes in LTER scientists willingness to participate in PES, attitudes, and efficacy beliefs.
DATE:
-
TEAM MEMBERS:
John BesleySarah GarlickPeter GroffmanPamela TemplerKathleen Lambert
The Water for Life project has been an effective, and in some cases an essential vehicle for addressing issues around water quality and retention in island settings where water security is an on-going challenge. The focus on local partnerships was a highly valued attribute of the WfL project, and the informal science and conservation education resources produced and disseminated by the project have had a significant impact on these populations
The Art of Science Learning, Phase 2 was an NSF-funded research and development project to investigate the value of incorporating arts-based learning techniques in STEM-related group innovation processes. The project team created a new, arts-infused innovation curriculum in consultation with leading national practitioners in the arts, creativity, and innovation, then deployed that curriculum in “innovation incubators” in San Diego, Chicago, and Worcester (Mass.) in partnership with informal STEM institutions in those cities. At each incubator, diverse members of the public (from high school
DATE:
TEAM MEMBERS:
Peter LinettSteve ShewfeltNicole BaltazarNnenna OkekeDreolin FleisherEric LaPlantMadeline SmithChloe Chittick PattonSarah LeeHarvey Seifter
This project will coordinate and focus existing educational elements with the common goal of increasing the participation of underrepresented minorities in STEM degree programs and the STEM workforce. This goal will help the US maintain its leadership in science and engineering innovation while supporting the expansion of the talent pool needed to fuel economic growth in technical areas. The program will feature an assessment system that addresses both social influence factors and the transfer of STEM skills with the aim of identifying the reasons that underrepresented minorities leave the STEM pipeline. By including both curricular and extracurricular elements of the STEM pipeline, ranging from middle school through college, the program will be able to respond quickly to findings from the assessment component and take proactive steps to retain STEM students and maintain their self perception as future scientists or engineers.
The program proposes to assess, unite and coordinate elements in the New Mexico STEM pipeline with the ultimate goal of increasing the participation of underrepresented groups in the STEM workforce. The need to grow a diverse science, technology, engineering and mathematics (STEM) workforce is recognized throughout the State of New Mexico, and beyond, by both the public and private sectors. The project develops a crosscutting assessment system that addresses both social influence factors and the skills component of STEM education. The project develops a collective impact framework aimed at increasing the participation of underrepresented minorities in the STEM workforce and implements a common assessment system for students in the 6-20+ STEM pipeline. This assessment system will address both social influence factors and the transfer of STEM related skills with the aim of building a research base to investigate why students from underrepresented minorities leave the STEM pipeline. The output from this research will drive the development of a set of best practices for increasing retention and a scheme for improving the integration of minority students into the STEM community. The retention model developed as part of the program will be shared with the STEM partners through a series of workshops with the goal of developing a more coordinated approach to the retention of underrepresented minorities. The program focuses on a small set of STEM programs with existing connections to the College of Engineering.
DATE:
-
TEAM MEMBERS:
Steven StochajPatricia SullivanLuis Vazquez
This project formed a partnership between a research team with experience in computer science (CS) education and learning sciences research and a newly fashioned practitioner team focused on building a grassroots, informal, volunteer group created to help women help themselves and others learn to write computer code. This research-practitioner partnership had a two-pronged focus, first on improving the program offered to learners through making adjustments based on research findings, and second on investigating the phenomenon of how women in the workforce informally learn CS skills that enable them to rewrite their career paths to contribute to what we know from research. The context of the study was situated in the virtual community that has formed around the phenomenally successful Salesforce Customer Relationship Management software platform.
This Exploratory Pathways project aimed to fill a gap in the research; we know little about the phenomenon of adult women in the workforce who are patching together resources to learn CS skills with a goal of job enhancement or job change. This project took an ethnographic approach to studying the informal learning (both through online, written resources and through sharing of knowledge with others) of the women involved in a 10-week, virtual Women’s Coaching and Learning group. The organization of this group consisted of learners—novice coders in the Apex language that is used on the Salesforce software platform, of coaches—more knowledgeable coders, and of a steering committee that ran the group and created the informal curriculum followed in the 10-week course.
Our overarching research question in this study was: In what ways are informal CS learning opportunities being used and created by adult women, what are their experiences with those opportunities, and how does this suggest ways to enhance those opportunities in the future to increase effectiveness in broadening access to and engagement in informal CS learning experiences for women?
We broke the question down into a number of sub questions, including:
Sociocultural context: What past gendered interactions do women report that discouraged (or encouraged) them from learning to code? What do interactions look like in female-only coaching and learning groups? In what ways does a coaching and learning group support persistence? What social barriers and supports outside the group affect persistence?
Personal context: What are the characteristics and backgrounds of female administrators who seek out resources to teach themselves to code? What are the motivations for these women to teach themselves to code? What motivates them to seek out and join all-women coding groups?
Physical context: How are women learning to code both through written resources and in virtual, informal coaching and learning classes? What are the conceptual barriers and supports that they encounter, and what works for women in these classes to overcome barriers? What conceptual barriers and supports affect persistence?
Persistence and identity: In what ways does participating in a learning group with female coaching motivate (or not) women to persist in learning to code? How do their goals or reasons for learning to code change through their participation? How does their identity as a “coder” change or shift as they participate?
Our findings for these subquestions are summarized in the “project products” linked to below.
Water for Life (WfL) is a full scale development youth and community based program; centered on freshwater literacy, water conservation and rainwater harvesting led by the Pacific Resources for Education Learning (PREL) in Hawaii. The goals of the project are to: (a) promote an understanding of water conservation and stewardship in areas lacking adequate quality water supplies and (b) build local capacity among rural communities to develop and employ site specific freshwater harvesting strategies proven to improve water quality. Rural communities within four Pacific Island entities in the U.S. affiliated Freely Associated States (FAS) will participate in WfL activities. PREL is collaborating with a host of organizations (such as the Federated States of Micronesia National Department of Education, Marshall Islands Conservation Society, and the Micronesian Conservation Trust, etc.) to develop and implement all phases of the initiative. This work is already improving the quality of life for hundreds of people in the FAS through water conversation education and improved water quality in local areas. Working closely with site-embedded PREL staff, Core Teams at each site - consisting of 4-6 local leaders from environmental agencies, water/sanitation systems, and education institutions - participated in a 5-day professional learning immersion in May, 2013, to buld capacities to develop and facilitate water conservation and catchment activities at the four target sites in the FAS. The Core Team members at each site now are recruiting and collaborating with local community members to implement site-specific projects that both educate and provide enhanced access to high quality drinking water. Both adults and youth are now engaging in a spectrum of proejcts that address loca needs and priorities through site-specific service learning activities. The site-specific focus in each locale, determined by the local Core Team, is distinct. In Palau, the Core Team has built broader community awareness of water conservation issues, raised the issue of water security in national conversations, engaged remote communities in improving natural rainwater drainage collection systems, and produced youth-oriented educational materials focused on local sites. In Yap, the Core Team members have collaborated with public utilities to install first-flush diverters into community rainwater catchment systems on Yap proper, and now are installing these devices in rainwater catchment systems on Yap's neighbor islands. In Chuuk, groundwater springs in remote communities are being upgraded for improved storage capacity, protection against contamination, and better public access. In Majuro (RMI), public school rainwater catchment systems are being repaired, repainted, cleaned, and upgraded so that schools can and will provide adequate drinking water to students (and to broader segments of the community during droughts). Broad segments of communities, including school classes and clubs, church and civic groups, etc. are becoming increasingly involved in building better water security and resilience for their communities, in preparation for a predicted drought, predicted to hit in the winter of 2014-2015, brought on by an El Nino event now edevelopig in the eastern Pacific. Water for Life has produced a range of locally relevant educational materials, including books, pamphlets, flyers, etc., some in English and others in local languages. Posters and billboards are being produced to enhance and maintain public awareness. Infrastructure projects are enabling better collection of more, higher quality water for drinking. A full-scale water handbook is under development, and this will serve as a basis for a self-contained water 'course' that will be offered through local community colleges. The experiences of project participants are being captured, analyzed, and reported in front-end, formative, and sumative evaluations conducted by David Heil & Associates. Thousands of individuals, comprising large segments of the participating countries' populations, will be directly impacted by the project. The results will be applicable to other remote and rural communities outside of the Pacific distressed by poor water quality and ineffective freshwater harvesting systems.
The Chicago Zoological Society (CZS) in collaboration with Eden Place Nature Center, the Fuller Park Community Corporation, and the University of Illinois at Chicago (UIC) will implement the SCIENCES Program, Supporting a Community's Informal Education Needs: Confidence and Empowerment in STEM. The primary goals of this Full Scale Development project are to broaden access to and participation in environmental science, strengthen partnerships between CZS, Eden Place, and UIC, and gain insights into the 'ecosystemic' learning model which promotes scientific literacy and agency in the community. The project targets a low-resource community with a minority audience while the secondary audience is informal science learning organizations and researchers who will advance research in informal learning. The theoretical framework for the project design draws on conservation psychology, informal science learning, civic ecology education, and urban science education to create an ecosystematic, geographically centered approach. The deliverables include research, curriculum, and engaging hands-on programs for youth, families, adults, and teachers, reaching both in-school and out-of-school audiences, in addition to the SCIENCES Implementation Network. Three potential curriculum themes to be explored are water conservation and protection, pollinators for healthy ecosystems, and community resilience to climate change. The SCIENCES project offers a comprehensive suite of engaging programs for community audiences. For example, the year-long Zoo Adventure Passport (ZAP) program for families includes hands-on experiments and field trips, while project-based learning experiences enable teens to create wetlands, design interpretive signage, and develop associated public programming. School-based programs include professional development for teachers on the Great Lakes ecosystem and invasive species. Existing programs that have been previously evaluated and demonstrated to show learning impacts will be adapted and modified to meet the goals of the ecosystemic learning model by providing multiple learning opportunities. New learning resources will also be created to support the content themes and provide continuity. The result will be a comprehensive approach that ensures deep community engagement by individuals, families, and organizations, with cohesiveness provided by the overarching content themes which broaden access to STEM learning resources and leverages partnerships. The project includes both a research and evaluation plan. The primary research question to be addressed is: How does a large informal science learning institution work with a community-based organization to support environmental scientific literacy and agency at all levels of the community? A sociocultural framework will be used for this mixed-methods case study research. Study participants include community leaders, youth, parents, teachers, and staff from Eden Place. The case study sample will include 20 focal individuals drawn from the participant groups and approximately 300 survey participants. Case study data will be triangulated with evaluation data and analyzed using a grounded theory approach. By examining changes from the baseline following the implementation of the community programs, the findings may provide insight on agency and science literacy among community members. The comprehensive, mixed-methods evaluation plan employs a quasi-experimental design and incorporates front-end, formative, and summative evaluation components. The evaluation questions address the quality of the processes and products, access to environmental science learning opportunities, environmental science literacy, sustainability, and barriers to implementation. An extensive dissemination plan is proposed with a dual emphasis on meeting stakeholders' needs at multiple levels. The evaluation and research teams will emphasize publication in peer reviewed journals and presentations at conferences for informal science education professionals. Findings will be shared with the Fuller Park community stakeholders using creative methods such as one-page research briefs written in layperson's language, videos, and recorded interviews with participants. The local project Advisory Board will also be actively involved in the dissemination of findings to community constituents. The SCIENCES National Amplification Network will be created and work collaboratively with the American Association of Zoos and Aquariums and the Metropolitan Green Spaces Alliance to disseminate the model. Collectively, the activities and deliverables outlined in this proposal will advance the discovery of sustainable models of community-based learning while the research will advance the understanding of informal learning support for science literacy and agency.