This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by engaging in hands-on field experience, laboratory/project-based entrepreneurship tasks and mentorship experiences. This ITEST project aims to research the STEM career interests of late elementary and middle-school students and, based on the results of that research, build an informal education program to involve families and community partners to enhance their science knowledge, attitudes, experiences, and resources. There is an emphasis on underrepresented and low income students and their families.
The project will research and test a new model to promote the development of positive attitudes toward STEM and to increase interest in STEM careers. Phase 1 of the project will include exploratory research examining science capital and habitus for a representative sample of youth at three age ranges: 8-9, 9-10 and 11-12 years. The project will measure the access that youth have to adults who engage in STEM careers and STEM leisure activities. In phase II the project will test a model with a control group and a treatment group to enhance science capital and habitus for youth.
Ruff Family Science is an exploratory project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. More specifically, the project is undertaking a research and design process to create prototype
In this NSF INCLUDES Design and Development Launch Pilot the institutions of "Building on Strengths" propose to build and pilot the infrastructure, induction process, and early implementation of the Mathematician Affiliates of Color network. This network will consist of mathematicians of color from across academia and industry who want to invest time in, share their expertise with, and learn from students of color and their teachers. Building on Strengths will draw on basic needs cognitive theory to support these interactions and will focus narrowly on short and moderate term collaborations (from one month to a semester) between visiting mathematicians, students, and collaborating teachers that will involve three specific types of interactions: doing mathematics together as a habits-of-mind practice, talking about the discipline of mathematics and the experiences of mathematicians of color in that discipline, and relationship-building activities. The foundational infrastructure developed in the project will include systems for recruitment, selection and induction, a process for pairing affiliate mathematicians with classrooms, and support structures for the collaborations. To support the goals of the network a prototype virtual space will be developed in which real-time artifacts can be collected and shared from the classroom interactions. While Building on Strengths will pilot this program in the secondary context, once a viable model is established, scaling to K-16, as well as to other STEM fields, will be possible.
The research study in the project uses an exploratory sequential mixed-methods design and will be conducted in two phases. In the first, quantitative, phase of the study the following questions will be addressed: (1) Is the teacher-mathematician collaboration associated with a change for students in perception of basic human needs being met, mathematical or racial identities, or beliefs about mathematics or who can do mathematics? (2) Is the teacher-mathematician collaboration associated with a change for adults in perceptions of the role of basic needs or in adults' identities or beliefs about mathematics or who can do mathematics? In the second, qualitative, phase of the study, two types of interactions will be selected for in-depth qualitative study, identifying cases where groups of students experienced changes in their needs, identity, and beliefs. In this qualitative case-centered phase, the following questions will be explored: (1) What is the nature of the mentor-student interaction? (2) What aspects of the intervention do students feel are most relevant to them? (3) How did the implementation of the intervention differ from the anticipated intervention? The results of the study will help improve the infrastructure for, and better support the interactions between, mathematicians of color, students of color and their mathematics teachers; the outcomes will also shed light on how students experience their interactions.
DATE:
-
TEAM MEMBERS:
Michael YoungMaisha MosesAlbert CuocoEden Badertscher
resourceprojectProfessional Development, Conferences, and Networks
This is a project to offer the Forum on Inclusive STEMM Entrepreneurship (FISE), a novel effort to broaden the participation of underrepresented minority women in STEMM entrepreneurship and to enhance the diversity of the science and engineering workforce. Through a convening of educators, entrepreneurs, aspiring entrepreneurs, industry leaders, investors and policy experts, entrepreneurial education thought leaders, and intersectionality scholars the PI proposes to use this conference as a platform for building capacity in the preparation and development of future entrepreneurs from underrepresented groups. The PI also seeks to contribute to the emerging field of research that bridges tech entrepreneurship and education policy.
The proposed forum has the potential to advance knowledge in the field of entrepreneurship education and engineering education. Given the dearth of research-based interventions to broaden participation in tech entrepreneurship, this conference offers an opportunity for participants to contribute to the leading edge of research and interventions in this field.
The convening and associated activities will leverage the social capital of knowledgeable experts in the academy and industry, investors, entrepreneurs and aspiring entrepreneurs to address critical needs of the nation that relate to enhanced global competitiveness, an improved national economy, and the participation of underrepresented cohorts in entrepreneurship and commercialization.
Worldwide, four million people participate in geocaching--a game of discovering hidden treasures with GPS-enabled devices (including smart phones). Geocachers span all ages and tend to be interested in technology and the outdoors. To share information about the Montana Climate Assessment (MCA), an NSF-funded scientific report, Montana State University created a custom trackable geocaching coin featuring the MCA Website and logo. We then recruited volunteers to hide one coin in each of Montana’s 56 counties. Volunteer geocachers enthusiastically adopted all 56 counties, wrote blogs and social media posts about the coins, and engaged local Scout troops and schools. Other geocachers then found and circulated the coins while learning about Montana’s climate. One coin has traveled nearly 4,000 miles; several have visited other states and Canada. 95% of the volunteers said the project made them feel more connected to university research, and they told an average of seven other people about the project. Nearly all of the participants were unfamiliar with the Montana Climate Assessment prior to participating. The geocaching educational outreach project included several partnerships, including with Geocaching Headquarters in Seattle (a.k.a. “Groundspeak”); Cache Advance, Inc., an environmentally friendly outdoor gear company; and Gallatin Valley Geocachers. An advisory board of geocachers helped launch the project.
DATE:
TEAM MEMBERS:
Suzi TaylorRay CallawayM.J. NehasilCathy Whitlock
This study explored how different presentations of an object in deep space affect understanding, engagement, and aesthetic appreciation. A total of n = 2,502 respondents to an online survey were randomly assigned to one of 11 versions of Cassiopeia A, comprising 6 images and 5 videos ranging from 3s to approximately 1min. Participants responded to intial items regarding what the image looked like, the aesthetic appeal of the image, perceptions of understanding, and how much the participant wanted to learn more. After the image was identified, participants indicated the extent to which the
DATE:
TEAM MEMBERS:
Lisa SmithKimberly ArcandRandall SmithJay BookbinderJeffrey Smith
Northern ecosystems are rapidly changing; so too are the learning and information needs of Arctic and sub-Arctic communities who depend on these ecosystems for wild harvested foods. Public Participation in Scientific Research (PPSR) presents a possible method to increase flow of scientific and local knowledge, enhance STEM-based problem solving skills, and co-create new knowledge about phenology at local and regional or larger scales. However, there remain some key challenges that the field of PPSR research must address to achieve this goal. The proposed research will make substantial contributions to two of these issues by: 1) advancing theory on the interactions between PPSR and resilience in social-ecological systems, and 2) advancing our understanding of strategies to increase the engagement of youth and adults historically underrepresented in STEM, including Alaska Native and indigenous youth and their families who play an essential role in the sustainability of environmental monitoring in the high latitudes and rural locations throughout the globe. In particular, our project results will assist practitioners in choosing and investing in design elements of PPSR projects to better navigate the trade-offs between large-scale scientific outcomes and local cultural relevance. The data collected across the citizen science network will also advance scientific knowledge on the effects of phenological changes on berry availability to people and other animals.
The Arctic Harvest research goals are to 1) critically examine the relationship between PPSR learning outcomes in informal science environments and attributes of social-ecological resilience and 2) assess the impact of two program design elements (level of support and interaction with mentors and scientists, and an innovative story-based delivery method) on the engagement of underserved audiences. In partnership with afterschool clubs in urban and rural Alaska, we will assess the impact of participation in Winterberry, a new PPSR project that investigates the effect of changes in the timing of the seasons on subsistence berry resources. We propose to investigate individual and community-level learning outcomes expected to influence the ability for communities to adapt to climate change impacts, including attributes of engagement, higher-order thinking skills, and their influence on the level of civic action and interest in berry resource stewardship by the youth groups. Using both quantitative and qualitative approaches, we compare these outcomes with the same citizen science program delivered through two alternate methods: 1) a highly supported delivery method with increased in-person interaction with program mentors and scientists, and 2) an innovative method that weaves in storytelling based on elder experiences, youth observations, and citizen science data at all stages of the program learning cycle. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project also has support from the Office of Polar Programs.
DATE:
-
TEAM MEMBERS:
Katie SpellmanElena SparrowChrista MulderDeb Jones
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will conduct research designed to deepen our fundamental knowledge about culture, experience, and ecosystems cognition and to develop innovative practices and approaches to support learning about changing ecological systems and environmental decision making. Work on cultural differences in the production of complex systems knowledge is severely lacking. This gap in knowledge may contribute to the continued reproduction of inequities in science education. More broadly findings from this project will have clear implications for theories of cognitive development, especially those pertaining to how knowledge is shaped by culture and experience. Focusing on ecosystems may represent an opportunity to not only increase engagement and achievement in science among non-dominant communities and Native youth specifically, but also advance effective learning for all communities. The primary deliverables for the project are conference presentations and research publications. However, the project will also develop additional resources freely available to researchers, educators, and the general public. These will include summer curricular materials and teaching tools, professional development workshops, practitioner briefs about research findings that can be used in professional development workshops and shared share more broadly, and evaluation reports.
A deeper understanding of cultural influences on conceptions of the natural world can serve to advance the educational needs of children, including children from diverse linguistic and cultural backgrounds. Project research will include two interrelated series of studies designed to expand knowledge about human cognition of complex ecosystems and the affordances of informal STEM learning environments in developing and supporting the critical 21st century skill of ecological systems level reasoning. The first consists of a series of experiments focused on ecological cognition and the role of humans in nature. The second consists of design-based research interventions in informal settings, summer workshops for youth and the communities, focused on ecological systems level thinking and socio-environmental decision making. The project will recruit and engage both child and adult participants from two broad cultural communities, Native Americans and European Americans living in urban and suburban communities, in part because it affords a sharp test of human-nature relations. Sampling from two different urban communities will avoid simple Native-non-Native comparative binaries and to conduct Native-to-Native comparative analysis. Based on results from this, the project will result in: 1) foundational knowledge about human learning and reasoning and ecosystems and environmental decision making, 2) culturally responsive models of learning and practice about complex ecosystems for indoors and outdoors informal learning environments, and 3) insights about research-practice-community partnerships. One important objective of the research is to broaden participation and close opportunity gaps for under-represented groups in STEM fields broadly and more specifically for Indigenous people. Members of Indigenous communities, who provide strong role models for other aspiring scholars, will be involved as postdoctoral fellows, research assistants and graduate fellows.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project will embed public engagement with science (PES) into the cultures and practices of two Long-Term Ecological Research (LTER) sites: the Hubbard Brook Experimental Forest in New Hampshire and the Harvard Forest in Massachusetts. The goals are 1) to build knowledge about the mutual learning between scientists and adult stakeholders in face-to-face engagement setting and 2) to develop evidence-based practices in the content of place-based ecosystem research. This is a collaborative project of 3 universities (Michigan State University, Harvard, and CUNY) and the two LTERs. Two primary research questions guide this work. First, how willing are participating scientists to take part in PES? What are their attitudes and beliefs about whether engagement can be effective and whether they have the necessary skills? Second, how willing are participating scientists to build relationships with stakeholders using normed tactics? Both qualitative and quantitative methods will be used to collect evidence including semi-structured interviews and surveys. A general set of hypothesis include that there will be positive changes in LTER scientists willingness to participate in PES, attitudes, and efficacy beliefs.
DATE:
-
TEAM MEMBERS:
John BesleySarah GarlickPeter GroffmanPamela TemplerKathleen Lambert