This project seeks to apply explainable artificial intelligence to the challenge of personalizing training for adult citizen scientists. The approach will be developed in the context of the Native Bee Watch (NBW) biodiversity monitoring project that began in 2016 at Colorado State University.
DATE:
-
TEAM MEMBERS:
Sarath SreedharanNikhil KrishnaswamyJill ZarestkyNathaniel Blanchard
PocketMacro is a mobile app designed by the Learning Media Design Center at Carnegie Mellon University in collaboration with Stroud Water Research Center, Carnegie Museum of Natural History and Clemson University, and stakeholder input. The PocketMacro app aims to help users better identify benthic macroinvertebrates commonly found in streams and other waterways. Rockman et al Cooperative (REA), an independent educational evaluation group, designed a summative study to explore the effectiveness of the app in supporting users’ aquatic macroinvertebrate identification. The purpose of the
This project is designed to support collaboration between informal STEM learning (ISL) researchers, designers, and educators with sound researchers and acoustic ecologists to jointly explore the role of auditory experiences—soundscapes—on learning. In informal STEM learning spaces, where conversation advances STEM learning and is a vital part of the experience of exploring STEM phenomena with family and friends, attention to the impacts of soundscapes can have an important bearing on learning. Understanding how soundscapes may facilitate, spark, distract from, or even overwhelm thinking and conversation will provide ISL educators and designers evidence to inform their practice. The project is structured to reflect the complexity of ISL audiences and experiences; thus, partners include the North Park Village Nature Center located in in a diverse immigrant neighborhood in Chicago; Wild Indigo, a Great Lakes Audubon program primarily serving African American visitors in Midwest cities; an after-school/summer camp provider, STEAMing Ahead New Mexico, serving families in the rural southwest corner of New Mexico, and four sites in Ohio, MetroParks, Columbus Zoo and Aquarium, Franklin Park Conservatory and Botanical Gardens, and the Center of Science and Industry.
Investigators will conduct large-scale exploratory research to answer an understudied research question: How do environmental sounds impact STEM learning in informal learning spaces? Researchers and practitioners will characterize and describe the soundscapes throughout the different outdoor and indoor exhibit/learning spaces. Researchers will observe 800 visitors, tracking attraction, attention, dwell time, and shared learning. In addition to observations, researchers will join another 150 visitors for think-aloud interviews, where researchers will walk alongside visitors and capture pertinent notes while visitors describe their experience in real time. Correlational and cluster analyses using machine learning algorithms will be used to identify patterns across different sounds, soundscapes, responses, and reflections of research participants. In particular, the analyses will identify characteristics of sounds that correlate with increased attention and shared learning. Throughout the project, a team of evaluators will monitor progress and support continuous improvement, including guidance for developing culturally responsive research metrics co-defined with project partners. Evaluators will also document the extent to which the project impacts capacity building, and influences planning and design considerations for project partners. This exploratory study is the initial in a larger research agenda, laying the groundwork for future experimental study designs that test causal claims about the relationships between specific soundscapes and visitor learning. Results of this study will be disseminated widely to informal learning researchers and practitioners through workshops, presentations, journal articles, facilitated conversations, and a short film that aligns with the focus and findings of the research.
DATE:
-
TEAM MEMBERS:
Martha MersonJustin MeyerDaniel Shanahan
Mathematizing, Visualizing, and Power (MVP): Appalachian Youth Becoming Data Artists for Community Learning is a three-year Advancing Informal STEM Learning, Innovations and Development, project that focuses on community-centered data exploration catalyzed by youth. The project develops statistical artistry among young people in East Tennessee Appalachian communities and enables these youth to share their data visualizations with their communities to foster collective reflection and understanding. The creative work generated by the MVP project will be compelling in two ways, both as statistical art and as powerful statements giving voice to the experience of communities. Critical aspects of the MVP model include (1) youth learning sessions that position youth as owners of data and producers of knowledge and (2) Community Learning Events that support community learning as youth learning occurs. The MVP project has a primary focus on broadening the STEM participation of underrepresented communities of Appalachia. The project’s mission is to increase the learning and life outcomes of young people and communities of Appalachia by creating a meaningful foundation of data science and collective data exploration. The University of Tennessee partners with Pellissippi State Community College, Drexel University, and the Boys & Girls Club of the Tennessee Valley to bring together a convergent team of community members, practitioners, and professionals, with the expertise to carry out the project. The project will impact approximately 120 youth and 3800 of their East Tennessee community members. The research generated will inform how to engage community members in learning about community issues through the exploration of datasets relevant to participants.
The field of STEM education is in urgent need of knowledge about effective models to inspire community-based data exploration with young people as leaders in these efforts. The MVP project includes engaging youth with meaningful problems, building a discourse community with possibilities for action, re-positioning youth as knowledge producers within their own communities, leveraging linguistic and cultural resources of the youth participants and their communities, and implementing critical events that support substantial interaction between youth, community members, and the data visualizations. MVP builds on the idea that the design of data visualizations requires an understanding of both data science and artistic design. Research will inform the model of community engagement, examine data artists’ identities, and document community learning. The MVP model will be designed, developed, tested, and refined through three cycles of design-based research. The overarching research question guiding these cycles is: What affordances (and delimitations) related to identity and learning does the model provide for MVP Youth and community members? Data sources for the project include: fieldnotes, portfolios created by MVP Youth, youth pre/post interviews, observations of the learning sessions, a project documentary, surveys for youth and community members, interviews with community members, and audience feedback. The National Institute for STEM Evaluation and Research (NISER) will provide formative and summative evaluation about project activities. Formative feedback will be integrated into the ongoing research cycles. The research conducted will inform (1) the community learning model; (2) the integrated pedagogy and curriculum of the MVP Youth learning sessions that emphasize data science through design arts; and, (3) research on community learning and youth identity. Findings will be shared through conferences, academic and practitioner-focused journals, a video documentary, a Summit on Engaging Youth and Communities in Data, and a project website.
DATE:
-
TEAM MEMBERS:
Lynn HodgeElizabeth DyerJoy BertlingCarlye Clark
Environmental Protectors is a four-year project based at the University of California at Berkeley’s Lawrence Hall of Science. The project is designed to explore the educational and developmental impact of an informal science education programming model that features Community and Citizen Science (CCS) activities for youth of color residing in urban communities. The project is grounded in hypothesis that CCS-focused experiences result in learning outcomes that better position youth of color to more effectively engage in Science, Technology, Engineering, and Mathematics (STEM) related educational, occupational, and civic activities. Each year, in three economically challenged urban communities located throughout the country, youth of color between the ages of 14 and 18 will participate in month-long summer or semester-long afterschool programs. These programs will feature CCS-related activities that include collection, analysis, interpretation and presentation of data that addresses local, pressing environmental quality concerns, such as soil lead contamination and air particulate matter pollution. The project will use a mix of qualitative and quantitative data collection and analysis to assess the impact of youth engagement in these CCS activities. Overall, through its implementation the project aims to generate information useful in nationwide efforts designed to identify effective strategies and approaches that contribute to increasing STEM understanding and interest among youth of color.
Project research is guided by the following questions: A) What are ways to increase STEM engagement among those who have typically been underrepresented in Community and Citizen Science (CCS) research projects in particular and STEM in general? B) When youth are engaged in CCS, what outcomes are observed related to their science agency and science activism? What other unanticipated outcomes are observed related to benefits of participation and learning? C) How does science activism develop in youth participating in CCS?; and D) How do differences in program implementation impact youth outcomes. In particular, the project explores the manner in which particular CCS activities (e.g., project design, data analysis and interpretation, data presentation) impact youth “Science Agency,” defined as a combination of constructs that include Science Identity (i.e., sense of themselves as science thinkers), Science Value (i.e., awareness of the potential benefits of applying scientific practices to addressing critical community health and environmental issues) and Science Competency Beliefs (i.e., belief of themselves as competent science practitioners) and “Science Activism,” defined as a combination of perceived behavioral control and personal salience. Through its execution the project will refine a theory of learning that makes explicit connections between these constructs. Information derived from the execution of the project will contribute to deeper understanding of the potential for using of CCS projects as a key component of science education environments in urban areas and in general.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program.
Refugee youth are particularly vulnerable to STEM disenfranchisement due to factors including limited or interrupted schooling following displacement; restricted exposure to STEM education; and linguistic, cultural, ethnic, socioeconomic, and racial minority status. Refugee youth may experience a gap in STEM skills and knowledge, and a conflict between the identities necessary for participation in their families and communities, and those expected for success in STEM settings. To conduct research to better understand these challenges, an interrelated set of activities will be developed. First, youth will learn principles of physics and computing by participating in cosmic ray research with physicists using an instructional approach that builds from their home languages and cultures. Then youth periodically share what they are learning in the cosmic ray research with their parents, siblings, and science teachers at family and community science events. Finally, youth conduct reflective research on their own STEM identity development over the course of the project. Research on learning will be conducted within and across these three strands to better understand how refugee youth develop STEM-positive identities. This project will benefit society by improving equity and diversity in STEM through (1) creating opportunities for refugee youth to participate in physics research and to develop computing skills and (2) producing knowledge on STEM identity development that may be applied more broadly to improve STEM education. Deliverables from this project include: (a) research publications on STEM identity and learning; (b) curriculum resources for teaching physics and computing to multilingual youth; (c) an online digital storytelling exhibit offering narratives about belonging in STEM research which can be shared with STEM stakeholders (policy makers, scientists, educators, etc.); and (d) an online database of cosmic ray data which will be available to physicists worldwide for research purposes. This Innovations in Development proposal is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This program is designed to provide multiple contexts, relationships, and modes across and within which the identity work of individual students can be studied to look for convergence or divergence. To achieve this goal, the research applies a linguistic anthropological framework embedding discourse analysis in a larger ethnography. Data collected in this study include field notes, audio and video recordings of naturalistic interactions in the cosmic ray research and other program activities, multimodal artifacts (e.g., students' digital stories), student work products, interviews, and surveys. Critically, this methodology combines the analysis of identity formation as it unfolds in moment-to-moment conversations (during STEM learning, and in conversations about STEM and STEM learning) with reflective tasks and the production of personal narratives (e.g., in digital stories and interviews). Documenting convergence and divergence of STEM identities across these sources of data offers both methodological and theoretical contributions to the field. The research will offer thick description of the discursive practices of refugee youth to reveal how they construct identities related to STEM and STEM disciplines across settings (e.g., during cosmic ray research, while creating digital stories), relationships (e.g., peer, parent, teacher), and the languages they speak (e.g., English, Swahili). The findings will be of potential value to instructional designers of informal learning experiences including those working with afterschool, museums, science centers and the like, educators, and scholars of learning and identity.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Tino NyaweloJohn MatthewsJordan GertonSarah Braden
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This Innovations in Development project addresses the need to broaden girls' participation in STEM studies and career pathways. While women make up 47% of the U.S. workforce, they hold only 28.3% of STEM jobs and only 1 in 10 employed engineers and scientists are minority women. Girls of low socioeconomic status start losing interest and confidence in STEM during middle school, and this decline often continues as girls get older. Multiple sociocultural barriers contribute to girl's loss of confidence including gender and ethnic stereotypes; lack of culturally responsive programming; limited exposure to women role models; and few or no hands-on STEM experiences. This project builds upon the success of SciGirls, the PBS television show and national outreach program, which provides professional development on research-based gender equitable and culturally responsive teaching strategies designed to engage girls in STEM. It is a collaboration between Twin Cities Public Television, the Cornell Lab of Ornithology, and the National Park Service. The project's goal is to create media-rich citizen science experiences for girls, particularly girls of color and/or from rural areas, which broaden their STEM participation, build positive STEM identities and increase girls' understanding of scientific concepts, while leveraging citizen science engagement at national parks. Project deliverables include 1) creating five new PBS SciGirls episodes that feature real girls working with women mentors in 16 National Parks, 2) producing five new role model videos of women National Park Service STEM professionals, nationally disseminated on multiple PBS platforms, 3) providing professional development for educators and role models. This project will increase access to STEM education for girls of color and/or from rural areas, inspiring and preparing them for future STEM workforce participation. It will build the capacity of educators and National Park Service women role models to create educational and professional programs that are welcoming to girls of varying racial, ethnic, socioeconomic, and geographic backgrounds. SciGirls' massive reach to diverse audiences via PBS broadcast and multiple PBS digital platforms will amplify public scientific literacy, particularly for 21st- century audiences that connect, learn and live online.
The research study conducted by the Cornell Lab of Ornithology will address these questions: 1) To what extent does the use of culturally responsive and gender equitable multimedia in citizen science programming affect girls' learning outcomes, and contribute to the development of positive STEM identity' 2) how will their experiencing citizen science in the parks influence girls' connection to nature? At the beginning of the project all participating girls (n=160) will complete a survey on their interest in science, efficacy for doing science, and knowledge of citizen science and project-specific subject matter. Researchers will use the suite of DEVISE instruments most of which have been validated for youth to measure these constructs. To measure connection to nature, researchers will use the Connection to Nature Index, a scale developed for children. Interviews with the girls will be used to obtain qualitative data to supplement the survey data. Pre-post data will be analyzed to determine the influence of the culturally responsive media and experiences on girls' STEM identities. Researchers will share findings with the project evaluator to triangulate data between educators' implementation of the strategies and girls' learning outcome providing a more holistic picture of the overall program.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The RASOR project is designed to increase engagement of students from rural Alaska communities in biomedical/STEM careers. Rural Alaskan communities are home to students of intersecting identities underrepresented in biomedical science, including Alaska Native, low-income, first generation college, and rural. Geographic isolation defines these communities and can limit the exposure of students to scientifically-minded peers, professional role models, and science career pathways. However these students also have a particularly strong environmental connection through subsistence and recreational activities, which makes the one-health approach to bio-medicine an intuitive and effective route for introducing scientific research and STEM content. In RASOR, we will implement place-based mentored research projects with students in rural Alaskan communities at the high school level, when most students are beginning to seriously consider career paths. The biomedical one-health approach will build connections between student experiences of village life in rural Alaska and biomedical research. Engaging undergraduate students in research has proved one of the most successful means of increasing the persistence of minority students in science (Kuh 2008). Furthermore, RASOR will integrate high school students into community-based participatory research (Israel et al. 2005). This approach is designed to demonstrate the practicality of scientific research, that science has the ability to support community and cultural priorities and to provide career pathways for individual community members. The one-health approach will provide continuity with BLaST, an NIH-funded BUILD program that provides undergraduate biomedical students with guidance and support. RASOR will work closely with BLaST, implementing among younger (pre-BLaST) students approaches that have been successful for retaining rural Alaska students along STEM pathways and tracking of post-RASOR students. Alaska Native and rural Alaska students are a unique and diverse population underrepresented in biomedical science and STEM fields.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This specific project will advance new knowledge about the nature of and functions for rural libraries as informal STEM learning environments. Research will identify the social contexts and relational capabilities of libraries to acquire new scientific knowledge that exists externally and to integrate it into community knowledge-building and forums. The research outcomes should lead to actionable strategies for library and science communication practitioners about who and how to influence public engagement in citizen science drought monitoring. Furthermore, collaborations with these rural libraries will lead to new resources for rural communities and informal STEM education. This project will focus on the design, development, and evaluation of informal science education programs and educational media for use in rural libraries in drought prone areas of the Great Plains. The target audiences include public librarians in rural communities of Oklahoma, Nebraska, and Colorado, as well as the general public (adults and children) they serve. The project goals are to leverage the professional skills and community knowledge of rural librarians to support local drought monitoring networks. The model prepares librarians to introduce citizen science processes and practices within the context of community dialogue and deliberation about drought. In collaboration with partners at the Community Collaborative for Rain, Hail, and Snow (CoCoRaHS), and the National Drought Mitigation Center (NDMC), the project will increase public participation in citizen science and improve the communication of science-based knowledge about drought. The project deliverables include: (1) a professional development workshop series for rural librarians, (2) a drought infographic booklet and poster series, and (3) co-designed library programs for rural public audiences. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.