Effective classification of large datasets is a ubiquitous challenge across multiple knowledge domains. One solution gaining in popularity is to perform distributed data analysis via online citizen science platforms, such as the Zooniverse. The resulting growth in project numbers is increasing the need to improve understanding of the volunteer experience; as the sustainability of citizen science is dependent on our ability to design for engagement and usability. Here, we examine volunteer interaction with 63 projects, representing the most comprehensive collection of online citizen science
DATE:
TEAM MEMBERS:
Helen SpiersAlexandra SwansonLucy FortsonBrooke SimmonsLaura TrouilleSamantha BlickhanChris Lintott
In citizen science, user-centred development is often emphasised for its potential to involve participants in the development of technology. We describe the development process of the mobile app “Naturblick” as an example of a user-centred design in citizen science and discuss digital user feedback with regard to the users' involvement. We have identified three types of digital user feedback using qualitative content analysis: general user feedback, contributory user feedback and co-creational user feedback. The results indicate that digital user feedback can link UCD techniques with more
The growing interest in citizen science has resulted in a new range of digital tools that facilitate the interaction and communications between citizens and scientists. Considering the ever increasing number of applications that currently exist, it is surprising how little we know about how volunteers interact with these technologies, what they expect from them, and why these technologies succeed or fail. Aiming to address this gap, JCOM organized this special issue on the role of User Experience (UX) of digital technologies in citizen science which is the first to focus on the qualities and
DATE:
TEAM MEMBERS:
Artemis SkarlatidouMarisa PontiJames SprinksChristian NoldMuki HaklayEiman Kanjo
Char Associates conducted an evaluation of the four-year, NSF-funded project, Interpreters and Scientists Working on Our Parks (iSWOOP). The project brought interpreters and scientists together in multi-day professional development sessions at five national parks with the purpose of showcasing scientific research that usually goes unseen and unappreciated by park visitors. iSWOOP coordinated the development and delivery of digital libraries including animations, still photos, thermal and high-speed videos, and maps to give visual support to explanations of particular scientific studies. In
The National Academy of Sciences’ LabX program came into existence in 2017 with a directive to develop programming meant to engage with a young-adult (18-37 years old) target audience who are active decision-makers and whose actions impact current and future policies. While conducting preliminary research, the LabX staff and advisory board discovered that available research on young adults’ relationship with science was sadly lacking in detail, beyond obvious conclusions about high levels of interest in technology and social experiences.
To fill these knowledge gaps, gain a deeper
The characteristics of interaction and dialogue implicit in the Web 2.0 have given rise to a new scenario in the relationship between science and society. The aim of this paper is the development of an evaluation tool scientifically validated by the Delphi method that permits the study of Internet usage and its effectiveness for encouraging public engagement in the scientific process. Thirty four indicators have been identified, structured into 6 interrelated criteria conceived for compiling data that help to explain the role of the Internet in favouring public engagement in science.
DATE:
TEAM MEMBERS:
Lourdes LopezMaria Dolores Olvera-Lobo
Participants in this study reported a variety of resources used in the past to learn to code in Apex, including online tutorials, one-day classes sponsored by Salesforce, and meet-up groups focused on learning. They reported various difficulties in learning through these resources, including what they viewed as the gendered nature of classes where the men already seemed to know how to code—which set a fast pace for the class, difficulty in knowing “where to start” in their learning, and a lack of time to practice learning due to work and family responsibilities. The Coaching and Learning Group
This INSPIRE award is partially funded by the Cyber-Human Systems Program in the Division of Information and Intelligent Systems in the Directorate for Computer Science and Engineering, the Gravitational Physics Program in the Division of Physics in the Directorate for Mathematical and Physical Sciences, and the Office of Integrative Activities.
This innovative project will develop a citizen science system to support the Advanced Laser Interferometer Gravitational wave Observatory (aLIGO), the most complicated experiment ever undertaken in gravitational physics. Before the end of this decade it will open up the window of gravitational wave observations on the Universe. However, the high detector sensitivity needed for astrophysical discoveries makes aLIGO very susceptible to noncosmic artifacts and noise that must be identified and separated from cosmic signals. Teaching computers to identify and morphologically classify these artifacts in detector data is exceedingly difficult. Human eyesight is a proven tool for classification, but the aLIGO data streams from approximately 30,000 sensors and monitors easily overwhelm a single human. This research will address these problems by coupling human classification with a machine learning model that learns from the citizen scientists and also guides how information is provided to participants. A novel feature of this system will be its reliance on volunteers to discover new glitch classes, not just use existing ones. The project includes research on the human-centered computing aspects of this sociocomputational system, and thus can inspire future citizen science projects that do not merely exploit the labor of volunteers but engage them as partners in scientific discovery. Therefore, the project will have substantial educational benefits for the volunteers, who will gain a good understanding on how science works, and will be a part of the excitement of opening up a new window on the universe.
This is an innovative, interdisciplinary collaboration between the existing LIGO, at the time it is being technically enhanced, and Zooniverse, which has fielded a workable crowdsourcing model, currently involving over a million people on 30 projects. The work will help aLIGO to quickly identify noise and artifacts in the science data stream, separating out legitimate astrophysical events, and allowing those events to be distributed to other observatories for more detailed source identification and study. This project will also build and evaluate an interface between machine learning and human learning that will itself be an advance on current methods. It can be depicted as a loop: (1) By sifting through enormous amounts of aLIGO data, the citizen scientists will produce a robust "gold standard" glitch dataset that can be used to seed and train machine learning algorithms that will aid in the identification task. (2) The machine learning protocols that select and classify glitch events will be developed to maximize the potential of the citizen scientists by organizing and passing the data to them in more effective ways. The project will experiment with the task design and workflow organization (leveraging previous Zooniverse experience) to build a system that takes advantage of the distinctive strengths of the machines (ability to process large amounts of data systematically) and the humans (ability to identify patterns and spot discrepancies), and then using the model to enable high quality aLIGO detector characterization and gravitational wave searches
DATE:
-
TEAM MEMBERS:
Vassiliki KalogeraAggelos KatsaggelosKevin CrowstonLaura TrouilleJoshua SmithShane LarsonLaura Whyte
Twin Cities PBS BRAINedu: A Window into the Brain/Una ventana al cerebro, is a national English/Spanish informal education project providing culturally competent programming and media resources about the brain’s structure and function to Hispanic middle school students and their families. The project responds to the need to eliminate proven barriers to Hispanic students’ STEM/neuroscience education, increase Hispanic participation in neuroscience and mental health careers and increase Hispanic utilization of mental health resources.
The program’s goals are to engage Hispanic learners and families by
empowering informalSTEM educators to provide culturally competent activities about the brain’s structure and function;
demonstrating neuroscience and mental health career options; and
reducing mental health stigma, thus increasing help-seeking behavior.
The hypothesis underpinning BRAINedu’s four-year project plan is that participating Hispanic youth and families will be able to explain how the brain works and describe specific brain disorders; demonstrate a higher level of interest of neuroscience and mental health careers and be more willing to openly discuss and seek support for brain disorders and mental health conditions.
To achieve program goals, Twin Cities PBS (TPT) will leverage existing partnerships with Hispanic-serving youth educational organizations to provide culturally competent learning opportunities about brain health to Hispanic students and families. TPT will partner with neuroscience and mental health professionals, cultural competency experts and Hispanic-serving informal STEM educators to complete the following objectives:
Develop bilingual educational resources for multigenerational audiences;
Provide professional development around neuroscience education to informal educators, empowering them to implement programming with Hispanic youth and families, and
Develop role model video profiles of Hispanic neuroscience professionals, and help partner organizations produce autobiographical student videos.
We will employ rigorous evaluation strategies to measure the project’s impact on Hispanic participants: a) understanding of neuroscience and brain health, particularly around disorders that disproportionately affect the Hispanic community; b) motivation to pursue neuroscience or mental health career paths; and c) mental health literacy and help-seeking behavior. The project will directly reach 72 Hispanic-serving informal STEM educators and public health professionals, and 200 children and 400 parents in underserved urban, suburban and rural communities nationwide.
Fostering greater inclusion in science creates benefits for both science and society. In this Innovations and Development project, the University of Utah will investigate how to sustain and scale the STEM Ambassador Program (STEMAP), begun in 2016 with AISL funding. STEMAP developed an innovative process to train scientists to engage members of the public, who cannot or do not gain access to science via conventional science education venues (such as museums, schools, zoos), by implementing activities in non-traditional settings. The 65 scientists trained by the initial STEMAP effort effectively engaged in over 45 settings including an affordable housing development, a youth residential treatment center, a state prison, a cooking class, a daycare facility, and several senior centers. The number of scientists applying to the program quickly exceeded STEMAP's capacity. Other institutions expressed interest in replicating the training. This project will explore strategies for scaling and sustaining public engagement training to support more scientists who can engage more people in more venues. Outcomes will serve to inform the broader implementation of STEMAP and the efforts of other public engagement programs, many of which face similar scaling and sustainability challenges.
Scaling and sustaining public engagement of science (PES) programs is a central challenge for many in the informal science learning community. This project will explore strategies to scale and sustain the STEM Ambassador Program. Research questions include: (1) How do different program formats increase or restrict program capacity and engagement outcomes? (2) What benefits accrue to scientists and their institutions by participating in public engagement in science activities that might serve as motivators to continue these activities? (3) Are funding and organizational models developed in business and other professional settings applicable to sustaining these programs? To address scalability, this project will explore the effectiveness of three dissemination formats: (1) the creation of a mentorship program for in-person trainees, (2) a train-the-trainer approach, and (3) online training with in-person mentorship. The project team will create an evaluation toolkit with participant surveys, rubrics for observers, and "on-the-spot" assessment tools developed under AISL Award 1811022 to assess the effectiveness of engagement activities delivered by trainees in each of the three formats. To address sustainability, the project team will document the values of public engagement training to both the participating scientists and their institutions via surveys and interviews. Consultants from the business sectors will create a PES Campus Council to explore possible financial, organizational, and leadership plans that will help sustain engagement efforts. Outcomes will be published in peer-reviewed journals and compiled into a dissemination framework to inform actions to scale and sustain STEMAP and other public engagement of science programs to engage more hard-to-reach audiences. Inverness Research will serve as the project's external evaluator.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This Research Advanced by Interdisciplinary Science and Engineering (RAISE) project is supported by the Division of Research on Learning in the Education and Human Resources Directorate and by the Division of Computing and Communication Foundations in the Computer and Information Science and Engineering Directorate. This interdisciplinary project integrates historical insights from geometric design principles used to craft classical stringed instruments during the Renaissance era with modern insights drawn from computer science principles. The project applies abstract mathematical concepts toward the making and designing of furniture, buildings, paintings, and instruments through a specific example: the making and designing of classical stringed instruments. The research can help instrument makers employ customized software to facilitate a comparison of historical designs that draws on both geometrical proofs and evidence from art history. The project's impacts include the potential to shift in fundamental ways not only how makers think about design and the process of making but also how computer scientists use foundational concepts from programming languages to inform the representation of physical objects. Furthermore, this project develops an alternate teaching method to help students understand mathematics in creative ways and offers specific guidance to current luthiers in areas such as designing the physical structure of a stringed instrument to improve acoustical effect.
The project develops a domain-specific functional programming language based on straight-edge and compass constructions and applies it in three complementary directions. The first direction develops software tools (compilers) to inform the construction of classical stringed instruments based on geometric design principles applied during the Renaissance era. The second direction develops an analytical and computational understanding of the art history of these instruments and explores extensions to other maker domains. The third direction uses this domain-specific language to design an educational software tool. The tool uses a calculative and constructive method to teach Euclidean geometry at the pre-college level and complements the traditional algebraic, proof-based teaching method. The representation of instrument forms by high-level programming abstractions also facilitates their manufacture, with particular focus on the arching of the front and back carved plates --- of considerable acoustic significance --- through the use of computer numerically controlled (CNC) methods. The project's novelties include the domain-specific language itself, which is a programmable form of synthetic geometry, largely without numbers; its application within the contemporary process of violin making and in other maker domains; its use as a foundation for a computational art history, providing analytical insights into the evolution of classical stringed instrument design and its related material culture; and as a constructional, computational approach to teaching geometry.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Polar Literacy: A model for youth engagement and learning will foster public engagement with polar science. The project targets middle-school aged underserved youth and polar research scientists, with the goal to increase youth interest in and understanding of Polar Regions, and to hone researchers' science communication skills. The project will develop affordable and replicable ways of bringing polar education to informal learning environments, extend our understanding of how polar education initiatives can be delivered to youth with maximum effect, and design a professional development model to improve the capacity for Polar Region researchers to craft meaningful broader impact activities. Polar Literacy will create and test a model which combines direct participation by scientists in after-school settings, with the use of curated polar research data sets and data visualization tools to create participatory learning experiences for youth. Beyond the life of the project funding, many of the project deliverables (including kits, videos, and other resources) will continue to be used and disseminated online and in person through ongoing work of project collaborators.
Polar Literacy: A model for youth engagement and learning will advance the understanding of informal learning environments while leveraging the rich interdisciplinary resources from polar investments made by the National Science Foundation (NSF). The project's key audiences -- polar researchers, informal educators, and out-of-school time (OST) youth in grades 4-7 (ages 9-13) -- will connect through both place-based and internet-based experiences and work collaboratively to generate a flexible, scalable, and transferable education model. The project will 1) design OST kits and resource guides (focused on Polar Literacy Principles) and include "Concept in a Minute" videos designed to highlight enduring ideas, 2) provide professional development for informal educators, 3) synthesize a club model through adaptation of successful facets of existing informal learning programs, and 4) create Data Jam events for the OST Special Interest (SPIN) clubs and camp programs by modifying an existing formal education model. A research design, implemented at four nodes over three years, will answer three research questions to evaluate the impact of professional development on informal educators, as well as the impact of programs on youth, and the effectiveness of the model. In addition to the project team and collaborators who are informal education practitioners, an advisory board composed of experts in youth programming, informal education, and evaluation will guide the project to ensure that it advances the body of informal STEM learning research.
Polar Literacy is an Advancing Informal STEM Learning (AISL) Innovations in Development project in response to the Dear Colleague Letter: Support for Engaging Students and the Public in Polar Research (NSF 18-103). Polar Literacy is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (Science, Technology, Engineering, Mathematics) learning in informal environments. This project has co-funding support from the Antarctic section of the Office of Polar Programs.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Janice McDonnellOscar SchofieldCharles LichtenwalnerJason Cervenec