The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
Citizen science is a form of Public Participation in Scientific Research (PPSR) in which the participants are engaged in the scientific process to support research that results in scientifically valid data. Opportunities for participation in real and authentic scientific research have never been larger or broader than they are today. The growing popularity and refinement of PPSR efforts (such as birding and species counting studies orchestrated by the Cornell Lab of Ornithology) have created both an opportunity for science engagement and a need for more research to better implement such projects in order to maximize both benefits to and contributions from the public.
Towards this end, Shirk et al. have posted a design framework for PPSR projects that delineates distinct levels of citizen scientist participation; from the least to the highest level of participation, these categories are contract, contribute, collaborate, co-create, and colleagues. The distinctions among these levels are important to practitioners seeking to design effective citizen science programs as each increase in citizen science participation in the scientific process is hypothesized to have both benefits and obstacles. The literature on citizen science models of PPSR calls for more research on the role that this degree of participation plays in the quality of that participation and related learning outcomes (e.g., Shirk et al., 2012; Bonney et al., 2009). With an unprecedented interest in thoughtfully incorporating citizen science into health-based studies, citizen science practitioners and health researchers first need a better understanding of the role of culture in how different communities approach and perceive participation in health-related studies, the true impact of intended educational efforts from participation, and the role participation in general has on the scientific process and the science outcome.
Project goal to address critical barrier in the field: Establish best practices for use of citizen science in the content area of human health-based research, and better inform the design of future projects in PPSR, both in the Denver Museum of Nature & Science’s Genetics of Taste Lab (Lab), and importantly, in various research and educational settings across the field.
Aims
Understand who currently engages in citizen science projects in order to design strategies to overcome the barriers to participation that occur at each level of the PPSR framework, particularly among audiences underrepresented in STEM.
Significantly advance the current knowledge regarding how citizen scientists engage in, and learn from, and participate in the different levels of the PPSR framework.
Determine the impact that each stage of citizen science participation has on the scientific process.
This pilot study will examine the effectiveness of an innovative applied social change, community and technology based program on marginalized youths' access, interest, efficacy and motivation to learn and engage in digital technology applications. Using stratified near-peer and peer-to-peer mentoring approaches, the pilot builds on extant literature that indicates that peer-supported hands-on mentoring and experiences can alleviate some barriers to youth engagement in digital technologies, particularly among underrepresented groups. In this project, undergraduate students will mentor and work collaboratively with high school youth primarily of Hispanic descent and community-based organizations to develop creative technology-based solutions to address social issues and challenges within their local communities, culminating in events called Impactathons. These community-hosted local and state-wide events set this pilot project apart from similar work in the field. The Impactathons not only provide a space for intellectual discourse and problem-solving among the undergraduate-youth-community partners but the Impactathons will also codify expertise from scientists, social scientists, technologists, community leaders, and other stakeholders to develop technology-based solutions with real world application. If successful, a distal outcome will be increased youth interest in digital technologies and related fields. In the short term, favorable findings will provide preliminary evidence of success and lay the foundation for a more extensive study in the future.
This pilot project is a collaboration between the Everett Program, a student-led program for Technology and Social Change at the University of California Santa Cruz - a Hispanic Serving Institution - and the Digital NEST, a non-profit, high-tech youth career development and collaboration space for young people ages 14-24. Through this partnership and other recruitment efforts, an estimated 70-90 individuals will participate in the Impactathon pilot program over two years. Nearly two-thirds of the participants are expected to be undergraduate students. They will receive extensive training in near-peer and peer-to-peer mentoring and serve as mentors for and co-innovation developers with the high school youth participants. The undergraduates and youth will partner with local community organizations to identify a local social challenge that can be addressed through a technology-based solution. The emergent challenges will vary and could span the spectrum of STEM and applied social science topics of interest. Working in informal contexts (i.e., afterschool. weekend), the undergraduate-youth-community partner teams will work collaboratively to develop practical technology-based solutions to real world challenges. The teams will convene three times per year, locally and statewide, at student and community led Impactathons to share their work and glean insights from other teams to refine their innovations. In parallel, the research team will examine the effectiveness of the Impactathon model in increasing the undergraduate and youths' interest, motivation, excitement, engagement and learning of digital technologies. In addition to the research, the formative and summative evaluations should provide valuable insights on the effectiveness of the model and its potential for expansion and replication.
The project is co-funded by the Advancing Informal STEM Learning (AISL) Program and STEM +C. The AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. STEM + C focuses on research and development of interdisciplinary and transdisciplinary approaches to the integration of computing within STEM teaching and learning for preK-12 students in both formal and informal settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Multi-Site Public Engagement with Science—Synthetic Biology (MSPES) initiative was an Innovations in Development project funded by the National Science Foundation (DRL-1421179) through the Advancing of Informal STEM Learning program (AISL). MSPES promoted public engagement with science (PES)—a model of mutual dialogue and learning between public and scientist audiences—through the creation and distribution of PES kits to nearly 200 informal science education sites around the country. Kits included two types of learning experiences: (1) forum programs during which scientists and teen or
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understanding of deeper learning by participants. This pilot study, Akeakamai (Hawaiian, literally lover of wisdom, scientist, scholar), will explore the convergence of contemporary Western science topics with indigenous Hawaiian culture-based science experiences as a mechanism to strengthen STEM perceptions, cross-cultural science collaboration, and multi-generational community engagement with STEM. The work is grounded in the notion that STEM learning within the context of local informal indigenous community settings should be culturally responsive and culturally sustaining, and should privilege indigenous epistemologies. If successful, the results of this pilot could provide valuable insights on effective approaches to developing and implementing culturally consistent and sustainable multigenerational STEM engagement among Native Hawaiians and Pacific Islanders, and across the Pacific region.
Over a two-year duration, the study will address three research questions. (1) To what extent does inclusion of culture into curriculum designed for informal Culture-Science Explorations mitigate perceived barriers to participation in science? (2) What barriers do community members perceive to limit their participation in science? (3) What are the areas of consonance between Native Hawaiian and Western scientific approaches to knowledge and learning? Approximately 200 predominantly Native Hawaiian and Pacific Islanders, ranging in age from 8 - 85 years old, will participate in the pilot. The research team will collect participant data during all phases of the social intervention, a suite of culture-science exploration experiences held at the Halau Inana, a Native Hawaiian community collaboration space. The intervention will employ pedagogical methods that are responsive to Hawaiian cultural norms to deliver content that integrates across the interfaces of Western science and technology and indigenous knowledge, and incorporates Hawaiian language. A rigorous external evaluation will also be conducted. The results of the research and evaluation will be broadly disseminated. Ultimately, the project aims to develop a conceptual and practical cross-cultural, multi-generational framework for community-based science learning in Hawai'i that can serve as a model for future research and programs that extend into and beyond indigenous communities of the Pacific region.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Helen TurnerJonathan BakerChrystie Naeole
Please join us in celebrating Citizen Science Day, which falls this year on Saturday, April 14th. This issue of Connected Science Learning is dedicated to highlighting effective citizen science programs that involve classroom students in collecting data for research scientists, while also engaging them in key STEM (science, technology, engineering, and math) content and practices. Students get a “front row seat” to what scientists do and how scientists work, plus develop the reasoning skills and practices used by scientists.
With support from the National Science Foundation (NSF), SciStarter 2.0 was launched to enhance, diversify, and validate participant engagement in scientific research in need of the public’s help. SciStarter’s leadership is part of the National Academy of Sciences’ Committee, Designing Citizen Science to Support Science Learning, which is developing guidelines and a research agenda for citizen science in education. This article briefly introduces educators to SciStarter 2.0.
Digital Observation Technology Skills (DOTS) is a framework for integrating modern, mobile technology into outdoor, experiential science education. DOTS addresses longstanding tensions between modern technology and classical outdoor education by carefully selecting appropriate digital technology for educational purposes and by situating these tools in classical experiential pedagogy.
DATE:
TEAM MEMBERS:
R. Justin HoughamMarc NutterCaitlin Graham
resourceevaluationMuseum and Science Center Programs
The Museum of Science, Boston’s Research and Evaluation Department conducted a summative evaluation of The Hall of Human Life (HHL) exhibition. This 9,700 square foot exhibition is geared towards older children and adults. It is focused on human biology and human health with the main message, “Human beings are changing in a changing environment.” Visitors are able to use their own bodies and behaviors to understand biological mechanisms. Unique to this exhibition, visitors are able to use scannable wristbands to record and compare personal data with other Museum visitors to learn about their
In this NSF INCLUDES Design and Development Launch Pilot the institutions of "Building on Strengths" propose to build and pilot the infrastructure, induction process, and early implementation of the Mathematician Affiliates of Color network. This network will consist of mathematicians of color from across academia and industry who want to invest time in, share their expertise with, and learn from students of color and their teachers. Building on Strengths will draw on basic needs cognitive theory to support these interactions and will focus narrowly on short and moderate term collaborations (from one month to a semester) between visiting mathematicians, students, and collaborating teachers that will involve three specific types of interactions: doing mathematics together as a habits-of-mind practice, talking about the discipline of mathematics and the experiences of mathematicians of color in that discipline, and relationship-building activities. The foundational infrastructure developed in the project will include systems for recruitment, selection and induction, a process for pairing affiliate mathematicians with classrooms, and support structures for the collaborations. To support the goals of the network a prototype virtual space will be developed in which real-time artifacts can be collected and shared from the classroom interactions. While Building on Strengths will pilot this program in the secondary context, once a viable model is established, scaling to K-16, as well as to other STEM fields, will be possible.
The research study in the project uses an exploratory sequential mixed-methods design and will be conducted in two phases. In the first, quantitative, phase of the study the following questions will be addressed: (1) Is the teacher-mathematician collaboration associated with a change for students in perception of basic human needs being met, mathematical or racial identities, or beliefs about mathematics or who can do mathematics? (2) Is the teacher-mathematician collaboration associated with a change for adults in perceptions of the role of basic needs or in adults' identities or beliefs about mathematics or who can do mathematics? In the second, qualitative, phase of the study, two types of interactions will be selected for in-depth qualitative study, identifying cases where groups of students experienced changes in their needs, identity, and beliefs. In this qualitative case-centered phase, the following questions will be explored: (1) What is the nature of the mentor-student interaction? (2) What aspects of the intervention do students feel are most relevant to them? (3) How did the implementation of the intervention differ from the anticipated intervention? The results of the study will help improve the infrastructure for, and better support the interactions between, mathematicians of color, students of color and their mathematics teachers; the outcomes will also shed light on how students experience their interactions.
DATE:
-
TEAM MEMBERS:
Michael YoungMaisha MosesAlbert CuocoEden Badertscher
The University of California, Irvine will lead this Design and Development Launch Pilot to engage with collaborators from the Orange County CA STEM Initiative, the Orange County CA Department of Education, the Orange County CA Workforce Investment Board, the Jamboree Affordable Housing Communities, the Orangewood Foundation for Foster and Community Youth Services, OCTANE-Technology Incubator, Project Tomorrow and Growth Section. This project was created in response to the Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address the computing technology education practices for recruiting, better educating, retaining and graduating a productive STEM workforce. However women who are members of underrepresented minority groups, with low socioeconomic status, historically underperform in STEM and specifically in computing technology. This project, NSF INCLUDES: Supporting Women Advancing Through Technology, has the potential to significantly advance a collaborative approach by a group of organizations to improve the success of poor, underrepresented minority women who are learning computing technology and transitioning to the STEM workforce.
The project will demonstrate the outcomes of computer science training for women, particular disenfranchised and underrepresented minority women that may be exiting foster youth services, living in low income housing, and/or having been denied access to programs particularly in technology due to their socioeconomic status. Partnering organizations will design, develop and launch a short-term, intensive training opportunity in computer science for women ages 16 to 34 who are unemployed or underemployed, and who desire to engage in upward career mobility. The program will include a replicable, custom curriculum and an educational approach that will be scalable. A boot camp will teach the fundamentals of Ruby on Rails, HTML, CSS, SQL, JavaScript, and AngularJS, and prepare participants for a career in web development while enabling them to keep their day jobs and have childcare provided. Educating a randomized sample treatment group of up to 150 women in this launch pilot, the partners will also offer internships and/or job shadows, where participants gain client experience, learn from more experienced developers, and continue to build their portfolios. All of the women in the program will receive information, coaching and exposure to college and career opportunities. Job placement in STEM careers is the outcome goal of this design and development launch pilot.