The widespread accessibility of live streaming video now makes it possible for viewers around the world to watch live events together, including unprecedented, 24/7 views of wildlife. In addition, online technologies such as live chatting and forums have opened new possibilities for people to collaborate from locations around the world. The innovation that the projects provide is bringing these opportunities together, enabling real-time research and discussion as participants observe and annotate live streaming footage; sharing questions and insights through live Q&A sessions; and explore data with interactive visualization tools. Scientists will support the community's research interests, in contrast with traditional models of citizen science in which communities support the work of scientists. This project will enable people from diverse backgrounds and perspectives to co-create scientific investigations, including participants who might not otherwise have access to nature. The evaluation research for this project will advance the understanding of practices that enable interconnected communities of people to participate in more phases of scientific discovery, and how participation affects their learning outcomes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. As such, this project will advance a new genre of Public Participation in STEM Research (PPSR). It will also advance scientific exploration using live wildlife cams and establish a database for long-term research to understand how bird behavior and reproductive success are affected by environmental change. This project aims to deepen public involvement in science, building on knowledge and relevance for STEM learning by creating an online learning environment that expands on traditional crowdsourcing models of PPSR in which participants collect data to answer questions driven by scientists. In this project, participants are involved in co-created research investigations, including asking questions, deciding what data are needed, generating data, looking for patterns, making interpretations, reviewing results, and sharing findings. The goals are to 1) create a system that involves the public more deeply in scientific research; 2) develop participants' science skills and interests; 3) increase participants' understanding of birds and the environment; 4) generate new scientific knowledge about wildlife; and 5) advance the understanding of effective project design for co-created PPSR projects at a national scale. Through iterative design and evaluation, the project will advance the understanding of the conditions that foster online collaboration and establish design principles for supporting science and discovery in online learning environments. Through scaling and quasi-experimental studies, the evaluation research will advance the understanding of how learning outcomes may be similar or different for participants engaging in different ways, whether they observe the cams and read about the investigation, process data as contributors, provide some input as collaborators, or join in most or all of the scientific process as co-creators. Despite the popularity of live wildlife cams, with millions of people watching hundreds of cams around the world, little research has been conducted on the use of live cams for collaborative work in formal or informal science education. The infrastructure and open-source framework created for this project will expand the capacity for online communities of people from diverse career backgrounds and perspectives to collaborative on solving personally meaningful questions and contribute to new knowledge. Using this project as a prototype, cam operators from around the world could build networks of cams, enabling future studies with broader scope for comparative biological studies and discoveries. Additionally, it will serve as a model for use in classrooms or for online communities exploring other scientific fields using live-streaming content in collaborative research. By involving scientists and participants from across society as collaborators and co-creators, this project can help increase public engagement with science, technology, and environmental stewardship while advancing the understanding of the natural world and informing public decision-making.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project will collaboratively design, test and study effective and efficient ways to develop embedded assessments (EAs) of citizen science (CS) volunteer scientific inquiry skills in order to better understand the impact of these CS experiences on volunteer scientific inquiry abilities. EAs are assessment activities that are integrated into the learning experience and allow learners to demonstrate their competencies in an unobtrusive way. The acquisition of scientific inquiry skills is an essential, even defining, characteristic of citizen science experiences that has a direct influence on data quality. Methods for assessing the direct impact of CS on volunteers' scientific inquiry skills are limited. The project will result in EA measures designed for use by diverse CS projects, strategies that CS projects can use to develop EA assessment tools, and research findings that document opportunities, supports and barriers of this innovative method across a range of CS contexts. Findings and initial resources will be shared with the broad array of stakeholders in CS through conferences, workshops, peer-reviewed publication, community websites and other relevant venues. The results of this work also have the potential to generalize to other informal science learning experiences that engage the public in science The project will address two research questions: (1) What processes are useful for developing broadly applicable EA methods or measures? and (2) What can we learn about gains in volunteers' scientific inquiry skills when citizen science organizations use EA? These will be addressed through design-based research focused on two streamlining strategies. For the reframing data validation strategy, six leaders from five established citizen science projects will conduct secondary analyses of their existing databases to uncover the skill gains of CS volunteers that are currently unexplored in their data. For the common measure strategy, ten CS projects will collaborate to create and test common EA measures of select identification-based skills. Data will be gathered through meeting notes, participant interviews and action plans, and volunteer skill gains to capture process and products of each strategy. Data will be analyzed using grounded theory, multiple process techniques, multilevel models, and repeated-measures analysis of variance. The design-based-research framework will significantly expand project impacts by jump-starting evaluation of the participating CS projects and by producing initial resources for two distinct EA strategies that have the potential to dramatically alter practice and impact citizen science efforts to ultimately enable more people to learn by contributing to the science endeavor. The project will directly equip the 15 participating citizen-science projects with authentic performance tools to assess the quality of their programing, which will expand their understanding of CS volunteer skills and help them better recruit and support their varied audiences (including rural, low-income and tribal communities).
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. The project plans to deliver and improve a constructivist professional development (PD) program called Remake Making for library staff that work with youth in maker spaces. The proposed project will be led by a team at the University of Pittsburgh and builds on a pilot facilitation framework developed in an earlier project by this team. The PD program responds to the rapid growth of makerspaces with a constructivist PD program focused on facilitation. Maker spaces are a new service model in many public libraries, part of a broader shift in general library services. Effective facilitation for learning, like that required in makerspaces, is a relatively new facet of librarianship that is not a consistent part of librarian education or PD. The project will work with two local library systems with libraries that have makerspaces but little to no PD opportunities around facilitation. The project plans to iteratively design and investigate the Remake Making program, its impact on library maker facilitators and their interactions with child and youth learners. This will provide a setting for preliminary research about constructivist PD and the experiences and struggles of staff who facilitate making in libraries within the context of shifting library norms. This project will produce an efficient, maker-friendly PD system for facilitation in makerspaces, applicable to a broad range of informal and formal educators who wish to incorporate facilitated making.
The project plans to conduct an iterative development process involving several cohorts of participants and using multiple data sources which include embedded PD workshop data, participant pre-post surveys, observation of library makerspaces, and interviews/focus groups. A participatory approach will be employed by involving participants in creating and refining research questions within the scope of the project. This approach is designed around inquiry-based improvement, which is experienced by participants as reflective practice or continuous improvement. The proposed project aims to advance knowledge and PD strategies for facilitation in library makerspaces. The research will build knowledge about the efficacy of an innovative constructivist PD program with adaptation as a key feature. The data collected in the context of the development of this innovation will provide opportunities for applied research about informal STEM learning in the context of library maker spaces, and the role that library staff play in facilitating this type of learning.
As part of its overall effort to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program, seeks to advance new approaches to, and evidence-based understanding of, the design and development of science, technology, engineering, and mathematics (STEM) learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. In alignment with these aims, the University of Washington will design and pilot an innovative leadership development program, NextGen Broadening Participation in ISE Professional Learning Program, to develop the leadership capacity of mid-career professionals, primarily from underrepresented groups in STEM, whose work focuses on broadening participation in informal STEM education (ISE). Unlike most existing ISE leadership models, this pathways project will employ a bottom-up, iterative design approach to engage program participants and garner new insights. Formative data and analysis will be used to better understand the broadening participation context, inform the model, and develop strategies and resources necessary to best support a more diversified next generation of ISE leaders. This pilot study is timely and significant. There is currently a substantial dearth of literature on the intersection between broadening participation and mid-level professional leadership development. Likewise, there are few comparable models in the current AISL portfolio. As such, the findings from this pilot will address critical gaps in the AISL portfolio and in the field, at large. It has the potential to markedly transform the capacity and impact of next generation ISE leaders. Over an eighteen-month period, this feasibility study will design, implement and test key aspects of the model to determine its potential for short and long term success. Using a competitive application process, twenty ISE mid-career professionals, who work primarily within broadening participation in STEM contexts, will be recruited to participate in the NextGen Broadening Participation in ISE Professional Learning Program. The year-long program includes four core components: (a) 4-day workshop, (b) four online webinars, (c) pilot projects carried out in participants' home institutions, and (d) poster presentations of projects at a national conference. A small cohort of faculty-mentors -- leaders from both research and practice in ISE broadening participation efforts -- will serve as participant mentors and play an integral role in the design and implementation of the program. Evaluative efforts will focus on documenting the efficacy of the design strategies (ex., recruitment, mentorship, social networking), the interests, needs, and professional growth of participants and the implications for broadening participation in STEM. The evaluation will be informed by data collected via interviews, surveys, focus groups, observations, content analyses of discourse, and participant deliverables. Formative and summative external evaluations will be conducted by the Garibay Group.
The Exploratorium, in collaboration with the city of San Francisco, the Tenderloin and Civic Center communities, and national museum-community partners, are excited to announce Middle Ground: Experiments in Urban Social Science (fka Street Smarts), a project to bring research on social psychology to public urban environments. Middle Ground combines recent work by the Exploratorium in social science exhibitry and urban learning spaces to develop a novel contribution to science learning in public spaces. The project will produce an outdoor learning installation in front of San Francisco City Hall that will serve the exceptionally diverse audiences that frequent the area. The installation will be populated with exhibits that engage this public in social observation and participatory experiences, promoting learning about the science of social polarization, social dilemmas, and social norms. The project will also produce an online "Guide to People Watching" for the general public, with additional materials to support professionals in the creation of social science learning experiences. The project will be supported by a community of practice of professionals engaged in educational place-making. Finally, Middle Ground will produce new research on how to design experiences that prompt structured, quasi-scientific social observation skills and foster empathy for the social experience of others.
Video has become a key tool for scientific communication because it increases the outreach and impact of projects, furthers scientific research within and across fields of study, and offers an accessible medium to engage the public in the understanding of science. This project supports the expansion of an interactive, online STEM Videohall where hundreds of NSF-funded researchers share their work through brief video narratives and interactive discussion. While the Videohall is accessible year-round, periodic annual Showcase events are used to drive visitors to the site where they can engage with one another, the project investigators and trained facilitators. The Videohall is a multiplier of NSF's investments in individual projects because it allows STEM education researchers to become aware of, and learn from, related work that is funded across NSF programs and directorates, and other federal agencies. In 3-minute video narratives, investigators share ideas, resources, data, evidence of impact, strategies and challenges. The Videohall platform supports open access and is designed to foster communication in ways that scale beyond traditional formats such as academic conferences. Moreover, because the online STEM Videohall is open to the public, it allows STEM investigators to share their work with multiple stakeholder communities including K-12 educators and school leaders, informal educators and community organizations, the STEM industry, education policy makers and families. Finally, because each video narrative is accompanied by a facilitated online discussion thread, investigators have a unique and valuable mechanism for receiving feedback from these various stakeholder communities. The STEM Videohall project is funded by the Discovery Research K-12 program (DRK-12), which seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.
This project brings together seven NSF-funded resource centers who work with their respective communities to encourage Principal Investigators to share video narratives of their work through annual NSF STEM Showcase events. Each annual Showcase event presents videos created by 150-230 projects; many of the projects are affiliated with one of the seven resource centers, but others are from projects across NSF directorates and beyond. During a one-week period, Principal Investigators, their project staff, as well as the public at large, are invited to engage in interactive discourse, providing queries, comments, and feedback. Participants also vote for favorite presentations through "Presenters' Choice," "Public Choice," and "Facilitators' Choice," processes. This participant voting system serves to increase engagement and enhances outreach of the event through social media. After the one-week Showcase event concludes, all of the videos along with the related discourse remain available to the public online, who continue to access the Showcase throughout the year. Based on prior pilot work, it is estimated that over the course of a year, over 30,000 visitors, from over 150 countries, will engage with each annual Showcase. Videos from annual showcase events will be shared, reused, and repurposed to create new products with new constituencies. The project includes technical development efforts to iteratively improve its interactive platform, outreach efforts before each annual Showcase event, facilitation of the week-long event, and intensive dissemination efforts. A research component examines the extent of participation on various constituencies, the benefit of participation to projects, and the success of the events in terms of dissemination nationally and internationally.
This longitudinal research study will contribute to a broader understanding of the pathways of STEM-interested high school students from underrepresented groups who plan to pursue or complete science studies in their post-high school endeavors. The project will investigate the ways that formative authentic science experiences may support youth's persistence in STEM. The study focuses on approximately 900 urban youth who are high interest, high potential STEM students who participate in, or are alumni of, the Science Research Mentoring Program. This program provides intensive mentoring for high school youth from groups underrepresented in STEM careers. It takes place at 17 sites around New York City, including American Museum of Natural History, which is the original program site. Identifying key supports and obstacles in the pathways of high-interest, under-represented youth towards STEM careers can help practitioners design more inclusive and equitable STEM learning experiences and supports. In this way, the project will capitalize on student interest so that students with potential continue to persist.
In order to understand better the factors that influence these students, this research combines longitudinal social network and survey data with interviews and case studies, as well as an analysis of matched student data from New York City Public Schools' records. The research questions in the study are a) how do youths' social networks develop through their participation in scientists' communities of practice? b) what is the relationship between features of the communities of practice and youths' social networks, measures of academic achievement, and youths' pursuit of a STEM major? and c) what are the variations in youth pathways in relationship to learner characteristics, composition of social networks, and features of the community of practice? The research design allows for a rich, layered perspective of student pathways. In particular, by employing social network analysis, this study will reveal relational features of persistence that may be particularly critical for underrepresented youth, for whom STEM role models and cultural brokers provide an otherwise unavailable sense of belonging and identity in STEM. The study will also access a New York City Public Schools data set comprised of student-level records containing biographical and demographic variables, secondary and postsecondary course enrollment and grades, exam scores, persistence/graduation indicators, linked responses to post-secondary surveys, and post-education employment records and wages. These data enable examination of inter-relationships between in-school achievement and out-of-school STEM experiences through comparison of program participants to similar non-participant peers. This project is supported by NSF's EHR Core Research (ECR) program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field.
The Growing Beyond Earth Project (GBE) is a STEM education program designed to have middle and high school students conduct botany experiments, designed in partnership with NASA researchers at Kennedy Space Center, that support NASA research on growing plants in space. GBE was initiated by Fairchild Tropical Botanic Garden in collaboration with NASA's Exploration Research and Technology Programs and Miami-Dade County Public School District. Project goals are to: (1) improve STEM instruction in schools by providing authentic research experiments that have real world implications through curricular activities that meet STEM education needs, comprehensive teacher training, summer-long internships and the development of replicable training modules; (2) increase and sustain youth and public engagement in STEM related fields; (3) better serve groups historically underrepresented in STEM fields; and (4) support current and future NASA research by identifying and testing new plant varieties for future growth in space. During the 2016-17 academic year, 131 school classrooms participated in the program. To date, students have tested 91 varieties of edible plants and produced more than 100,000 data points that have been shared with the researchers at KSC.
This proposal was submitted in response to EHR Core Research (ECR) program announcement NSF 15-509. The ECR program of fundamental research in STEM education provides funding in critical research areas that are essential, broad and enduring. EHR seeks proposals that will help synthesize, build and/or expand research foundations in the following focal areas: STEM learning, STEM learning environments, STEM workforce development, and broadening participation in STEM. The ECR program is distinguished by its emphasis on the accumulation of robust evidence to inform efforts to (a) understand, (b) build theory to explain, and (c) suggest interventions (and innovations) to address persistent challenges in STEM interest, education, learning, and participation.
The study will investigate the processes that connect gestures and mathematics learning. Gestures are an important yet under-investigated aspect of mathematics teaching. They can influence students' memory and understanding of mathematical representations. The series of studies will examine students' learning of the concept of mathematical equivalence by testing instruction that incorporates commonly used verbal explanations and gestures. Mathematical equivalence includes understanding the meaning of the equal sign and determining if two expressions are equal. Second and third grade children will be participants. Of particular interest in the studies is the influence of gestures on preexisting knowledge of procedures, how gestures support learning beyond emphasizing information and direct learners' attention, and the creation of procedural knowledge.
The series of experimental studies will examine the mechanisms that connect gestures and procedural understanding of mathematical equivalence. The studies begin in the first phase with examining how gesture is connected to procedural knowledge of mathematical equivalence. Subsequent studies investigate how gesture functions as a mechanism for learning beyond emphasizing or directing attention to relevant information. Data collected will students' responses to equivalence problems and eye tracking data to follow whether students are looking from one side of the equal sign to the other. In the second phase of the work, the studies will examine how gesture has beneficial effects on learning more generally in mathematics. Working memory will be assessed in order to examine the role of gesture across different individuals. Fraction tasks will be used to examine the generalization of the previous results regarding gestures to other mathematics concepts.
Education stakeholders from advocates to developers are increasingly recognizing the potential of science games in advancing student academic motivation for and interest in science and science careers. To maximize this potential, the project will use science games (e.g. Land Science, River City, and EcoMUVE), shown to be enjoyable to students and proven to promote student learning in science at the middle school level. Through a two-phase process, games will be used as vehicles for learning about ways to change how students think about science and potentially STEM careers. The goal of the intervention is to explore which processes and design features of science games will actually help students move beyond a temporary identity of being a scientist or engineer (as portrayed while playing the game) to one where students began to see themselves in real STEM careers. Students' participation will be guided by teams of teachers, faculty members, and graduate students from Drexel University and a local school. All science students attending the local inner city middle school in Philadelphia, PA, will participate in the intervention.
Using an exploratory mixed-method design, the first two years of the project will focus on exploring, characterizing, coding, and analyzing data sets from three large games designed to help students think about possible careers in science. During year 3, the project will integrate lessons learned from the first two years into the existing middle school science curriculum to engage students in a one-year intervention using PCaRD (Play Curricular activity Reflection Discussion). During the intervention, the PI will work with experts from Drexel University and a local school to collect data on the design features of Land Science to capture identity change in the science identity of the participating students. Throughout the course of year 3, the PI will observe, video, interview, survey, and use written tasks to uncover if the Land Science game is influencing students' identity in any way (from a temporary to a long-term perspective about being a scientist or engineer). Data collected during three specified waves during the intervention will be compared to analyses of existing logged data through collaborations with researchers at Harvard University and the University of Wisconsin-Madison. These comparisons will focus on similar middle-aged science students who used the same gaming environments as the students involved in this study. However, the researcher will intentionally look for characteristics related to motivation, science knowledge, and science identity change.
This project will integrate research and education to investigate learning as a process of change in student science identity within situated environmental contexts of digital science gameplay around curricular and learning activities. This integrated approach will allow the researcher to explore how gaming is inextricably linked to the student as an individual while involved in the learning of domain specific content in science. The collaboration among major university and school partners; the expertise of the researcher in educational psychology, educational technology, and science games; and the project's advisory board makes this a real-life opportunity for the researcher to use information that naturally exists in games to advance knowledge in the field about the value of gaming to changing students' science identities. It also responds to reports by the National Research Council committee on science learning and computer games, which identifies games as having the potential to catalyze new approaches to science learning.
Recharge the Rain moves sixth through twelfth grade teachers, students and the public through a continuum from awareness, to knowledge gain, to conceptual understanding, to action; building community resiliency to hazards associated with increased temperatures, drought and flooding in Arizona. Watershed Management Group with Arizona Project WET will utilize NOAA assets and experts from the National Weather Service and Climate Assessment for the Southwest (CLIMAS) to inform citizens and galvanize their commitment to building a community, resilient to the effects of a warming climate. Project activities will be informed by Pima County’s hazard mitigation plan and planning tools related to preparing for and responding to flooding and extreme heat. Starting January 2017, this four-year project will 1) develop curriculum with Tucson-area teachers that incorporates systems-thinking and increases understanding of earth systems, weather and climate, and the engineering design of rainwater harvesting systems 2) immerse students in a curricular unit that results in the implementation of 8 teacher/student-led schoolyard water harvesting projects, 3) train community docents in water harvesting practices and citizen-science data collection, 4) involve Tucson community members in water harvesting principles through project implementation workshops, special events, and tours, and 5) expand program to incorporate curriculum use in Phoenix-area teachers’ classrooms and 6) finalize a replicable model for other communities facing similar threats. Environmental and community resiliency depends upon an informed society to make the best social, economic, and environmental decisions. This idea is not only at the core of NOAA’s mission, but is echoed in the programs provided by Watershed Management Group and Arizona Project WET.