This project will bring STEM content knowledge to visitors to Cuyahoga Valley National Park via mobile device applications. Visitors will be able to use their mobile phones to access details about Park features (such as where they are in the park, what they are looking at, and where are related features), supporting just-in-time STEM learning. Cuyahoga Valley National Park receives around 2.5 million visitors every year and experiences multitudes of inquiries. Until this project, visitors were subjected to less than optimum signage for information and background about a given feature that may or may not be of interest to them. In this project, knowledge building information will be selected by the visitors and delivered to them with convenience and speed. The data base supporting this effort will provide the visitor with identification and the history of park features as well as more in depth knowledge building information while they are in the park and after the leave, providing a more holistic experience than is currently available. The investigators will build the system in parts, testing the feasibility at each stage and evaluating affective and cognitive outcomes of each portion. Research questions that will be addressed in the course of this project include: (1) What outcomes associated with use of this GPS-base system could inform future development and implementation? and (2) What contributions do these GPS-based mobile learning applications have on informal science learning as understood within the Six Strands of Informal Science Learning? It is expected knowledge generated in this project will stimulate additional programing for increasing efficacy and use in other widely ranging venues. If successful, it is easy to imagine how this STEM knowledge-building application could be extended for use in other venues across the country.
DATE:
-
TEAM MEMBERS:
Richard FerdigRuoming JinPatrick LorchAnnette Kratcoski
This project is making novel use of familiar technology (smartphones and tablets) to address the immediate and pressing challenge of affordable, ongoing, large-scale museum evaluation, while encouraging museum visitors to engage deeply with museum content. Using a smartphone app, museum visitors pose questions to a 'virtual scientist' called Dr. Discovery (Dr. D). Dr. D provides answers and the chance to complete fun mini-challenges. The questions visitors ask are gathered in a large database. An analytics system analyzes these data and a password-protected website provides continuous, accessible evaluation data to museum staff, helping them make just-in-time tweaks (or longer term changes) to exhibit-related content (such as multimedia, lecture topics, docent training, experience carts, etc.) as current events and visitors' needs and interests change. The intellectual merit of this project is that it is building evaluation capacity among informal educators, advancing the fields of visitor studies, museum evaluation, informal science learning, and situated engagement, and is contributing to the development of novel evaluation techniques in museums. This project has many broader impacts: The Ask Dr. Discovery system is available to any venue that wishes to use or adapt it to their context. By enhancing the visitor experience and improving museum access to data for evaluation and data-driven decision making across the country, Ask Dr. Discovery has both a direct and indirect impact on museums and visitors of all types. This project is also training the next generation of STEM and education innovators by employing a diverse team of undergraduate students.
The Cyberlearning and Future Learning Technologies Program funds efforts that will help in envisioning the next generation of learning technologies and advancing what we know about how people learn in technology-rich environments. Development and Implementation (DIP) Projects build on proof-of-concept work that showed the possibilities of the proposed new type of learning technology, and project teams build and refine a minimally-viable example of their proposed innovation that allows them to understand how such technology should be designed and used in the future and answer questions about how people learn with technology. Although for years researchers have believed technology could afford anytime-anywhere learning, we still don't understand how learners behave differently across contexts, such as home, school, and in the community, and how to get youth to identify as learners across those contexts. This proposal aims to use mobile devices and strategically placed shared kiosks to 'scientize' youth in two low-income communities. Through strategic partnerships with community organizations, educators, and families, the innovation is to get primary and middle-school students engaging in scientific inquiry in the context of their neighborhoods. Research will help determine how the technology can best be deployed, but also answer important questions about how communities can provide support to help kids think like scientists and identify with science. This project will design and implement ubiquitous technology tools that include mobile social media and tangible, community displays (collectively called ScienceKit) that are deeply embedded into two urban neighborhoods, and demonstrate how such ubiquitous technologies and related cyberlearning strategies are vital to improve information flow and coordination across a neighborhood ecosystem, in order to create environments where children can connect their science learning across contexts and time (e.g. scientizing). A program called ScienceEverywhere comprised of partnerships between tightly connected neighborhood organizations with mentors, teachers, parents, and researchers will help learners develop scientifically literate practices both in and out of school, and will demonstrate students' learning to their communities. Research will consist of mixed methods studies of use of the tools, including iterative design-based research, ethnography, and the use of participant observers from the community; these will be triangulated with usage logs of the technologies and content analysis of microblogs by the learners on their identities and interests. Discourse analysis of interviews with focal learners will orient the qualitative work on identity development, and analysis using activity theory will inform the influences of the social practices and sociotechnical systems on learner trajectories. Formative evaluation will help shed light on if and how the sociotechnical system promotes STEM literacy and STEM identity development.
The Cyberlearning and Future Learning Technologies Program funds efforts that support envisioning the future of learning technologies and advancing what we know about how people learn in technology-rich environments. Development and Implementation (DIP) Projects build on proof-of-concept work that shows the possibilities of the proposed new type of learning technology, and PI teams build and refine a minimally-viable example of their proposed innovation that allows them to understand how such technology should be designed and used in the future and that allows them to answer questions about how people learn, how to foster or assess learning, and/or how to design for learning. This project team aims to explore how to foster learning in socially-networked communities, particularly learning that results in behavior change. Understanding how to foster such learning could have a wide variety of societal impacts, e.g., better fostering science, engineering, mathematical, or design thinking in school or college or on the job, fostering healthy behaviors, helping teens develop pro-social behaviors, and helping people learn to make environmentally-friendly choices as they live their lives. In previous work, this team has developed YardMap, an infrastructure for citizen science that brings together retired adults who are interested in planting and managing their yards in environmentally-friendly ways. YardMap enables social interactions and shared creation of virtual worlds in which participants can try out different ways of managing their yards and see what the downstream effects will be. They also track and display their changing practices and actual yards in ways that are visible to others. YardMap is used by many thousands of participants. In this project, the team is taking YardMap to the next level, using what is known about how people learn and come to change their behaviors to design and refine ways to more directly support individuals in critiquing and improving their behaviors and designs for the common good. What can be learned from the new YardMap will be useful in other fields that focus on helping people change their behaviors in productive ways. The PIs seek to explore how people learn and how to foster learning in socially-networked citizen science communities. Their research addresses how learning happens, how to foster learning, how to design to increase social activity, and how increased interaction with others elevates interest, generates knowledge, and leads to behavior change. Their technological innovation, an infrastructure for citizen science that fosters behavior change, builds on YardMap, an existing infrastructure for citizen science around environmental issues that allows collective data collection and analysis and supports interactive graphing and mapping. Participants design and refine ways of managing their yards in ways that take into account environmental concerns. YardMap enables social interaction and co-creation of a set of virtual worlds for trying out new ideas; learners who are part of the community interact with others in the community, create and refine virtual worlds together, interact with things in the virtual world, manipulate those worlds and collect and analyze data about outcomes, and discuss visual objects that represent real things and practices. As well, individuals track and display their changing practices and actual yards in ways that are visible to others. YardMap can be thought of as a maker movement community focused on yard maintenance; like other maker communities, it encourages participants to create, share and discuss new inventions and practices in a social-networked community setting. Using both what is known about learning in communities and what is known about social drivers of interaction, the team is is extending YardMap to focus on fostering learning and investigating the relationships between learning and behavior change and the influences each has on the other. Much will be learned about how to use social interactions in positive ways to help individuals become more comfortable with behaviors they need to or should take on for health, civic, or educational reasons. What is learned and the technological infrastructure that is created will be directly applicable to other situations where individual behavior changes are needed for change to happen in a social system (e.g., environmental action, changing the culture of an organization, changing norms in a community, perhaps even creating learning communities in formal on-line courses).
This project will help address the urgent need for a new engineering workforce. Middle school students will be entering a workforce that is increasingly global. They will need not only technical skills but also global competencies including: the ability to investigate the world, recognize perspectives, communicate ideas, and take action. This model integrates engineering with global competencies and will provide new knowledge about how this type of learning experience impacts students and educators. This project builds on the success of the previous Design Squad project funded by NSF and developed by WGBH, which has implemented a national model for engineering education for middle school youth. This project expands the model internationally, connecting U.S. based youth with those in Southern Africa (including South Africa, Botswana, and Swaziland). The project partners are FHI 360, a non-profit organization in 60 countries around the world that helps build capacity for improving lives. They will facilitate the implementation of the afterschool programs in Southern Africa . The US dissemination partners include Promise Neighborhoods Institute, Middle Start, Every Hour Counts, and the National Girls Collaborative Project. Project deliverables include a global engineering curriculum; a web platform with videos, games, activities; an afterschool Club Guide; and a Community of Practice for informal engineering educators. A knowledge building component will provide new evidence on how high quality accessible resources and strategies can impact students' development of global competencies and engineering skills to solve real world problems. An iterative approach will be used to develop the resources including the global engineering afterschool curriculum, Club guide, and other components. The methodology uses a continuous cycle of improvement including: assess/design, test/ implement, synthesize/reflect, and utilize/disseminate. The Summative Evaluation will generate evidence about whether and how this kind of collaborative work builds children's understanding of engineering, motivation to participate, and confidence in taking informed action on behalf of pressing global problems. This will contribute to a larger body of work about whether and how engaging with global, collaborative engineering problems leads to greater self-efficacy for children with very different backgrounds, experiences, and opportunities. This project will add new knowledge about how the well-honed Design Squad model in the U.S. can be expanded with a global context and global partners. This proposal was co-funded by EHR/DRL, Engineering/EEC, and International Science and Engineering. During the project period approximately 125,000 children in the US and 5000 children in southern Africa will be reached. In the long term, with the continued global access to the resources, the reach will potentially be in the millions.
The Cyberlearning Resource Center (CRC) has responsibility for promoting integrative collaboration among cyberlearning grantees (across NSF programs); synthesis and national dissemination of cyberlearning findings, technologies, models, materials, and best practices; creating a national presence for Cyberlearning; helping the disparate Cyberlearning research and development communities coordinate efforts to build capacity; and providing infrastructure (technological and social) for supporting these efforts. Monitored through the Cyberlearning: Transforming Education program, the CRC serves as a resource for all NSF grantees and programs with cyberlearning components, helping to promote synergy and integrate projects across NSF's cyberlearning investments. Among society's central challenges are amplifying, expanding, and transforming opportunities people have for learning and more effectively drawing in, motivating, and engaging young learners. Engaging actively as a citizen and productively in the workforce requires understanding a broad variety of concepts and possessing the ability to collaborate, learn, solve problems, and make decisions. Whether learning is facilitated in school or out of school, and whether learners are youngsters or adults, to develop such knowledge and capabilities, learners must be motivated to learn, actively engage over the long term in learning activities, and put forth sustained cognitive and social effort. Consistent with NSF's mission and strategic plan, a variety of programs at NSF invest in research aimed towards achieving these goals. In support of this important thematic thrust, the Cyberlearning Resource Center works with researchers and NSF program officers to identify and disseminate findings from across programs and projects; develop ways to broker productive partnerships and collaborations; convene meetings for purposes of envisioning the future, integrating findings, and building capacity,; and monitor the cyberlearning portfolio and its influences and impacts.
This project will research factors influencing the implementation of programs designed to increase diverse participation in informal science. The goal is to provide the informal science education field with information and tools that will help them design effective programs that more effectively engage a broad range of diverse audiences. The project has two major components. First, the project will research the implementation of a citizen science project, Celebrate Urban Birds (CUB), in major U.S. cities. Citizen science projects involve public volunteers in gathering scientifically valid data as part of ongoing research. Second, building on results of the research, the project will launch a website and learning community (called a Community of Practice or CoP) supporting informal science educators that are involved in designing and implementing informal science programs with an emphasis on engaging diverse participants. The project will be lead by the Cornell Lab of Ornithology (CLO), a leader in designing and researching citizen science projects, in collaboration with the Association of Science-Technology Centers (ASTC) and five science center members of ASTC, where the CUB program will be implemented and researched. The objective of the research is to better understand contextual factors and how they impact implementation even when accepted practices are followed. Such research is key not only to revealing accepted practices but also to understanding how projects are implemented in the face of concrete operational, cultural, economic, and demographic variables. The research will use a comparative case study approach, which is designed for studies requiring holistic, in-depth investigation. The development of the website and the CoP will be guided by a Network Improvement Strategy, a research-based approach to designing educational CoPs. The development of the CoP will involve the project stakeholders including the informal science organization practitioners, community organization representatives, CUB staff, ASTC staff, advisors and consultants. This strategy will allow the project team and pilot sites to leverage their diverse experiences and skill sets to improve practice; provide space for researchers and practitioners to work together as partners; and develop a nuanced set of strategies that can be implemented across a variety of organizational contexts.
Project TRUE (Teens Researching Urban Ecology) was a summer research experience for New York City youth that focused on strengthening their STEM interest, skills, and ultimately, increasing diversity in STEM fields. Through a partnership between an informal science institution (the Wildlife Conservation Society) and a university (Fordham University), 200 high school students conducted urban ecology research at one of four zoos in New York City under the guidance of STEM mentors. A unique feature of Project TRUE was its near-peer mentorship model, in which university professors mentored graduate urban ecology students, who mentored undergraduate students, who mentored high school students Science research projects focused on urban ecology topics, with high school students identifying their own research questions that were nested within the undergraduate mentor’s larger research question, thereby establishing a sense of ownership. Youth collected and analyzed their own data and the experience culminated in the creation of research posters, with teams presenting their posters to the public at a student science symposium.
This project was funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. We studied the impacts of two key parts of the program – conducting authentic science research and near-peer mentorship – on the STEM trajectories of almost 200 high school students who participated in the program from 2015 to 2018. The research explored short-term outcomes immediately after the program and followed up with students multiple years after participation to understand the medium-term impacts of the experience during and after the transition from high school to college.
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.
This project will bring STEM education to rural communities through local public libraries. Museum quality exhibits labelled as "Discover Earth", "Discover Technology", and "Discover Space" will spend 3 months at a series of locations around the Nation. Twenty four medium sized libraries will be chosen for the large exhibits and forty small libraries will be chosen for scaled down versions. The project's intent is to provide exhibits in every state and to reach as many under-represented individuals as possible. The significance of this project is that rural areas of this country are underserved regarding STEM education and since this segment of society is represented by 50-60 million residents, it is important to reach out to them. There is a significant segment of the Nation's population (50-60 million) that is underserved by out-of-school learning venues such as museums and science centers. An earlier phase 1 project demonstrated at 18 sites that rural libraries and librarians could provide STEM education to community members ranging in age from adults to children using these hands-on exhibits. Each exhibit (earth, space or technology) includes information about the topic and technologically enabled models to provide interesting and fun discovery mechanisms. They use common layman friendly language that highlights the most recent discoveries in each area. Each exhibit will be placed in the selected library for 3 months during which the library will organize events to feature and advertise the STEM learning opportunities. Another feature of this project will be to determine the models of learning in library settings and as a function of the demographics. The partners in this project that bring the necessary expertise are the American Library Association, the Afterschool Alliance, the Association of Rural and Small Libraries, the University of Colorado Museum, Datum Advisors, LLC, Evaluation and Research Associates, the Lunar and Planetary Institute, the American Geophysical Union, and the Space Science Institute.
This early-stage design and development, integrated media and research project will contribute important new understandings to the informal science learning literature by exploring science engagement on social media when integrated with broadcast television. It will help answer questions including: What does such engagement look like? Who participates? How and why does it happen? and What is the degree or depth of engagement? The project builds on the previous successful work by WGBH nationally distributing the television series NOVA scienceNOW and the research expertise of EDC. WGBH's NOVA scienceNOW program will collaborate with EDC to develop new metrics to understand how and why learners engage with science on social media. Deliverables will include six one-hour episodes of NOVA scienceNOW, short online videos, moderated online discussion events, and an online film festival. A new social Media Initiative will develop six live broadcast microblogging events, six post-broadcast online discussion events, daily social media updates, and an online film festival that will feature user generated videos. A range of STEM content in the videos and online posts will be framed around big science and engineering questions such as animal communication and survival systems, the biology of sleep, climate change, new technologies, energy, genetics, and natural disasters. The continued innovations and expansion of social media channels provides significant new opportunities for providing learner's access to high quality science content, researchers, and opportunities to participate in science. In the first phase of this work to deepen the evidence based understanding of how social media supports informal science engagement, NOVA and EDC will collaborate to develop new measurement instruments: (1) a Network Profile to quantitatively represent the size and activity of NOVA's social media network; (2) an Informal Science Engagement (ISE) index to measure the degree of engagement by coding and analyzing conversations and posts; (3) a Follower Profile to assess the degree of activity and the nature of the engagement; and (4) a Science Social Media Engagement survey instrument. They will then use these measures and data collection protocols to explore whether and how the initiative might influence science engagement. External expert reviewers with content and methodological expertise will review all aspects of the project at critical junctures. This project will contribute important new knowledge and research instruments and methods to better understand how the learning opportunities of social media channels can be realized most effectively. This has significant potential for broad and lasting benefits to society as well as advancing the informal science learning field.
For over two decades NSF has been investing in the development and evaluation of giant screen films for viewing by audiences in science centers and museums. These have been highly successful in terms of audiences reached and project evaluations that indicate their impact on learning. Less well understood is how the unique attributes of giant screen films (e.g., "immersion" and "presence") affect learners in ways that differ from other film formats. This integrated research and media project will contribute to that knowledge base. Project deliverables will include a giant screen film that tells the story of the discovery of biological mimicry (the critical proof for natural selection and in turn, evolution) through the life story of Henry Bates and his travels through the Amazon rainforest more than 150 years ago; 2D dome, and 2D flat format versions; live interactive science demonstrations and educational resources; and workshops for ISE professionals. The film and the related outreach via science centers, social media, and the web are expected to reach large public audiences; workshops and web resources will reach ISE professionals nationally. A strategy for reaching underrepresented audiences through science museums and partnerships with educational societies is a part of the broadening participation effort. Building on results of an NSF-funded workshop in which researchers, evaluators, and filmmakers began to develop a research agenda to provide evidence about giant screen attributes and their impacts on learning, the research component of this project will focus on the differences in learner knowledge among the various film formats, their unique attributes, and whether format plays a role in science interest and science identity. A baseline study will be conducted to begin gathering evidence on how each of these formats affects learning. Data on audience knowledge gains, interest, and science identity will be collected using a novel tablet-based game-like assessment pre-film viewing, immediately post viewing, and in a later follow-up. These baseline data will inform follow-on research that, over time, can better explain the unique impacts on learning of the giant screen format. Project partners include the Pacific Science Center, SK Films, Howard Hughes Medical Institute, Rutgers University, and Arizona State University.