Summative evaluation of the Marcellus Matters: EASE project. Marcellus Matters: Engaging Adults in Science and Energy (EASE) was a program of Penn State University’s Marcellus Center for Outreach and Research (MCOR), in collaboration with other experts across the university. The first year of program activities took place in 2012, and the project continued through September 2016. EASE was a multidisciplinary initiative that provided adults in rural Pennsylvania with opportunities to increase their knowledge of science and energy systems and engage in scientific inquiry and investigation
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) developed, implemented, and evaluated the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through this grant, the NCBYS extended opportunities for informal science learning for the direct benefit of blind students by conducting six NFB STEM2U regional programs included programs for blind youth, their parents/caregivers, blind teen mentors (apprentices), and museum educators.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
In 2012, the Conner Prairie Interactive History Park began work on the National Science Foundation-funded Prairie Science project. Its goal: to produce a framework for integrating informal science experiences into exhibitions, interpretation, and programs at historic sites and museums. From the outset, the core project team acknowledged that the task of integrating STEM (Science, Technology, Engineering, and Math) and history learning would challenge the norms of both disciplines and institutions. Conner Prairie is a history museum in Fishers, Indiana, with a long tradition of exploring novel
The Virginia Institute of Marine Science (VIMS) and The Watermen's Museum, Yorktown, VA, will produce an underwater robotics research and discovery education program in conjunction with time-sensitive, underwater archeological research exploring recently discovered shipwrecks of General Cornwallis's lost fleet in the York River. The urgency of the scientific research is based upon the dynamic environment of the York River with its strong tidal currents, low visibility, and seasonal hypoxia that can rapidly deteriorate the ships, which have been underwater since 1781. Geophysical experts believe that further erosion is likely once the wrecks are exposed. Given the unknown deterioration rate of the shipwrecks coupled with the constraints of implementing the project during the 2011-2012 school-year, any delays would put the scientific research back at least 18 months - a potentially devastating delay for documenting the ships. The monitoring and studying of the historic ships will be conducted by elementary through high school-aged participants and their teachers who will collect the data underwater through robotic missions using VideoRay Remotely Operated Vehicles (ROVs) and a Fetch Automated Underwater Vehicle (AUV) from a command station at The Watermen's Museum. Students and teachers will be introduced to the science, mathematics, and integrated technologies associated with robotic underwater research and will experience events that occur on a real expedition, including mission planning, execution, monitoring, and data analysis. Robotic missions will be conducted within the unique, underwater setting of the historical shipwrecks. Such research experiences and professional development are intended to serve as a key to stimulating student interest in underwater archeological research, the marine environment and ocean science, advanced research using new technologies, and the array of opportunities presented for scientific and creative problem solving associated with underwater research. A comprehensive, outcomes-based formative and summative, external evaluation of the project will be conducted by Dr. L. Art Safer, Loyola University. The evaluation will inform the project's implementation efforts and investigate the project's impact. The newly formed partnership between the Waterman's Museum and VIMS will expand the ISE Program's objectives to forge new partnerships among informal venues, and to expand the use of advanced technologies for informal STEM learning. Extensive public dissemination during and after the project duration, includes but is not limited to, hosting an "Expedition to the Wrecks" web portal on the VIMS BRIDGE site for K-12 educators providing real-time results of the project and live webcasts. The website will be linked to the education portal at the Association for Unmanned Vehicle Systems International, the world's largest organization devoted to promoting unmanned systems and to the FIRST Robotics community through the Virginia portal. The website will be promoted through scientific societies, the National Marine Educators Association, National Science Teachers Association, and ASTC. Links will be provided to the Center for Archeological Research at the College of William and Mary and the Immersion Presents web portal--consultants to Dr. Bob Ballard's K-12 projects and JASON explorations. The NPS Colonial National Historic Park and the Riverwalk Landing will create public exhibits about the shipwreck's archeological and scientific significance, and will provide live observation of the research and the exploration technologies employed in this effort.
This is an overview of audience research and evaluation pertaining to the exhibition "Living With Hurricanes: Katrina and Beyond". The process of investigating the perceptions of audiences and visitors was mostly designed to inform the interpretive planning process. Then, after the exhibit opened to the public in late October 2010, the intent was to describe and assess the experiences of visitors. Ten audience/visitor studies were conducted over a seven-year period, five of which were designed to inform the planning process and five of which were conducted after the exhibition opened to
The research presented in this report was the tenth and final study in a multi-phase evaluation plan for “Living With Hurricanes: Katrina and Beyond,” an exhibition created by the Louisiana State Museum and installed at the Presbytere building. The exhibition opened in October 2010; a remedial evaluation was conducted in November 2010; the summative evaluation was conducted in the spring and summer of 2011; preparations for this longitudinal study began in the fall of 2011, the telephone interviews were conducted in the spring of 2013. Results from this analysis indicate that “Living With
DATE:
TEAM MEMBERS:
Louisiana State MuseumJeff HaywardJolene Hart
The purpose of this Summative Evaluation was to assess visitors’ use and perceptions of ‘Living with Hurricanes: Katrina & Beyond’ at the Louisiana State Museum (LSM) as an informal science experience. The exhibition is distinctive in that it is presented in a museum which has been primarily focused on history. The overall experience, affective impact and learning were evaluated for visitors leaving the exhibition. More specific questions of science learning were evaluated in mini-studies in Room 3. This report also examines the degree to which emotion affects informal learning in the museum
The Lemelson Center for the Study of Invention and Innovation at the Smithsonian’s National Museum of American History (NMAH) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a formative evaluation for Places of Invention, an exhibition funded by the National Science Foundation. The exhibition aims to stimulate visitors’ thought about how people, resources, and spaces work together to support invention in historic and modern communities. Through formative evaluation, RK&A explores visitors’ use of exhibition prototypes (including barriers to use) and the meanings visitors take away
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Lemelson Center for the Study of Invention and InnovationNational Museum of American HistorySmithsonian Institution
This report presents front-end evaluation findings at the North Carolina Transportation Museum. The study was conducted to assist with the formidable task of programming the 110,000-square-foot roadhouse and to provide data for researchers and exhibit designers. Front-end evaluation goals included: (1) determine if pre-existing or natural traffic flow patterns were present in the roundhouse; (2) evaluate visitor interest in proposed research topics; and (3) obtain visitor reactions, insights, attitudes and expectations concerning proposed roundhouse programming.
In this article, Stephen L. Gerritson of Economic Research Associates discusses a study conducted by the Iron Range Interpretive Center to learn more about its visitors. This museum of mining history and ethnic heritage in Chisholm, Minnesota conducted intercept surveys in the summer of 1986 to better understand visitor demographics, visitor expectations, and the visitor experience.