The Smithsonian’s National Museum of Natural History (NMNH) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a multi-method summative evaluation of Q?rius, an interactive and experimental learning space that brings the unique assets of NMNH—the science, researchers, and collections—out from behind the scenes. Q?rius is designed as a flexible space for walk-in visitors visiting exhibitions at the Museum as well as a program space. Given the breadth of experiences available in the space, the scope of the evaluation specifically targeted walk-in youth and adult visitors to Q?rius.
The Oregon Museum of Science and Industry is implementing a Pathways project that will test and refine a model to promote an appreciation that science is everywhere and personally relevant by engaging transit riders in Portland, OR with location-relevant STEM content through unfacilitated, interactive science exhibits in everyday places. The study will employ a "design-based research" approach that both iteratively tests exhibit effectiveness and develops and refines an underlyting theoretical model that can contribute knowledge to the field. The "Science on the Move" model will be developed and tested using an exhibit prototype that includes 1) an easily transportable prototype core with a familiar touch-screen interface, 2) multiple sets of interactive digital content, and 3) a variety of accompanying outer skins designed to attract the public. The exhibit prototype will be placed at bus transit nodes to reach adults, specifically targeting those without college degrees who are underrepresented in science centers. A range of possible STEM content domains will be selected and tested based on topics of interest to the public. If successful, given the several challenges involved, the feasibility study will be applied more fully around Portland and be a model for other cities to consider.
StarTalk Radio will develop a highly innovative new genre of science radio that bridges the intersection between popular culture and science education. Host of the show and project PI is Dr. Neil deGrasse Tyson, renowned scientist, astrophysicist, popular science author and director of the Hayden Planetarium in New York City. The radio programs will combine comedy, references to pop culture, and public fascination with space science to reach an untapped audience for the informal science field--those who listen to commercial talk radio call-in shows. The STEM content will include astronomy, astrophysics, astrobiology, space exploration, earth system science, and associated technologies. Goals and intended outcomes of the project include increasing knowledge and interest of space science topics, and motivating audiences to pursue additional learning acitivities as the result of listening to the programs. This project builds on a previous SGER grant (#0852400) which produced 13 pilot programs and was evaluated by Multimedia Research. Project deliverables include 39 one-hour live call-in shows a year for a total of 117 shows over three years, a website, and a business strategy that projects making the radio programs self-sustaining. Dr. Tyson will be the host, and each program will include a celebrity guest who has a strong interest in science. The target audience for the show is the "blue collar intellectual" audience segment who listens to commercial talk radio, has a high school education or less and is in the 25-44 year old range. It is estimated that there will be one million listeners per week by the end of the project. People with disabilities (deaf and visually impaired) will have access to the products through captioning and other features on the website. Project partners include CBS Radio, CBS/AOL, and Discover Magazine. Formative evaluation of these new shows and website will be conducted by Multimedia Research. The Goodman Research Group (GRG) will conduct the summative evluation to assess the extent to which the project accomplishes the goals and specifically will gather and analyze data on the previously untappped and underserved audiences. The evaluation will examine the differences in impact on Science Novices and Science Enthusiasts, asking questions about how the programs increase awareness of scientific issues, and their effects on society and culture, as well as factual knowledge. Methods include multi-level, quasi-experimental, and longitudinal episode assessments. Potential impacts on the field of informal science education include opening up a new commercial radio audience for informal science learning, increasing knowledge about effective approaches to combining humor and science, and demonstrating an effective business model that results in a self-supporting show about science on commercial radio.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
Researchers at the American Association of Variable Star Observers, the Living Laboratory at the Boston Museum of Science, and the Adler Planetarium are studying stereoscopic (three-dimensional or 3D) visualizations so that this emerging viewing technology has an empirical basis upon which educators can build more effective informal learning experiences that promote learning and interest in science by the public. The project's research questions are: How do viewers perceive 3D visualizations compared to 2D visualizations? What do viewers learn about highly spatial scientific concepts embedded in 3D compared to 2D visualizations? How are viewers\' perceptions and learning associated with individual characteristics such as age, gender, and spatial cognition ability? Project personnel are conducting randomized, experimental mixed-methods research studies on 400 children and 1,000 adults in museum settings to compare their cognitive processing and learning after viewing two-dimensional and three-dimensional static and dynamic images of astronomical objects such as colliding galaxies. An independent evaluator is (1) collecting data on museum workers' and visitors' perceived value of 3D viewing technology within museums and planetariums and (2) establishing a preliminary collection of best practices for using 3D viewing technology based on input from museum staff and visitors, and technology creators. Spatial thinking is important for learning many domains of science. The findings produced by the Two Eyes, 3D project will researchers' understanding about the advantages and disadvantages of using stereoscopic technology to promote learning of highly spatial science concepts. The findings will help educators teach science in stereoscopic ways that mitigate problems associated with using traditional 2D materials for teaching spatial concepts and processes in a variety of educational settings and science content areas, including astronomy.
Rockman et al (REA), a San Francisco-based research and evaluation firm, conducted the external evaluation for Youth Radio's DO IT! program, which was funded by the National Science Foundation. Building upon Youth Radio's previous Science and Technology Program, the DO IT! initiative consisted of three primary components that promoted STEM (science, technology, engineering, and mathematics) learning by training underserved youth in cutting-edge digital technologies: (1) Brains and Beakers: Young people hosted a line-up of investigators and inventors for demo-dialogues at Youth Radio's studios
DATE:
TEAM MEMBERS:
Rockman et al | Youth RadioKristin BassJulia Hazer
In 2010 EarthSky Communications Inc. was awarded a broad implementation grant from the National Science Foundation (NSF) entitled Proyecto de Implementacion Amplia EarthSky en Español (EarthSky in Spanish Broad Implementation Project). In partnership with the Spanish media company Univision Communications Inc. and a national Advisory Committee of Hispanic scientists, educators, and media experts, EarthSky proposed to present science information and scientist interviews to Spanish-preferring U.S. Hispanics via short video programs distributed on television and the Internet. Under the Broad
DATE:
TEAM MEMBERS:
Knight Williams Inc.Valerie Knight-WilliamsDeborah ByrdRachel TeelDivan WilliamsRoxana HernandezEric AndersonGabriel SimmonsSauleh Rahbari
To better help museum visitors make sense of large data sets, also called “big data”, this study focuses on what museum visitors felt individual layers of a visual (alone and in combination with other layers) were communicating to them as the visual was constructed or deconstructed layer by layer. A second, smaller study, collected data to better understand how adult visitors would construct large data visualizations. This study was concerned with how people make sense of “big data” in their daily lives and how they engage with reference systems. The primary study used four different “big data
The Designing Our World (DOW) project centers on science, technology, engineering, and mathematics (STEM) equity and addresses the need for more youth, especially girls, to pursue engineering and fill vital workforce gaps. DOW will integrate tested informal science education (ISE) programs and exhibits with current knowledge of engaging diverse youth through activities embedded in a social context. Led by teams of diverse community stakeholders and in partnership with several local girl-serving organizations, DOW will leverage existing exhibits, girls’ groups, and social media to impact girls’
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryAnne Sinkey
NOVA Labs (www.pbs.org/nova/labs) is a web-based platform designed for use by educators, students, and teens to engage learners with authentic data, processes, and tools of working scientists. The present evaluation study sought to investigate the outcomes achieved by users of the third NOVA Labs platform developed: Cloud Lab. The intended outcomes identified for student users were that they would: • Be able to successfully work with the real data provided in the Cloud Lab; • Demonstrate ability to interpret and use scientific data and tools; • Engage with real scientific data through the
This final report summarizes the findings from three summative evaluation activities conducted by Serrell & Associates and the Oakland Museum of California with visitors to the newly renovated, reinstalled, and reinterpreted Gallery of California Natural Sciences in April and July 2014: the stay-time study, the cued questionnaire study, and the personal connections study.
DATE:
TEAM MEMBERS:
Serrell & AssociatesBeverly SerrellMary T. Faria
This report summarizes findings from an evaluation of the NSF-funded project: Two Eyes, 3D. Through collaborations with two museums, the project sought to develop and test learning outcomes for stereoscopic (3D) resources. More specifically, the external evaluation—conducted by Rockman Et Al—sought to determine the perceived value of using stereoscopic technology within museums and planetariums, uncover best practices for implementation of stereoscopic resources, and further explore best practices for research partnerships within museum settings.
DATE:
TEAM MEMBERS:
American Association of Variable Star ObservrsJennifer Borland