This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
The Multi-Site Public Engagement with Science—Synthetic Biology (MSPES) initiative was an Innovations in Development project funded by the National Science Foundation (DRL-1421179) through the Advancing of Informal STEM Learning program (AISL). MSPES promoted public engagement with science (PES)—a model of mutual dialogue and learning between public and scientist audiences—through the creation and distribution of PES kits to nearly 200 informal science education sites around the country. Kits included two types of learning experiences: (1) forum programs during which scientists and teen or
Digital Observation Technology Skills (DOTS) is a framework for integrating modern, mobile technology into outdoor, experiential science education. DOTS addresses longstanding tensions between modern technology and classical outdoor education by carefully selecting appropriate digital technology for educational purposes and by situating these tools in classical experiential pedagogy.
DATE:
TEAM MEMBERS:
R. Justin HoughamMarc NutterCaitlin Graham
resourceprojectProfessional Development, Conferences, and Networks
This is a project to offer the Forum on Inclusive STEMM Entrepreneurship (FISE), a novel effort to broaden the participation of underrepresented minority women in STEMM entrepreneurship and to enhance the diversity of the science and engineering workforce. Through a convening of educators, entrepreneurs, aspiring entrepreneurs, industry leaders, investors and policy experts, entrepreneurial education thought leaders, and intersectionality scholars the PI proposes to use this conference as a platform for building capacity in the preparation and development of future entrepreneurs from underrepresented groups. The PI also seeks to contribute to the emerging field of research that bridges tech entrepreneurship and education policy.
The proposed forum has the potential to advance knowledge in the field of entrepreneurship education and engineering education. Given the dearth of research-based interventions to broaden participation in tech entrepreneurship, this conference offers an opportunity for participants to contribute to the leading edge of research and interventions in this field.
The convening and associated activities will leverage the social capital of knowledgeable experts in the academy and industry, investors, entrepreneurs and aspiring entrepreneurs to address critical needs of the nation that relate to enhanced global competitiveness, an improved national economy, and the participation of underrepresented cohorts in entrepreneurship and commercialization.
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
This study explored how different presentations of an object in deep space affect understanding, engagement, and aesthetic appreciation. A total of n = 2,502 respondents to an online survey were randomly assigned to one of 11 versions of Cassiopeia A, comprising 6 images and 5 videos ranging from 3s to approximately 1min. Participants responded to intial items regarding what the image looked like, the aesthetic appeal of the image, perceptions of understanding, and how much the participant wanted to learn more. After the image was identified, participants indicated the extent to which the
DATE:
TEAM MEMBERS:
Lisa SmithKimberly ArcandRandall SmithJay BookbinderJeffrey Smith
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
The Art of Science Learning, Phase 2 was an NSF-funded research and development project to investigate the value of incorporating arts-based learning techniques in STEM-related group innovation processes. The project team created a new, arts-infused innovation curriculum in consultation with leading national practitioners in the arts, creativity, and innovation, then deployed that curriculum in “innovation incubators” in San Diego, Chicago, and Worcester (Mass.) in partnership with informal STEM institutions in those cities. At each incubator, diverse members of the public (from high school
DATE:
TEAM MEMBERS:
Peter LinettSteve ShewfeltNicole BaltazarNnenna OkekeDreolin FleisherEric LaPlantMadeline SmithChloe Chittick PattonSarah LeeHarvey Seifter
Under a subcontract with Randi Korn & Associates, who conducted a study of the on‐site museum exhibit, RMC was engaged to conduct an evaluation of the Places of Invention online map site for the Jerome and Dorothy Lemelson Center for the Study of Invention and Innovation. The Places of Invention online map, part of the 3,500 square foot on‐site exhibit, was developed as a platform for collecting invention stories related to specific places or landscapes submitted by Smithsonian staff, Smithsonian Affiliations, and visitors to the online map. RMC investigated three key topics related to
With funding from the National Science Foundation, NOVA/WGBH Boston with the participation of 14 U.S. and 4 international science museums have produced an IMAX/OMNIMAX film titled, Special Effects. The 40-minute film shows the techniques and methods that special effects filmmakers use along with their understanding of the human visual system to create movie illusions. Multimedia Research implemented a summative evaluation focused on the following major outcomes: To what extent did the program appeal to adult viewers? To what extent did the program achieve its intended viewing goals? What
The Space Science Institute is developing an astronomy educational social game for the Facebook platform. The game uses the "sporadic play" model popular with many Facebook games, in which players take only a few actions at a time, then return to explore the results. Here players will create their own stars and planetary systems that evolve over time at a rate of a million years a minute. Players set systems in motion, revisiting the game over days or weeks to make new choices and alter strategies. The game is in effect an end-to-end solar system simulation, following a star from birth to death. As a result it encompasses a wide variety of core concepts in astronomy, including galactic structure, stellar evolution and lifecycles, planetary formation and evolution, and habitability and "habitable zones." The accompanying research program will examine the effectiveness of this type of game in informal education, and the effects of the social network on meeting the education goals, including viral spread, cooperative play, and discussions about the game and its underlying content in associated online forums.
StarTalk Radio will develop a highly innovative new genre of science radio that bridges the intersection between popular culture and science education. Host of the show and project PI is Dr. Neil deGrasse Tyson, renowned scientist, astrophysicist, popular science author and director of the Hayden Planetarium in New York City. The radio programs will combine comedy, references to pop culture, and public fascination with space science to reach an untapped audience for the informal science field--those who listen to commercial talk radio call-in shows. The STEM content will include astronomy, astrophysics, astrobiology, space exploration, earth system science, and associated technologies. Goals and intended outcomes of the project include increasing knowledge and interest of space science topics, and motivating audiences to pursue additional learning acitivities as the result of listening to the programs. This project builds on a previous SGER grant (#0852400) which produced 13 pilot programs and was evaluated by Multimedia Research. Project deliverables include 39 one-hour live call-in shows a year for a total of 117 shows over three years, a website, and a business strategy that projects making the radio programs self-sustaining. Dr. Tyson will be the host, and each program will include a celebrity guest who has a strong interest in science. The target audience for the show is the "blue collar intellectual" audience segment who listens to commercial talk radio, has a high school education or less and is in the 25-44 year old range. It is estimated that there will be one million listeners per week by the end of the project. People with disabilities (deaf and visually impaired) will have access to the products through captioning and other features on the website. Project partners include CBS Radio, CBS/AOL, and Discover Magazine. Formative evaluation of these new shows and website will be conducted by Multimedia Research. The Goodman Research Group (GRG) will conduct the summative evluation to assess the extent to which the project accomplishes the goals and specifically will gather and analyze data on the previously untappped and underserved audiences. The evaluation will examine the differences in impact on Science Novices and Science Enthusiasts, asking questions about how the programs increase awareness of scientific issues, and their effects on society and culture, as well as factual knowledge. Methods include multi-level, quasi-experimental, and longitudinal episode assessments. Potential impacts on the field of informal science education include opening up a new commercial radio audience for informal science learning, increasing knowledge about effective approaches to combining humor and science, and demonstrating an effective business model that results in a self-supporting show about science on commercial radio.