This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2015. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from a Membership study, a formative evaluation of a new Makerspace exhibition, and program evaluation of a workshop for the
NASA's Universe of Learning provides resources and experiences that enable diverse audiences to explore fundamental questions in astronomy, experience how science is done, and discover the universe for themselves. Using its direct connection to science and science experts, NASA's Universe of Learning creates and delivers timely and authentic resources and experiences for youth, families, and lifelong learners. The goal is to strengthen science learning and literacy, and to enable learners to discover the universe for themselves in innovative, interactive ways that meet today's 21st century needs. The program includes astronomical data tools, multimedia resources, exhibits and community programs, and professional learning experiences for informal educators. It is developed through a unique partnership between the Space Telescope Science Institute, Caltech/IPAC, the Jet Propulsion Laboratory, the Smithsonian Astrophysical Observatory, and Sonoma State University.
DATE:
-
TEAM MEMBERS:
Denise SmithGordon SquiresKathy LestitionAnya BifernoLynn Cominsky
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
Dinosaurs have been a very popular science topic since signs of their presence on earth were first discovered. They have represented so-called ‘edutainment’ for some people. Learning from informal sources and in- an out-of-school environment can be effective and motivating. In this study, 12-year-old pupils (N = 366) visited a dinosaur science centre exhibition in Finland. Pupils were tested with standardised tests of motivation as defined by self-determination theory, cognitive skills, and interest via pre-, post-, and delayed post-tests during a six-month period. Findings show that pupils
DATE:
TEAM MEMBERS:
Hannu SalmiHelena ThunebergMari-Pauliina Vainikainen
The aim of the study was to analyse learning using Augmented Reality (AR) technology and the motivational and cognitive aspects related to it in an informal learning context. The 146 participants were 11- to 13-year-old Finnish pupils visiting a science centre exhibition. The data, which consisted of both cognitive tasks and self-report questionnaires, were collected using a pre- post-test design and were analysed by SEM path-analysis. The results showed that AR-technology experience was beneficial for all, but especially for the lowest-achieving group and for the girls. In general, pre
DATE:
TEAM MEMBERS:
Hannu SalmiHelena ThunebergMari-Pauliina Vainikainen
C-RISE will create a replicable, customizable model for supporting citizen engagement with scientific data and reasoning to increase community resiliency under conditions of sea level rise and storm surge. Working with NOAA partners, we will design, pilot, and deliver interactive digital learning experiences that use the best available NOAA data and tools to engage participants in the interdependence of humans and the environment, the cycles of observation and experiment that advance science knowledge, and predicted changes for sea level and storm frequency. These scientific concepts and principles will be brought to human scale through real-world planning challenges developed with our city and government partners in Portland and South Portland, Maine. Over the course of the project, thousands of citizens from nearby neighborhoods and middle school students from across Maine’s sixteen counties, will engage with scientific data and forecasts specific to Portland Harbor—Maine’s largest seaport and the second largest oil port on the east coast. Interactive learning experiences for both audiences will be delivered through GMRI’s Cohen Center for Interactive Learning—a state-of-the-art exhibit space—in the context of facilitated conversations designed to emphasize how scientific reasoning is an essential tool for addressing real and pressing community and environmental issues. The learning experiences will also be available through a public web portal, giving all area residents access to the data and forecasts. The C-RISE web portal will be available to other coastal communities with guidance for loading locally relevant NOAA data into the learning experience. An accompanying guide will support community leaders and educators to embed the interactive learning experiences effectively into community conversations around resiliency. This project is aligned with NOAA’s Education Strategic Plan 2015-2035 by forwarding environmental literacy and using emerging technologies.
The importance of increasing and widening participation in post-compulsory science and informal science learning (ISL) spaces is widely recognized—particularly for working-class and minority ethnic communities. While there is a growing understanding of the intersection of femininity with class, ethnicity, and science learning across formal and informal settings, there has been little work on how masculinity may shape urban boys’ science (non)participation and (dis)engagement. This article analyzes performances of masculinity enacted by 36 urban, working-class boys (from diverse ethnic
Brooklyn Botanical Garden, Brooklyn NY
Audience Research for a New Garden, 2016
The Brooklyn Botanic Garden (BBG) contracted Randi Korn & Associates, Inc. (RK&A), to conduct a study of visitors to the Discovery Garden. The goal of this study was to assess the successes and challenges of the exhibition and accompanying interactive elements to support the BBG in improving the Discovery Garden.
How did we approach this study?
RK&A used three methodologies to address the study objectives, based on specific outcomes developed by BBG for the Discovery Garden. Data were collected through
This study was a longitudinal summative evaluation of repeat visitors’ experiences in four Math Moves! exhibitions that were developed as part of a large collaborative exhibition development project called Math Core for Museums, and mounted at four museums around the country: Museum of Science (Boston); Museum of Life & Science (Durham, NC); Explora (Albuquerque); and Science Museum of Minnesota (St. Paul). The summative evaluation purposively selected four family groups at each institution and collected naturalistic data as the 16 groups engaged with the exhibits from 4-6 times over a two
Mathematics is a notoriously disliked subject; there is so little stigma associated with being "bad at math", that educated adults openly describe themselves in this way. There are many reasons for math's unpopularity; chief among them is that school mathematics seldom offers opportunities to engage with the richness of this potentially fascinating subject. As a result, the mathematics education pipeline in the United States is more often a filter than a pump, siphoning students out rather than bringing them along. Children have libraries to help them fall in love with literature: where do they get a chance to fall in love with math? This project presents a unique opportunity to study children engaged with mathematics in an informal setting, the Minnesota State Fair, facilitated by mathematically knowledgeable volunteers. The Math On-a-Stick mathematical playground provides a place for children to engage with mathematics by exploring patters, asking quantitative questions, and investigating shape and space to mathematize their play. The project will observe and videotape this engagement to inform the design of mathematical learning environments in a variety of outside of school time settings, such as after school programs and summer camps, that are accessible to a wider range of the population. This project is co-funded by the EHR Core Research (ECR) and Advancing Informal STEM Learning (AISL) programs. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in three thematic areas: STEM learning and learning environments, broadening participation, and STEM workforce development. The AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will investigate three research questions: (1) How does the design of various parts of the exhibit differently support rich mathematical interactions between children and mathematicians? (2) How do children engage different parts of the exhibit? How do differences in engagement relate to (a) exhibit design and (b) prior mathematical experience? (3) How do exhibit volunteers, mathematicians, and caregivers interact to support (or undermine) students' mathematical play? The project will use participant observation and videography to capture visitors' activities through the exhibit, analyzing them as qualitative case studies.
This project, a collaboration of teams at Georgia Institute of Technology, Northwestern University, and the Museum of Design Atlanta and the Museum of Science and Industry in Chicago, will investigate how to foster engagement and broadening participation in computing by audiences in museums and other informal learning environments that can transfer to at-home and in-school engagement (and vice versa). The project seeks to address the national need to make major strides in developing computing literacy as a core 21st century STEM skill. The project will adapt and expand to new venues their current work on their EarSketch system which connects computer programming concepts to music remixing, i.e. the manipulation of musical samples, beats and effects. The initiative involves a four-year process of iteratively designing and developing a tangible programming environment based on the EarSketch learning environment. The team will develop three new applications: TuneTable, a multi-user tabletop exhibit for museums; TunePad, a smaller version for use at home and in schools; and an online connection between the earlier EarSketch program and the two new devices.
The goal is to: a) engage museum learners in collaborative, playful programming experiences that create music; b) direct museum learners to further learning and computational music experiences online with the EarSketch learning environment; c) attract EarSketch learners from local area schools to visit the museum and interact with novice TuneTable users, either as mentors in museum workshops or museum guests; and d) inform the development of a smaller scale, affordable tangible-based experience that could be used at homes or in smaller educational settings, such as classrooms and community centers. In addition to the development of new learning experiences, the project will test the hypothesis that creative, playful, and social engagement in the arts with computer programming across multiple settings (e.g. museums, homes, and classrooms) can encourage: a) deeper learner involvement in computer programming, b) social connections to other learners, c) positive attitudes towards computing, and d) the use and recognition of computational concepts for personal expression in music. The project's knowledge-building efforts include research on four major questions related to the goals and evaluation processes conducted by SageFox on the fidelity of implementation, impact, success of the exhibits, and success of bridging contexts. Methods will draw on the Active Prolonged Engagement approach (unobtrusive observation, interviews, tracking-and-timing, data summaries and team debriefs) as well as Participatory Action Research methods.
This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Michael HornBrian MagerkoJason Freeman
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.