This set of appendices represent all research instruments related to study presented in the I/CaLL Art Experiences and Advancing Science Literacy report (NewKnowledge Publication #NSF.097.115.07).
Appendix A: Installation Site Intercept Interview Instrument
Appendix B: Artists-Scientists Walk & Talks Instrument
Appendix C: Post-Performance Event Survey Instrument
Note that researchers did not use an instrument for the fourth aspect of the study, the post-performance event reflection sessions. Instead, they allowed the discussions to be directed by the reflection participants.
DATE:
TEAM MEMBERS:
John FraserRebecca Joy NorlanderSophie SwansonNezam ArdalanKate FlinnerJoanna Laursen BruckerNicole LaMarca
The Indianapolis / City as Living Laboratory (I/CaLL) project was a civic collaboration that used the city of Indianapolis as an informal science learning (ISL) environment. The 21 Urban Water Science Concepts Resource Handbook is designed for all people who are interested in exploring science topics related to urban waterways, particularly in Indianapolis. Specifically, educators, artists, and community members in Indianapolis may find this publication useful. With a small amount of extra research for examples in their area of interest, urban environmental educators across the country will
The National Autonomous University of Mexico (UNAM) is one of the world's single largest employers of science communicators, with over 350,000 students and 40,000 staff. Its science communication activities include five museums (Universum, Museo de la Luz, the Geology Museum, Museo de la Medicina Mexicana and Musem of Geophysics), botanical gardens, as well as a wide range of cultural and outreach activities. It has several programmes for training professional science communicators. The science communication staff are spread across the campuses in Mexico City and four other cities, including
DATE:
TEAM MEMBERS:
Ana Claudia NepoteElaine Reynoso-Haynes
The Exploratorium, in collaboration with the city of San Francisco, the Tenderloin and Civic Center communities, and national museum-community partners, are excited to announce Middle Ground: Experiments in Urban Social Science (fka Street Smarts), a project to bring research on social psychology to public urban environments. Middle Ground combines recent work by the Exploratorium in social science exhibitry and urban learning spaces to develop a novel contribution to science learning in public spaces. The project will produce an outdoor learning installation in front of San Francisco City Hall that will serve the exceptionally diverse audiences that frequent the area. The installation will be populated with exhibits that engage this public in social observation and participatory experiences, promoting learning about the science of social polarization, social dilemmas, and social norms. The project will also produce an online "Guide to People Watching" for the general public, with additional materials to support professionals in the creation of social science learning experiences. The project will be supported by a community of practice of professionals engaged in educational place-making. Finally, Middle Ground will produce new research on how to design experiences that prompt structured, quasi-scientific social observation skills and foster empathy for the social experience of others.
Co-led by the University of Washington and Science Gallery Dublin, this project aims to drive and transform the next generation of broadening participation efforts targeting teen-aged youth from communities historically underrepresented in STEM fields. This project investigates how out-of-school time (OST) programs that integrate epistemic practices of the arts, sciences, computer science, and other disciplines, in the context of consequential activities (such as creating radio segments, designing museum exhibitions, or building online games), can more broadly appeal to and engage youth who do not already identify as STEM learners. STEM-related skills and capacities (such as computational thinking, design, data visualizations, and digital storytelling) are key to productive and creative participation in many future civic and workplace activities, and are driving the 30 fastest-growing occupations in the US. But many new jobs will entail a hybrid blend of skills, such as programming and design skills that many students who have disengaged with academic STEM pathways may already have and would be eager to develop further. There is not currently a strong foundation of research-based evidence to guide the design, implementation, and evaluation transdisciplinary programs - in which STEM skills are embedded as tools for meaningful participation - or how such approaches relate to long-term outcomes. Hypothesizing that OST programs which effectively engage youth during their high-leverage teenage years can significantly impact youths' longer-term STEM learning trajectories, this project will involve: 1) Five 3-year studies documenting learning in different technology-rich contexts: Making Afterschool, Media Production, Museum Exhibition Design, Digital Arts Programs, and Pop-Up/Street Science Programs; 2) A 4-year longitudinal study, involving 100 youth from the above programs; 3) The creation of a number of practical measurement tools that can be used to monitor how programs are leveraging the intersections of the arts and sciences to support student engagement and learning; and 4) A Professional Development program conducted at informal science education conferences in the EU and US to engage the informal STEM field with emerging findings. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences to better understand, strengthen, and coordinate STEM engagement and learning. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments.
Transdisciplinary, equity-oriented OST programs can provide supportive social contexts in which STEM concepts and practices are taken up as the means for meaningful participation in valued activities, building students' STEM skills in ways that can propel their future academic, career, and lifelong learning choices. This project will build the knowledge base about these emerging 21st century transdisciplinary approaches to broadening participation investigating: 1) The epistemic intersections across a range of disciplines (art, science, computation, design) that operate to broaden appeal and meaningful participation for underrepresented youth; 2) How transdisciplinary activities undertaken in the context of consequential learning (e.g., producing a radio segment, designing an exhibition for the general public) can illuminate the relevance of STEM to young people's lives, concerns, and futures; and 3) How participation in such programs can propel students' longer-term life choices and STEM learning trajectories. The project is a collaboration of the University of Washington, Science Gallery Dublin, Indiana University, Youth Radio in Oakland California, Guerilla Science in New York and London, and the London School of Economics.
Ciencia Pública is a National Science Foundation (NSF) -funded initiative in which the Exploratorium, in collaboration with the Boys and Girls Club of San Francisco (BGCSF), developed a parklet to engage Latino families in STEM content. The Parklet is located in San Francisco’s Mission District (the Mission), a historically Latino neighborhood. Buena Vista Horace Mann School (BVHM) is an additional project partner and hosts the Parklet on its site. Garibay Group conducted a summative evaluation of the project outcomes. This report discusses evaluation findings.
Brooklyn Botanical Garden, Brooklyn NY
Audience Research for a New Garden, 2016
The Brooklyn Botanic Garden (BBG) contracted Randi Korn & Associates, Inc. (RK&A), to conduct a study of visitors to the Discovery Garden. The goal of this study was to assess the successes and challenges of the exhibition and accompanying interactive elements to support the BBG in improving the Discovery Garden.
How did we approach this study?
RK&A used three methodologies to address the study objectives, based on specific outcomes developed by BBG for the Discovery Garden. Data were collected through
Mathematics is a notoriously disliked subject; there is so little stigma associated with being "bad at math", that educated adults openly describe themselves in this way. There are many reasons for math's unpopularity; chief among them is that school mathematics seldom offers opportunities to engage with the richness of this potentially fascinating subject. As a result, the mathematics education pipeline in the United States is more often a filter than a pump, siphoning students out rather than bringing them along. Children have libraries to help them fall in love with literature: where do they get a chance to fall in love with math? This project presents a unique opportunity to study children engaged with mathematics in an informal setting, the Minnesota State Fair, facilitated by mathematically knowledgeable volunteers. The Math On-a-Stick mathematical playground provides a place for children to engage with mathematics by exploring patters, asking quantitative questions, and investigating shape and space to mathematize their play. The project will observe and videotape this engagement to inform the design of mathematical learning environments in a variety of outside of school time settings, such as after school programs and summer camps, that are accessible to a wider range of the population. This project is co-funded by the EHR Core Research (ECR) and Advancing Informal STEM Learning (AISL) programs. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in three thematic areas: STEM learning and learning environments, broadening participation, and STEM workforce development. The AISL program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
The project will investigate three research questions: (1) How does the design of various parts of the exhibit differently support rich mathematical interactions between children and mathematicians? (2) How do children engage different parts of the exhibit? How do differences in engagement relate to (a) exhibit design and (b) prior mathematical experience? (3) How do exhibit volunteers, mathematicians, and caregivers interact to support (or undermine) students' mathematical play? The project will use participant observation and videography to capture visitors' activities through the exhibit, analyzing them as qualitative case studies.
Since its completion in 1937, the Golden Gate Bridge has become one of the world’s most recognized landmarks as both an iconic public works accomplishment and a popular tourist destination. In 2008, the National Science Foundation (NSF) awarded a $3 million grant to the Golden Gate Bridge Highway & Transportation District to leverage this status in developing informal education resources to interpret the science, engineering and history of the bridge. Through this initiative the Golden Gate Bridge would become a model for other public works venues for providing informal science education and
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
In respect of the different modes of science communication including journalism, radio, online, I would propose that the process of making exhibitions and centres dedicated to science & technology is one of the hardest creative typologies. It also provides a very different type of engagement to other modes, in that it works in real time and space with real tangible objects and responsive media. The power of the real is also extended through the direct and collective involvement of people, providing a refreshing antidote to the potential alienating nature of social media and the ever-growing
The urgent state of our global environment calls for collective action, which depends in large part on effective science communication for better understanding and awareness. Activities and institutions that provide opportunities to learn about nature all ultimately rely on scientific findings about nature. Although science produces the knowledge and information about nature, for the content to be accessible and meaningful to the general public, it needs to be processed by what I call science content design. This process is similar to the concepts of interpretation in tourism, or aesthetic