This is a compilation of front-end, formative, and a partial summative evaluations, and an exploratory study using the xMacroscope, a data visualization technology developed for generating data from an exhibit using data captured from visitor actions.
The Lawrence Hall of Science at the University of California, Berkeley, will launch the Learning Technology Studio project to improve the ability of its staff to create digital technology tools and experiences that help youth, families, and adults learn about STEM topics. The museum will design and implement a professional learning program for staff from multiple departments to build their understanding of best and innovative practices for using digital technology to support STEM learning. The program will empower a subset of staff will to collaboratively design, test, and revise technology experiences using simulations, digital media, and AR that can elevate visitor engagement and enhance learning. The museum will create an institution-wide Learning Technology Framework that captures the findings and resources developed through the project to guide long-term professional learning and collaboration in digital technology design and integration.
Reflecting on the practice of storytelling, this practice insight explores how collaborations between scholars and practitioners can improve storytelling for science communication outcomes with publics. The case studies presented demonstrate the benefits of collaborative storytelling for inspiring publics, promoting understanding of science, and engaging publics more deliberatively in science. The projects show how collaboration between scholars and practitioners [in storytelling] can happen across a continuum of scholarship from evaluation and action research to more critical thinking
DATE:
TEAM MEMBERS:
Michelle RiedlingerJenni MetcalfeAyelet Baram-TsabariMarta EntradasMarina JoubertLuisa Massarani
As new technologies continue to dominate the world, access to and participation in science, technology, engineering, mathematics (STEM), and computing has become a critical focus of education research, practice, and policy. This issue is exceptionally relevant for American Indians, who remain underrepresented as only 0.2% of the STEM workforce, even though they make up 2% of the U.S. population. In response to this need, this Faculty Early Career Development Program (CAREER) project takes a community-driven design approach, a collaborative design process in which Indigenous partners maintain sovereignty as designers, to collaboratively create three place-based storytelling experiences, stories told in historical and cultural places through location-based media. The place-based storytelling experiences will be digital installations at three culturally, politically, and historically significant sites in the local community where the public can engage with Indigenous science. The work is being done in partnership with the Northwestern Band of the Shoshone Nation (NWBSN).
The principal investigator and the NWBSN will investigate: (a) what are effective strategies and processes to conduct community-driven design with Indigenous partners?; (b) how does designing place-based storytelling experiences develop tribal members' design, technical, and computational skills?; (c) how does designing these experiences impact tribal members' scientific, technological, and cultural identities? The goals are to establish a process of community-driven design, build infrastructure to support this process, and understand how this methodological approach can result in culturally-appropriate ways to engage with science through technology. The principal investigator will work with the tribe to complete three intergenerational design cycles (a design cycle is made up of multiple design iterations). Each design cycle will result in one place-based storytelling experience. The goal is to include roughly 15 youth (ages 6-18), 10 Elders, and 10 other community members (i.e. members ages 18-50, likely parents) in each design cycle (35 tribal members total). Some designers are likely to participate in multiple design cycles. The tribe currently has 48 youth ages 6-18 and the project aims to engage at least 30 across all three design cycles. Over four years of designing three different experiences, the NWBSN aims to recruit at least 100 tribal members (just under 20% of the tribe) to make contributions (as designers, storytellers, or to provide cultural artifacts or design feedback).
This CAREER award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
There is a dearth of prominent STEM role models for underrepresented populations. For example, according to a 2017 survey, only 3.1% of physicists in the United States are Black, only 2.1% are Hispanic, and only 0.5% are Native American. The project will help bridge these gaps by developing exhibits that include simulations of historical scientific experiments enacted by little-known scientists of color, virtual reality encounters that immerse participants in the scientists' discovery process, and other content that allows visitors to interact with the exhibits and explore the exhibits' themes. The project will develop transportable, interactive exhibits focusing on light: how we perceive light, sources of light from light bulbs to stars, uses of real and artificial light in human endeavors, and past and current STEM innovators whose work helps us understand, create, and harness light now. The exhibits will be developed in three stages, each exploring a characteristic of light (Color, Energy, or Time). Each theme will be explored via multiple deliveries: short documentary and animated films, virtual reality experiences, interactive "photobooths," and technology-based inquiry activities. The exhibit components will be copied at seven additional sites, which will host the exhibits for their audiences, and the project's digital assets will enable other STEM learning organizations to duplicate the exhibits. The exhibits will be designed to address common gaps in understanding, among adults as well as younger learners, about light. What light really is and does, in scientific terms, is one type of hidden story these exhibits will convey to general audiences. Two other types of science stories the exhibits will tell: how contemporary research related to light, particularly in astrophysics, is unveiling the hidden stories of our universe; and hidden stories of STEM innovators, past and present, women and men, from diverse backgrounds. These stories will provide needed role models for the adolescent learners, helping them learn complex STEM content while showing them how scientific research is conducted and the diverse community of people who can contribute to STEM innovations and discoveries.
The project deliverables will be designed to present complex physics content through coherent, immersive, and embodied learning experiences that have been demonstrated to promote engagement and deeper learning. The project will research whether participants, through interacting with these exhibits, can begin to integrate discrete ideas and make connections with complex scientific content that would be difficult without technology support. For example, students and other novices often lack the expertise necessary to make distinctions between what is needed and what is extra within scientific problems. The proposed study follows a Design-Based Research (DBR) approach characterized by iterative cycles of data collection, analysis, and reflection to inform the design of educational innovations and advance educational theory. Project research includes conceiving, building, and testing iterative phases, which will enable the project to capture the complexity of learning and engagement in informal learning settings. Research participants will complete a range of research activities, including focus group interviews, observation, and pre-post assessment of science content knowledge and dispositions.
By showcasing such role models and informing about related STEM content, this project will widen perspectives of audiences in informal learning settings, particularly adolescents from groups underrepresented in STEM fields. Research findings and methodologies will be shared widely in the informal STEM learning community, building the field's knowledge of effective ways to broaden participation in informal science learning, and thus increase broaden participation in and preparation for the STEM-based workforce.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Todd BoyetteJill HammJanice AndersonCrystal Harden
Co-led by the University of Washington and Science Gallery Dublin, this project aims to drive and transform the next generation of broadening participation efforts targeting teen-aged youth from communities historically underrepresented in STEM fields. This project investigates how out-of-school time (OST) programs that integrate epistemic practices of the arts, sciences, computer science, and other disciplines, in the context of consequential activities (such as creating radio segments, designing museum exhibitions, or building online games), can more broadly appeal to and engage youth who do not already identify as STEM learners. STEM-related skills and capacities (such as computational thinking, design, data visualizations, and digital storytelling) are key to productive and creative participation in many future civic and workplace activities, and are driving the 30 fastest-growing occupations in the US. But many new jobs will entail a hybrid blend of skills, such as programming and design skills that many students who have disengaged with academic STEM pathways may already have and would be eager to develop further. There is not currently a strong foundation of research-based evidence to guide the design, implementation, and evaluation transdisciplinary programs - in which STEM skills are embedded as tools for meaningful participation - or how such approaches relate to long-term outcomes. Hypothesizing that OST programs which effectively engage youth during their high-leverage teenage years can significantly impact youths' longer-term STEM learning trajectories, this project will involve: 1) Five 3-year studies documenting learning in different technology-rich contexts: Making Afterschool, Media Production, Museum Exhibition Design, Digital Arts Programs, and Pop-Up/Street Science Programs; 2) A 4-year longitudinal study, involving 100 youth from the above programs; 3) The creation of a number of practical measurement tools that can be used to monitor how programs are leveraging the intersections of the arts and sciences to support student engagement and learning; and 4) A Professional Development program conducted at informal science education conferences in the EU and US to engage the informal STEM field with emerging findings. This project is funded through Science Learning+, which is an international partnership between the National Science Foundation (NSF) and the Wellcome Trust with the UK Economic and Social Research Council. The goal of this joint funding effort is to make transformational steps toward improving the knowledge base and practices of informal STEM experiences to better understand, strengthen, and coordinate STEM engagement and learning. Within NSF, Science Learning+ is part of the Advancing Informal STEM Learning (AISL) program that seeks to enhance learning in informal environments.
Transdisciplinary, equity-oriented OST programs can provide supportive social contexts in which STEM concepts and practices are taken up as the means for meaningful participation in valued activities, building students' STEM skills in ways that can propel their future academic, career, and lifelong learning choices. This project will build the knowledge base about these emerging 21st century transdisciplinary approaches to broadening participation investigating: 1) The epistemic intersections across a range of disciplines (art, science, computation, design) that operate to broaden appeal and meaningful participation for underrepresented youth; 2) How transdisciplinary activities undertaken in the context of consequential learning (e.g., producing a radio segment, designing an exhibition for the general public) can illuminate the relevance of STEM to young people's lives, concerns, and futures; and 3) How participation in such programs can propel students' longer-term life choices and STEM learning trajectories. The project is a collaboration of the University of Washington, Science Gallery Dublin, Indiana University, Youth Radio in Oakland California, Guerilla Science in New York and London, and the London School of Economics.
Under a subcontract with Randi Korn & Associates, who conducted a study of the on‐site museum exhibit, RMC was engaged to conduct an evaluation of the Places of Invention online map site for the Jerome and Dorothy Lemelson Center for the Study of Invention and Innovation. The Places of Invention online map, part of the 3,500 square foot on‐site exhibit, was developed as a platform for collecting invention stories related to specific places or landscapes submitted by Smithsonian staff, Smithsonian Affiliations, and visitors to the online map. RMC investigated three key topics related to
This is the final evaluation report on the Laurel Clark Earth Camp Experience, a multi-component program to incorporate NASA satellite data into summer field programs for teens, environmental and water education for teachers, environmental after-school clubs and Earth Science exhibits at the Arizona- Sonora Desert Museum.
The Virginia Institute of Marine Science (VIMS) and The Watermen's Museum, Yorktown, VA, will produce an underwater robotics research and discovery education program in conjunction with time-sensitive, underwater archeological research exploring recently discovered shipwrecks of General Cornwallis's lost fleet in the York River. The urgency of the scientific research is based upon the dynamic environment of the York River with its strong tidal currents, low visibility, and seasonal hypoxia that can rapidly deteriorate the ships, which have been underwater since 1781. Geophysical experts believe that further erosion is likely once the wrecks are exposed. Given the unknown deterioration rate of the shipwrecks coupled with the constraints of implementing the project during the 2011-2012 school-year, any delays would put the scientific research back at least 18 months - a potentially devastating delay for documenting the ships. The monitoring and studying of the historic ships will be conducted by elementary through high school-aged participants and their teachers who will collect the data underwater through robotic missions using VideoRay Remotely Operated Vehicles (ROVs) and a Fetch Automated Underwater Vehicle (AUV) from a command station at The Watermen's Museum. Students and teachers will be introduced to the science, mathematics, and integrated technologies associated with robotic underwater research and will experience events that occur on a real expedition, including mission planning, execution, monitoring, and data analysis. Robotic missions will be conducted within the unique, underwater setting of the historical shipwrecks. Such research experiences and professional development are intended to serve as a key to stimulating student interest in underwater archeological research, the marine environment and ocean science, advanced research using new technologies, and the array of opportunities presented for scientific and creative problem solving associated with underwater research. A comprehensive, outcomes-based formative and summative, external evaluation of the project will be conducted by Dr. L. Art Safer, Loyola University. The evaluation will inform the project's implementation efforts and investigate the project's impact. The newly formed partnership between the Waterman's Museum and VIMS will expand the ISE Program's objectives to forge new partnerships among informal venues, and to expand the use of advanced technologies for informal STEM learning. Extensive public dissemination during and after the project duration, includes but is not limited to, hosting an "Expedition to the Wrecks" web portal on the VIMS BRIDGE site for K-12 educators providing real-time results of the project and live webcasts. The website will be linked to the education portal at the Association for Unmanned Vehicle Systems International, the world's largest organization devoted to promoting unmanned systems and to the FIRST Robotics community through the Virginia portal. The website will be promoted through scientific societies, the National Marine Educators Association, National Science Teachers Association, and ASTC. Links will be provided to the Center for Archeological Research at the College of William and Mary and the Immersion Presents web portal--consultants to Dr. Bob Ballard's K-12 projects and JASON explorations. The NPS Colonial National Historic Park and the Riverwalk Landing will create public exhibits about the shipwreck's archeological and scientific significance, and will provide live observation of the research and the exploration technologies employed in this effort.
Young people's participation in informal STEM learning activities can contribute to their academic and career achievements, but these connections are infrequently explicitly recognized or cultivated. More systemic approaches to STEM education could allow for students' experiences of formal and informal STEM learning to be aligned, coordinated, and supported across learning contexts. This Science Learning+ planning project brings together stakeholders in two digital badge systems--one in the US and one in the UK--to plan for a study to identify the specific structural features of the systems that may allow for the alignment of learning objectives across institutions. Digital badge systems may offer an inventive solution to the challenge of connecting and building on youth's STEM-related experiences in multiple learning contexts. When part of a defined system, badges could be used to represent and communicate evidence of individual learning, as well as provide youth and educators with evidence-supported indicators for other activities in the system that might be interesting or valuable. Properly designed and supported badge systems could transmit critical information within a network of informal STEM programs and schools that (1) recognize context-dependent, interest-driven learning and (2) provide opportunities to explore those interests across multiple settings. This project advances the field of informal STEM learning in two ways. First, the project documents and analyzes the processes by which two small groups of informal science education organizations and schools negotiate the meaning and value of badges, as proxies for learning objectives, and how they decide to recognize badges awarded by other institutions. This process builds capacity within the target systems while also beginning to identify the institutional, cultural, and material capacity issues that facilitate or constrain the alignment process. Second, the project conducts a pilot study with a small number of youth in the US and UK to investigate factors associated with an individual youth's likelihood of: a) identifying badges of interest; b) connecting the activities of various badge systems to each other and to non-badging institutions, such as school or industry; c) determining which badges to pursue; and d) persisting in a particular badge pathway. Findings from this pilot study will help identify institution- and individual-level factors that might be associated with advancing student interest and progression in STEM fields. Deepening and validating the understanding of those factors and their relative impact on student experiences and outcomes will be the focus of investigations in future studies.
DATE:
-
TEAM MEMBERS:
James DiamondNew York City Hive Learning NetworkMOUSEDigitalMeKatherine McMillan
To better help museum visitors make sense of large data sets, also called “Big Data”, this study focused on the types of visual representations visitors recognize, and how they make meaning (or not) of various visuals. Individual adults and youths were shown five different data visualizations (one from each of five categories), one at a time, and asked if the visualization looked familiar and how it was read. This study found that Context and previous experience matters. Participants of all ages are familiar with a wide variety of visual displays of data. If a participant encounters a visual
To better help museum visitors make sense of large data sets, also called “big data”, this study focuses on what museum visitors felt individual layers of a visual (alone and in combination with other layers) were communicating to them as the visual was constructed or deconstructed layer by layer. A second, smaller study, collected data to better understand how adult visitors would construct large data visualizations. This study was concerned with how people make sense of “big data” in their daily lives and how they engage with reference systems. The primary study used four different “big data