Skip to main content

Community Repository Search Results

resource evaluation Exhibitions
This study collected data from seven planetarium email lists (one per planetarium regional organization in the United States), as well as online survey panel data from residents in each area, to describe and compare those who do and do not visit planetariums.
DATE:
TEAM MEMBERS: Karen Peterman Keshia Martin Jane Robertson Evia Sally Brummel Holly L. Menninger
resource evaluation Exhibitions
This paper presents synthesized research on where XR is most effective within a museum setting and what impact XR might have on the visitor experience.
DATE:
TEAM MEMBERS: Madeleine Pope Kate Haley Goldman William Swartout Dr. Emily Lindsey Dr. Benjamin Nye Dr. Gale Sinatra
resource project Media and Technology
Increasing the diversity of the Science, Technology, Engineering, and Mathematics (STEM) workforce hinges on understanding the impact of the many related, pre-college experiences of the nation’s youth. While formal preparation, such as high school course-taking, has a major influence, research has shown that out-of-school-time activities have a much larger role in shaping the attitudes, identity, and career interests of students, particularly those who are members of groups historically underrepresented in STEM fields (Black, Indigenous, Latinx, and/or Pacific Islander). A wide range of both innovative adult-led (science clubs, internships, museum-going, competitions, summer camps) and personal-choice (hobbies, family talk, games, simulations, social media, online courses) options exist. This project studies the variety and availability such experiences to pre-college students. The project is particularly interested in how community cultural capital is leveraged through informal activities and experiences, drawing upon the “funds of knowledge” that culturally diverse students bring to their STEM experiences (e.g., high aspirations, multilingual facility, building of sustaining social networks, and the capacity to challenge negative stereotyping). This study has the capability to begin to reveal evidence-based measures of the absolute and relative effectiveness of promising informal educational practices, including many developed and disseminated by NSF-funded programs. Understanding the ecology of precollege influencers and the hypotheses on which they are based, along with providing initial measures of the efficacy of multiple pathways attempting to broaden participation of students from underrepresented groups in STEM majors and careers, will aid decision-making that will maximize the strategic impact of federal and local efforts.

The project first collects hypotheses from the wide variety of stakeholders (educators, researchers, and students) about the kinds of experiences that make a difference in increasing students’ STEM identity and career interest. Identifying the descriptive attributes that characterize opportunities across individual programs and validating a multi-part instrument to ascertain student experiences will be carried out through a review of relevant literature, surveying stakeholders using crowdsourced platforms, and through in-depth interviews with 50 providers. A sample of 1,000 students from 2- and 4-year college and universities, drawn from minority-serving institutions, such as Historically Black Colleges, Hispanic Serving Institutions, and Tribal Colleges and Universities will serve to establish the validity and reliability of the derived instrument and provide estimates of the availability and frequency of involvement. Psychometric methods and factor analysis will guide us in combining related variables into indices that reflect underlying constructs. Propensity score weighting will be employed for estimating effects when exposure to certain OST activities is confounded with other factors (e.g., parental education, SES). Path models and structural equation models (SEM) will be employed to build models that use causal or time related variables, for instance, students’ career interests at different times in their pre-college experience. The study goes beyond evaluation of individual experiences in addressing important questions that will help policy makers, educators, parents, and students understand which OST opportunities serve the diverse values and goals of members of underrepresented groups, boosting their likelihood of pursuing STEM careers. This project is co-funded by the Advancing Informal STEM Learning (AISL) and EHR CORE Research (ECR) programs.
DATE: -
TEAM MEMBERS: Philip Sadler Remy Dou Monique Ross Susan Sunbury Gerhard Sonnert
resource project Public Programs
This project addresses a longstanding problem in informal science education: how to increase the likelihood of consequential science, technology, engineering, and mathematics (STEM) learning from short duration experiences such as field trips. Although informal learning experiences can greatly contribute to interest in and knowledge of science, there is a shared concern among educators and researchers that students may have difficulty recalling and using scientific information and practices emphasized during these experiences, even though doing so would further their science learning. Nonetheless, science learning is rarely, if ever, a "one-shot deal." Children acquire knowledge about science cumulatively across different contexts and activities. Therefore, it is important that informal science learning institutions identify effective practices that support the consolidation of learning and memory from exhibit experiences to foster portable, usable knowledge across contexts, such as from informal science learning institutions, to classrooms, and homes. To this end, this Research in Service to Practice project seeks to harness the power and potential of visual representations (e.g., graphs, drawings, charts, maps, etc.) for enhancing learning and encouraging effective reflection during and after science learning experiences. The project promises to increase learning for the 9,000+ 5th and 6th grade students from across the rurality and growing diversity of the state of Maine who annually participate in LabVenture, a 2.5-hour exploration of the Gulf of Maine ecosystem at Gulf of Maine Research Institute. The research will provide new and actionable informal science learning practices that promote engagement with visual representations and reflection, and science understandings that can be applied broadly by informal science institutions. This project is funded by the Advancing Informal STEM Learning (AISL) and the Discovery Research PreK-12 (DRK-12) programs. It supports the AISL program goals to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. It supports the DRK-12 program goal of enhancing the learning and teaching of STEM by preK-12 students and teachers.

The project is grounded in the idea that visual representations, including drawings, can both enhance science learning and encourage reflection on doing science that can support extension of that learning beyond a singular informal science experience. The project uses design-based research to address the following research questions: (1) Does reflection during an informal science learning experience promote students’ retention and subsequent use of science information and practices that are part of the experience? (2) Does interpreting and constructing visual representations, such as drawings, improve students’ understanding and retention of information, and if so, how and when? and (3) Does combining visual representations and narrative reflections confer benefits on students’ science learning and engagement in science practices both during the informal learning experience, and later in their classrooms and at home? These questions will be pursued in collaboration with practitioners (both informal educators and classroom teachers) and a diverse team of graduate and undergraduate student researchers. Approximately 600 student groups (roughly 3000 individual students) will be observed during the LabVenture experience, with further data collection involving a portion of these students at school and at home. The project will yield resources and video demonstrations of field-tested, empirically based practices that promote engagement with visual representations and reflection, and science understandings that can travel within students' learning ecosystem. In support of broadening participation, the undergraduate/graduate student researchers will gain wide understanding and experience connecting research to practice and communicating science to academic and nonacademic audiences.
DATE: -
TEAM MEMBERS: David Uttal Amanda Dickes Leigh Peake Catherine Haden
resource project Exhibitions
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).

The Accessible Oceans study will design auditory displays that support learning and understanding of ocean data in informal learning environments like museums, science centers, and aquariums. Most data presentations in these spaces use visual display techniques such as graphs, charts, and computer-generated visualizations, resulting in inequitable access for learners with vision impairment or other print-related disabilities. While music, sound effects, and environmental sounds are sometimes used, these audio methods are inadequate for conveying quantitative information. The project will use sonification (turning data into sound) to convey meaningful aspects of ocean science data to increase access to ocean data and ocean literacy. The project will advance knowledge on the design of auditory displays for all learners, with and without disabilities, as well as advance the use of technology for STEM formal and informal education. The study will include 425 participants but will reach tens of thousands through the development of education materials, public reporting, and social media. The study will partner with the Smithsonian National Museum of Natural History, Woods Hole Oceanographic Institution Ocean Discovery Center, the Georgia Aquarium, the Eugene Science Center, the Atlanta Center for the Visually Impaired, and Perkins School for the Blind.

The project will leverage existing educational ocean datasets from the NSF-funded Ocean Observatories Initiative to produce and evaluate the feasibility of using integrated auditory displays to communicate tiered learning objectives of oceanographic principles. Integrated auditory displays will each be comprised of a data sonification and a context-setting audio introduction that will help to make sure all users start with the same basic information about the phenomenon. The displays will be developed through a user-centered design process that will engage ocean science experts, visually impaired students and adults (and their teachers), and design-oriented undergraduate and graduate students. The project will support advocacy skills for inclusive design and will provide valuable training opportunities for graduate and undergraduate students in human-centered design and accessibility. The project will have foundational utility in auditory display, STEM education, human-computer interaction, and other disciplines, contributing new strategies for representing quantitative information that can be applied across STEM disciplines that use similar visual data displays. The project will generate publicly accessible resources to advance studies of inclusive approaches on motivating learners with and without disabilities to learn more about and consider careers in STEM.

This Pilots and Feasibility Studies project is supported by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE: -
TEAM MEMBERS: Amy Bower Carrie Bruce Jon Bellona
resource project Exhibitions
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.

Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
DATE: -
TEAM MEMBERS: Susan Letourneau
resource research Exhibitions
This case study of the development of a cross-cultural museum exhibition illustrates value and difficulties of cross-cultural collaboration. University researchers worked with a class of postgraduate science communication students and designers from the Otago Museum to produce a museum exhibition. ‘Wai ora, Mauri ora’ (‘Healthy environments, Healthy people’) provided visibility and public access to information about Māori work. The exhibition assignment provided an authentic assessment of student work, with a professional output. Working on the exhibition involved cross-cultural communication
DATE:
TEAM MEMBERS: Nancy Longnecker Craig Scott
resource project Exhibitions
Museums, science centers, zoos and other informal science education (ISE) institutions often focus on the idea of "authenticity" to engage the public. Authenticity includes providing something real, original, or even awe-inspiring to the visitor or learner--be it an object, a context, or an experience. While those educators, exhibit designers, and program developers who work in ISE settings often recognize authenticity as an important part of many informal learning experiences, this may be simply be an assumption driven by tradition in practice versus a strategy supported by evidence. This project seeks to better understand how and/or why "the real thing" may (or may not be) important for supporting informal science learning. By examining what is already known about authenticity and learning, the project will inform best practices in ISE as well as point to gaps in knowledge that might need further research. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This research synthesis takes a systematic approach to identify and compile both theoretical and empirical literature to better understand the role authenticity may play in supporting informal science learning. This project will gather ISE literature related to the effects of "authenticity" on learner outcomes, and will look to neighboring disciplines such as psychology, anthropology, media studies, linguistics, marketing and others to seek relevant theoretical perspectives and empirical work that might further understanding of the potential role of authenticity in ISE. The initial phase of the project will focus on gathering theoretical perspectives and positions that help explain the value or importance (or perhaps non-importance) of "realness" as it relates to learning, interest, and experience. A panel of experts from multiple disciplines will convene to help identify key perspectives and frameworks that may clarify the role or impacts of authenticity. A second phase focuses on gathering and assessing empirical studies that support (or refute) the relevant perspectives and theories identified from the initial multi-disciplinary foray into authenticity. To ensure breadth and depth of review, the PIs, research librarians, graduate students, and special topics classes will engage in identifying, evaluating, summarizing, and synthesizing the relevant research (including gray literature) to produce an initial synthesis report that will be reviewed by select experts from the earlier panel. A second convening of practitioners (exhibit developers, educators, program designers, etc.) will be used to further contextualize the findings in ways that may better inform current practices in providing effective ISE. The resulting products include a peer-reviewed research synthesis and a practitioner handbook.

The proposed project's Broader Impacts lie in the potential to inform ISE practice in exhibit and program design and in the delivery of ISE-related experiences. Although the importance of the authenticity of an object or experience may ultimately be determined by the individual, this study will be able to provide guidance to help practitioners and scholars in making sometimes difficult design choices. Such insights may also inform other learning environments (e.g. the classroom) as well as other disciplinary areas (e.g. history, anthropology, art).

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
resource project Public Programs
Research on how museum staff are trained continues to emerge. Training varies considerably across institutions and typically includes observations, shadowing, and trial and error. While museum educators put high value on increasing visitor-centered participatory experiences, engagement based on acquisition-based theories of learning is still common among floor staff, even after training. Facilitating learning about science, technology, engineering, and mathematics (STEM) topics in ways that support visitors in constructing their own understanding is difficult, especially since floor staff/facilitators may be working simultaneously with children and adults of a range of ages, backgrounds, and goals. This project will advance understanding of how to facilitate open-ended learning experiences in ways that engage visitors in practices that align with the STEM disciplines. The project will result in an evidence-based facilitation framework and training modules for training informal science educators. The work is grounded in constructivist theories of learning and identity work and focuses on visitors constructing understanding of STEM topics through active engagement in the practices of STEM. This model also results in learning experiences in informal settings that are mutually reinforcing with the goals of schools. This research is being conducted through an established researcher-practitioner partnership between MOXI, the Wolf Museum of Exploration + Innovation and the University of California at Santa Barbara (UCSB).

The two primary goals of the work are to (1) enable visitors to better engage in STEM practices (practice-based learning) and (2) investigate the role of training in helping facilitators develop the practice-based facilitation strategies needed to support visitors' learning. STEM content in this study is physical science. Prior work resulted in two tools that constitute part of a facilitation framework (a practices-by-engagement matrix and three facilitation pathways) which help educators identify appropriate goals based on how the visitor is engaging with exhibits. The development of the final tool in the framework, facilitation strategies, and the refinement of the first two tools will be done using a design-based implementation research (DBIR) approach. Data collection and analysis will be directed and completed by research-practitioner teams of UCSB graduate students (researchers) and MOXI educators (practitioners); MOXI educators will be both participants and researchers. Data collection activities include: video data using point-of-view cameras worn by visitors and educators; interviews of educators and visitors; observations of the training program; and educator reflections. In the final year, a small field test will be done at six sites, representing different types of museums. Interviews and reflections comprise the data collection at the field sites.


This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Ron Skinner Danielle Harlow
resource research Public Programs
On the first day of the Science and Society course at the Cooperstown Graduate Program in Cooperstown, New York, I present the students with an incandescent lightbulb, with clear glass so one can easily see the filament inside. I ask the students how it works and they are able to tell me that the electricity comes in there, runs through the filament here, heats up, and produces light. Then I take out my iPhone and slide it across the table and ask, “How does this work?” Blank stares abound.
DATE:
TEAM MEMBERS: Carlyn Buckler
resource project Public Programs
Utah Valley University (UVU) with partners Weber State University (WSU) and American Indian Services (AIS) are implementing UTAH PREP (PREParation for STEM Careers) to address the need for early preparation in mathematics to strengthen and invigorate the secondary-to-postsecondary-to-career STEM pipeline. As the preliminary groundwork for UTAH PREP, each partner currently hosts a PREP program (UVU PREP, WSU PREP, and AIS PREP) that identifies low-income, under-represented minority, first-generation, and female students entering seventh grade who have interest and aptitude in math and science, and involves them in a seven-week, three-year summer intensive program integrating STEM courses and activities. The course content blends skill-building academics with engaging experiences that promote a clear understanding of how mathematical concepts and procedures are applied in various fields of science and engineering. Courses are enhanced through special projects, field trips, college campus visits, and the annual Sci-Tech EXPO. The purpose of the program is to motivate and prepare participants from diverse backgrounds to complete a rigorous program of mathematics in high school so that they can successfully pursue STEM studies and careers, which are vital to advancing the regional and national welfare.

UTAH PREP is based on the TexPREP program that originated at the University of Texas at San Antonio and which was named as one of the Bright Spots in Hispanic Education by the White House Initiative on Educational Excellence for Hispanics in 2015. TexPREP was adapted by UVU for use in Utah for non-minority serving institutions and in regions with lower minority populations, but with great academic and college participation disparity. With NSF funding for a two-year pilot program, the project partners are building UTAH PREP through a networked improvement community, collective impact approach that, if demonstrably successful, has the ability to scale to a national level. This pilot program's objectives include: 1) creating a UTAH PREP collaboration with commitments to a common set of objectives and common set of plans to achieve them; 2) strengthening existing PREP programs and initiating UTAH PREP at two or three other institutions of higher education in Utah, each building a sustainable local support network; 3) developing a shared measurement system to assess the impact of UTAH PREP programs, adaptations, and mutually reinforcing activities on students, including those from groups that are underrepresented in STEM disciplines; and 4) initiating a backbone organization that will support future scaling of the program's impact.
DATE: -
TEAM MEMBERS: Daniel Horns Andrew Stone Violeta Vasilevska
resource research Media and Technology
The ever-changing nature of academic science communication discourse can make it challenging for those not intimately associated with the field ― scientists and science-communication practitioners or new-comers to the field such as graduate students ― to keep up with the research. This collection of articles provides a comprehensive overview of the subject and serves as a thorough reference book for students and practitioners of science communication.
DATE:
TEAM MEMBERS: Achintya Rao