Currently, many museums present histories of science and technology, but very few are integrating scientific activity--observation, measurement, experimentation-with the time- and place-specific narratives that characterize history-learning experiences. For the Prairie Science project, Conner Prairie is combining proven science center-style activities, developed by the Science Museum of Minnesota, with family-engagement strategies developed through extensive research and testing with audiences in historical settings. The goal of this integration is to create guest experiences that are rich in both STEM and historical content and encourage family learning. One key deliverable of this project is the Create.Connect gallery, which is currently installed at Conner Prairie. Create.Connect allows the project team to evaluate and research hands-on activities, facilitation strategies and historic settings to understand how these elements combine to encourage family conversations and learning around historical narratives and STEM content. For example, in one exhibit area families can experiment with creating their own efficient wind turbine designs while learning about the innovations of the Flint & Walling windmill manufacturing company from Indiana. The activity is facilitated by a historic interpreter portraying a windmill salesman from 1900. The interpreter not only guides the family though the process of scientific inquiry, but shares his historic perspective on wind power as well. Two other exhibit areas invite hands-on exploration of electrical circuits and forces in motion as they connect to stories from Indiana history. Evaluation and research findings from the Create.Connect exhibit will be used to develop a model that can guide other history institutions that want to incorporate STEM content and thinking into their exhibits and interpretation. By partnering with the Science Museum of Minnesota, we will combine the experience of science center professionals and history museum professionals to find the best practices for incorporating science activities into historic settings. To ensure that this dissemination model is informed from many perspectives, Conner Prairie has invited the participation of four history museums: The Museum of America and the Sea, Mystic, Connecticut; the California State Railroad Museum, Sacramento, California; the Wabash County Historical Society, Wabash, Indiana; and the Oliver H. Kelley Farm, Elk River, Minnesota. Each of the four participants will install history-STEM exhibit components which will be connected to location-specific historic narratives. Drawing on the staff experience and talents of participant museums, this project will develop realistic solutions to an array of anticipated barriers. These issues and the resulting approaches will become part of a stronger, more adaptable dissemination model that will support history museums in creating STEM-based guest experiences.
The STAR Library Education Network: a hands-on learning program for libraries and their communities, (STAR_Net for short) is led by the National Center for Interactive Learning (NCIL) at the Space Science Institute (PI: Paul Dusenbery). STAR stands for Science-Technology, Activities and Resources. Team members include NCIL staff, the American Library Association (ALA), Lunar and Planetary Institute (LPI), and the National Girls Collaborative Project (NGCP). STAR_Net is developing two comprehensive, informal education programs: Discover Earth and Discover Tech. The project also includes a comprehensive evaluation plan and a research component that explores how public libraries can serve as a STEM learning center in rural, underserved communities. STAR_Net is supported through a grant from the National Science Foundation. The STAR_Net project includes two traveling library exhibits: Discover Earth: A Century of Change and Discover Tech: Engineers Make a World of Difference. The Discover Earth exhibition features interactive, multimedia displays that allow exhibit visitors to interact with digital information in a dynamic way, encouraging new perspectives on our planet. Discover Tech introduces the many extraordinary ways that engineers solve problems to help people and societies around the world. Similar to a science center experience, visitors and families will be able to explore and tinker with their own engineering solutions. A number of STEM activities and resources will be developed by project staff and by other organizations to help librarians and community partners offer a wide variety of programs for their patrons. Besides the traveling exhibits and programs, STAR_Net also includes library staff training (online and in-person) and a Community of Practice (CoP) for librarians (including non-host librarians) to interact and partner with STEM professionals and organizations. NCI's Kate Haley Goldman and staff from Evaluation and Research Associates are conducting the project's evaluation.
Assessing science learning in informal environments involves a series of challenges that are difficult to address using traditional assessment practices (National Research Council, 2009). Some of the assessment challenges inherent in informal and afterschool environments include: (a) interactions in these environments are diverse in terms of duration, type of activity, number of people involved; (b) they usually include emerging behavior due to unpredictable interactions with other participants (e.g., peers, family members, and facilitators); and (c) these environments are characterized by a
Cross-national assessments of student learning in mathematics, science, reading, computer technology, and civics have been successfully conducted since the 1960’s. Each subject required professional researchers and educators from different cultural backgrounds to reach agreement on a common definition of the content areas and measurement techniques for formal schooling. Two international organizations, the International Association for the Evaluation of Educational Achievement (IEA) and the Organization for Economic and Cooperation and Development (OECD) are now continuously conducting
This background paper is intended to support consideration of assessments "in improving program quality and student learning outcomes in the field of informal science education." This includes three questions: (a) What definitions of engagement, interest, curiosity, and motivation might be used in evaluations of informal and after-school science learning programs and activities? (b) Given the diversity of learning experiences, what are the prospects for developing common definitions of engagement, interest, curiosity, and motivation? And, (c) Given the diversity of types of informal and after
The NRC Framework for K – 12 Science Education (2012) lists five major ideas that are essential to the design of assessments and learning environments: 1) limited number of core ideas of science, 2) cross-cutting concepts, 3) engaging students in scientific and engineering practices, 4) building integrated understanding as a developmental process, and 5) the coupling of scientific ideas and scientific and engineering practices to develop integrated understanding. What implications do these major ideas have for assessment in informal science setting? This paper will discuss each of these ideas
Observational instruments are receiving broad attention as measures of gauging the quality of interactions within formal educational settings (Bill and Melinda Gates Foundation, 2012). Scores from observations are used as critical pieces of information in the evaluation of teachers for purposes of making employment-related decisions and supporting professional development. Given the potential high-stakes use, a large body of research is emerging to address the validity of observation instruments as assessments of quality (Gitomer & Bell, in press). Using this research base, this paper focuses
The practice and use of assessments in the informal science education (ISE) realm is highly diverse and inconsistent, with differing stakeholders having dramatically different attitudes towards which assessments (if any) they value. This essay reviews the landscape of attitudes and uses of assessment on the part of informal science education stakeholders beyond the research community.
The National Science and Technology Council (NSTC) Committee on STEM Education (CoSTEM) was created to coordinate federal programs and activities that support STEM education pursuant to the requirements of Sec. 101 of the America COMPETES Reauthorization Act of 2010. The CoSTEM addresses a wide range of education and workforce policy issues including: research and development efforts that focus on STEM education at the PreK-12, undergraduate, graduate, and lifelong learning levels; and current and projected STEM workforce needs, trends, and issues. This paper describes the role of assessment
With increased resources and professionalism come increased expectations for the evaluation of individual projects to also provide field-wide evidence for the impact of ISE. But there has not been a significant growth in the use of psychometric measures that are validated to support field-wide assessments and norm-referenced tests for the field. This essay argues that expectations for the field to adopt normed assessments need to be contextualized in the practice and realities of ISE evaluation. While at the same time, evaluators of ISE projects need to build upon stepping stones such as
Creating Museum Media for Everyone (CMME) is a proof-of-concept collaborative project between the Museum of Science (MOS) in Boston, WGBH's National Center for Accessible Media (NCAM) and Ideum (Funded by NSF-DRL, award number 1114549). The project aims to show how digital interactive museum exhibit devices can be designed and developed for visitors who have a wide range of disabilities. Current deliverables include two exemplar exhibition components in which museum visitors will learn STEM concepts by manipulating and analyzing real data. To create these deliverables, CMME utilized an
This preliminary report, prepared by New Knowledge Organization Ltd. in collaboration with Pennsylvania State University, summarizes evaluation results from the development of an online and in-person national training program to support the creation of a National Network for Ocean Climate Change Interpretation (NNOCCI). The project also explored whether and how training might prove to be an effective and efficient vector for increased public literacy about ocean climate science at a national level.
DATE:
TEAM MEMBERS:
New England Aquarium CorporationJohn Fraser