These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
Expanding on the encouraging outcomes of an NSF-funded conference, this three-year project led by the National Center for Science and Civic Engagement at Harrisburg University of Science and Technology, in collaboration with the Koshland Science Museum of the National Academy of Sciences, will explore and evaluate ways to support new collaborations between professionals in institutions of higher education and informal STEM education around areas of common interest. The primary goal is to develop the educational infrastructure to grow and efficiently sustain multiple cross-organizational partnership activities at the intersection of learning about science, society and civic engagement around such possible topics as energy, environment, genetics, earth resources, computers and ethics, nanotechnology, etc. The initiative is: 1) creating a joint organizing "secretariat" to provide communications and support through low-cost shared services for at least six partnerships around the country; 2) providing partnership support and technical assistance to seed the six national partnerships, and 3) sharing evaluation and analysis services across all the partnerships. The outcomes of the work pertain to improvements in professional knowledge and practice in higher education and informal science education, as well as the improvement of learning by undergraduates and by the general public.
In the summer of 2010, the Denver Museum of Nature & Science (DMNS) spearheaded an effort to bring together a group of Denver Metro Area cultural institutions as part of an informal network of professionals interested in visitor evaluation (hereafter referred to as “the Network”). The founding purpose of the Network was to utilize the existing resources of DMNS to build evaluation capacity in other institutions, share instruments and data between cultural institutions, and to embark on citywide evaluation projects that would be of benefit to all institutions involved in the group. The Network
The Girls RISEnet project convened an international community to explore the role of science centers in issues of gender equity in STEM learning. This effort resulted in two major products, including this international literature review that synthesizes what is known about how science centers and museums contribute to girls' engagement with STEM, summarizes what is useful for practice, and identifies gaps in the research. In addition, an international survey identified common global themes and issues and began to outline opportunities for science centers and museums to advance gender equity.
In December 2008, the Monterey Bay Aquarium, in partnership with the New England Aquarium and the National Aquarium in Baltimore, hosted a summit of leaders from aquariums across North America and beyond. The intent was to empower aquarium professionals to elevate their collective focus on the relationship between climate change and the ocean, and to develop collaborative strategies for communicating climate change and inspiring solution-‐oriented actions among our institutions and audiences. The summit represented the birth of a community. The three‐day event succeeded in mobilizing 34
The Climate Interpretation Coalition is maturing beyond a set of discrete institutions to become a collective voice for communicating climate change and the ocean. As the three‐year funded NOAA program and the empowerment evaluation end, the question of how to build ongoing communities of support arises. The findings are based upon an interview‐based exploration of individuals who participated in the 2012 Baltimore summit and who represent a broad spectrum of engagement (highly engaged with creating the coalition through to limited engagement in a single summit). The interviews were nested
Find out how afterschool and summer learning can support student success in the Expanding Minds and Opportunities compendium, released by The Expanded Learning & Afterschool Project. This collection of nearly 70 articles includes reports, studies, opinion commentaries, and examples of best practices makes the case that opportunities in out-of-school time learning can have positive impacts on youth development—including in STEM.
DATE:
TEAM MEMBERS:
Terry Peterson
resourceevaluationProfessional Development, Conferences, and Networks
Leaders of the only two large-scale assessments of environmental literacy used in the U.S. to date (Programme for International Student Assessment [PISA] and the National Environmental Literacy Assessment [NELA]), led by an experienced PI representing the North American Association for Environmental Education, to develop a new, comprehensive, research-based framework for assessing environmental literacy. By bringing together, for the first time, experts in research, assessment, and evaluation from the fields of science education, environmental education, and related social science fields -
DATE:
TEAM MEMBERS:
Joe E HeimlichNorth American Association for Environmental Education
resourceresearchProfessional Development, Conferences, and Networks
The resources on this handout were shared by participants of the “Bridging the practice-research gap” forum, which took place on InformalScience.org from July 6-17, 2015.
DATE:
TEAM MEMBERS:
Association of Science-Technology CentersGrace Troxel
resourceresearchProfessional Development, Conferences, and Networks
This article conceptualizes and measures collaboration. An empirically validated theory of collaboration, one that can inform both theory and practice, demands a systematic approach to understanding the meaning and measurement of collaboration. We present findings from a study that develops and tests the construct validity of a multidimensional model of collaboration. Data collected using a mail questionnaire sent to 1382 directors of organizations that participate in a large national service program provides the basis for a higher order confirmatory factor analysis. The model that emerges
DATE:
TEAM MEMBERS:
Ann Marie ThompsonJames PerryTheodore Miller