This paper discusses the value and place of evaluation amidst increasing demands for impact. We note that most informal learning institutions do not have the funds, staff or expertise to conduct impact assessments requiring, as they do, the implementation of rigorous research methodologies. However, many museums and science centres do have the experience and capacity to design and conduct site-specific evaluation protocols that result in valuable and useful insights to inform ongoing and future practice. To illustrate our argument, we discuss the evaluation findings from a museum-led teacher
This paper discusses the value and place of evaluation amidst increasing demands for impact. We note that most informal learning institutions do not have the funds, staff or expertise to conduct impact assessments requiring, as they do, the implementation of rigorous research methodologies. However, many museums and science centres do have the experience and capacity to design and conduct site-specific evaluation protocols that result in valuable and useful insights to inform ongoing and future practice. To illustrate our argument, we discuss the evaluation findings from a museum-led teacher
The 2nd annual conference of the ad hoc group Science Communication was dedicated to research on risk and uncertainty as important challenges for the present practice of science communication. The review firstly offers a short portrait of the ad hoc group Science Communicaiton as a newly established network of communication scholars and secondly reconstructs the course of the highliy spirited debate during the conference in Jena.
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
The Maker Movement is a community of hobbyists, tinkerers, engineers, hackers, and artists who creatively design and build projects for both playful and useful ends. There is growing interest among educators in bringing making into K-12 education to enhance opportunities to engage in the practices of engineering, specifically, and STEM more broadly. This article describes three elements of the Maker Movement, and associated research needs, necessary to understand its promise for education: 1) digital tools, including rapid prototyping tools and low-cost microcontroller platforms, that
This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?
The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.
The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.
The Katonah Museum of Art (KMA) contracted Randi Korn & Associates, Inc. (RK&A) to evaluate its early childhood program, ArteJuntos/ArtTogether (ArteJuntos), ArteJuntos is a bilingual art and culture-based family literacy program that introduces low-income, educationally at-risk preschool children and their families to the KMA. Using works of art in KMA’s exhibitions, the program connects parents and their children (ages 3-5) to activities that support children’s emergent literacies—observation, oral and receptive language, and critical thinking skills.
How did we approach this study?
RK
In this paper, the authors synthesize three types of research-practice partnerships (RPPs) for informal learning. The article includes descriptions of example partnerships between local researchers and informal educators from the Hive NYC Learning Network, Community Practice Research Collaboration, and California Tinkering Afterschool Network. The synthesis paper concludes with a review of characteristics commonly found in partnerships in informal science education.
This paper describes Synergies, an on-going longitudinal study and design effort, being conducted in a diverse, under-resourced community in Portland, Oregon, with the goal of measurably improving STEM learning, interest and participation by early adolescents, both in school and out of school. Authors examine how the work of this particular research-practice partnership is attempting to accommodate the six principles outlined in this issue: (1) more accurately reflect learning as a lifelong process occurring across settings, situations and time frames; (2) consider what STEM content is worth
Scientific literacy is an important educational and societal goal. Measuring scientific literacy, however, has been problematic because there is no consensus regarding the meaning of scientific literacy. Most definitions focus on the content and processes of major science disciplines, ignoring social factors and citizens’ needs. The authors developed a definition of scientific literacy for the California 4-H Program from the citizen’s perspective, concentrating on real-world science-related situations. The definition includes four anchor points: science content; scientific reasoning skills
A new online and mobile resource for teens, Sparticl presents the best science, technology, engineering, and math (STEM) resources on the web. A team of experts has hand-selected articles, videos, games, hands-on activities, and other content that is age-appropriate, accurate, safe, and engaging. Teens and educators can explore and investigate, share and contribute—all the while earning points and badges.
The site is designed to allow teens to easily rate, comment on, and share their favorite games, articles, and activities. Users can create their own customized collections and submit new resources. The goal of Sparticl is to create an online destination that is irresistible to kids and valued by parents, teachers, and the scientific community, a destination where providers of high-quality STEM content will be proud to be included. Sparticl is created by the National Productions division of Twin Cities Public Television and is made possible with the generous support of 3M.
QuarkNet is a national program that partners high school science teachers and students with particle physicists working in experiments at the scientific frontier. These experiments are searching for answers to fundamental questions about the origin of mass, the dimensionality of spacetime and the nature of symmetries that govern physical processes. Among the experimental projects at the energy frontier with which QuarkNet is affiliated is the Large Hadron Collider, which is poised at the horizon of discovery. The LHC will come on line during the 5-years of this program. QuarkNet is led by a group of teachers, educators and physicists with many years of experience in professional development workshops and institutes, materials development and teacher research programs. The project consists of 52 centers at universities and research labs in 25 states and Puerto Rico. It is proposed that Quarknet be funded as a partnership among the ESIE program of EHR; the Office of Multidisciplinary Activities and the Elementary Particle Physics Program (Division of Physics), both within MPS; as well as the Division of High Energy Physics at DOE.
DATE:
-
TEAM MEMBERS:
Mitchell WayneRandal RuchtiDaniel Karmgard