Assessing science learning in informal environments involves a series of challenges that are difficult to address using traditional assessment practices (National Research Council, 2009). Some of the assessment challenges inherent in informal and afterschool environments include: (a) interactions in these environments are diverse in terms of duration, type of activity, number of people involved; (b) they usually include emerging behavior due to unpredictable interactions with other participants (e.g., peers, family members, and facilitators); and (c) these environments are characterized by a
Cross-national assessments of student learning in mathematics, science, reading, computer technology, and civics have been successfully conducted since the 1960’s. Each subject required professional researchers and educators from different cultural backgrounds to reach agreement on a common definition of the content areas and measurement techniques for formal schooling. Two international organizations, the International Association for the Evaluation of Educational Achievement (IEA) and the Organization for Economic and Cooperation and Development (OECD) are now continuously conducting
This background paper is intended to support consideration of assessments "in improving program quality and student learning outcomes in the field of informal science education." This includes three questions: (a) What definitions of engagement, interest, curiosity, and motivation might be used in evaluations of informal and after-school science learning programs and activities? (b) Given the diversity of learning experiences, what are the prospects for developing common definitions of engagement, interest, curiosity, and motivation? And, (c) Given the diversity of types of informal and after
The NRC Framework for K – 12 Science Education (2012) lists five major ideas that are essential to the design of assessments and learning environments: 1) limited number of core ideas of science, 2) cross-cutting concepts, 3) engaging students in scientific and engineering practices, 4) building integrated understanding as a developmental process, and 5) the coupling of scientific ideas and scientific and engineering practices to develop integrated understanding. What implications do these major ideas have for assessment in informal science setting? This paper will discuss each of these ideas
Observational instruments are receiving broad attention as measures of gauging the quality of interactions within formal educational settings (Bill and Melinda Gates Foundation, 2012). Scores from observations are used as critical pieces of information in the evaluation of teachers for purposes of making employment-related decisions and supporting professional development. Given the potential high-stakes use, a large body of research is emerging to address the validity of observation instruments as assessments of quality (Gitomer & Bell, in press). Using this research base, this paper focuses
The practice and use of assessments in the informal science education (ISE) realm is highly diverse and inconsistent, with differing stakeholders having dramatically different attitudes towards which assessments (if any) they value. This essay reviews the landscape of attitudes and uses of assessment on the part of informal science education stakeholders beyond the research community.
The National Science and Technology Council (NSTC) Committee on STEM Education (CoSTEM) was created to coordinate federal programs and activities that support STEM education pursuant to the requirements of Sec. 101 of the America COMPETES Reauthorization Act of 2010. The CoSTEM addresses a wide range of education and workforce policy issues including: research and development efforts that focus on STEM education at the PreK-12, undergraduate, graduate, and lifelong learning levels; and current and projected STEM workforce needs, trends, and issues. This paper describes the role of assessment
With increased resources and professionalism come increased expectations for the evaluation of individual projects to also provide field-wide evidence for the impact of ISE. But there has not been a significant growth in the use of psychometric measures that are validated to support field-wide assessments and norm-referenced tests for the field. This essay argues that expectations for the field to adopt normed assessments need to be contextualized in the practice and realities of ISE evaluation. While at the same time, evaluators of ISE projects need to build upon stepping stones such as
A working group of the NIH Advisory Committee to the Director was tasked with developing a model for a sustainable and diverse U.S. biomedical research workforce that can inform decisions about training the optimal number of people for the appropriate types of positions that will advance science and promote health. Based on this analysis and recognizing that there are limits to NIH’s ability to control aspects of the training pipeline, the working group was asked to make recommendations for actions that NIH should take to support a future sustainable biomedical research infrastructure. This
DATE:
TEAM MEMBERS:
National Institute of HealthDorit Zuk
With support from the Institute of Museum and Library Services, the Mathematics in Zoos and Aquariums project worked with zoo and aquarium staff members to integrate mathematical concepts into the interpretation of living collections. Over two years, the project developed three activities related to logic, measurement, and data analysis and conducted workshops with over 400 staff from 124 institutions. In refining the workshop model and conducting evaluation, we found that most staff increased their comfort with and use of math-based activities and that the goals of the participants and the
This report, commissioned by the Wellcome Trust, provides a review of the value of informal science learning to science education in the UK. The study seeks to provide: a better understanding of the scope of informal science learning, its theoretical base and the types of change it can bring about in the understanding of and attitudes towards science; recommendations for robust methods for evaluating the impact of informal science learning, based on an analysis of practice in the field; recommendations on reaching deprived learners, schools and families; and recommendations based on best
DATE:
TEAM MEMBERS:
GHK ConsultingRichard LloydRoss NeilsonSuzanne KingMark DyballWellcome Trust
This checklist provides a step-by-step process for preparing, leading, and ending an after school science project. The document also includes a partner checklist for science coaches and trainers when instructing adult learners.
DATE:
TEAM MEMBERS:
National Partnerships for After School Science 2