Observational instruments are receiving broad attention as measures of gauging the quality of interactions within formal educational settings (Bill and Melinda Gates Foundation, 2012). Scores from observations are used as critical pieces of information in the evaluation of teachers for purposes of making employment-related decisions and supporting professional development. Given the potential high-stakes use, a large body of research is emerging to address the validity of observation instruments as assessments of quality (Gitomer & Bell, in press). Using this research base, this paper focuses
The practice and use of assessments in the informal science education (ISE) realm is highly diverse and inconsistent, with differing stakeholders having dramatically different attitudes towards which assessments (if any) they value. This essay reviews the landscape of attitudes and uses of assessment on the part of informal science education stakeholders beyond the research community.
The National Science and Technology Council (NSTC) Committee on STEM Education (CoSTEM) was created to coordinate federal programs and activities that support STEM education pursuant to the requirements of Sec. 101 of the America COMPETES Reauthorization Act of 2010. The CoSTEM addresses a wide range of education and workforce policy issues including: research and development efforts that focus on STEM education at the PreK-12, undergraduate, graduate, and lifelong learning levels; and current and projected STEM workforce needs, trends, and issues. This paper describes the role of assessment
With increased resources and professionalism come increased expectations for the evaluation of individual projects to also provide field-wide evidence for the impact of ISE. But there has not been a significant growth in the use of psychometric measures that are validated to support field-wide assessments and norm-referenced tests for the field. This essay argues that expectations for the field to adopt normed assessments need to be contextualized in the practice and realities of ISE evaluation. While at the same time, evaluators of ISE projects need to build upon stepping stones such as
Recent work in the informal science education (ISE) field has begun to systematically categorize aspects of learning in a variety of ways. Most notable are the “Framework for Evaluating Impacts of Informal Science Education” (Friedman, A. (Ed.), 2008, henceforth ‘NSF’) and “Learning Science in Informal Environments” (LSIE, National Research Council, 2009, henceforth ‘NRC’). Both frameworks have potential implications for assessment as well as project planning.
A Study of Communication in the NISE Network (Network Communication Study), conducted during the sixth year of the grant, sought to learn how the four primary communication components that were developed in the first 5 years of NISE Net (NanoDays, face-to-face meetings, the regional hub structure, and the nisenet.org website) are functioning within the Network. In particular, the study explored how these components communicate information, ideas, and practices related to NISE Net between and within the three Network tiers.
Creating Museum Media for Everyone (CMME) is a proof-of-concept collaborative project between the Museum of Science (MOS) in Boston, WGBH's National Center for Accessible Media (NCAM) and Ideum (Funded by NSF-DRL, award number 1114549). The project aims to show how digital interactive museum exhibit devices can be designed and developed for visitors who have a wide range of disabilities. Current deliverables include two exemplar exhibition components in which museum visitors will learn STEM concepts by manipulating and analyzing real data. To create these deliverables, CMME utilized an
The CSMC-OMSI Partnership for Public Engagement (COPPE) project was developed to establish a strong and long-lasting partnership between the Center for Sustainable Materials Chemistry (CSMC) and the Oregon Museum of Science and Industry (OMSI). Through participation in this project, COPPE researchers and OMSI educators sought a deeper understanding of each other's profession while simultaneously developing a suite of Informal Science Education (ISE) outreach programs that engage the public in new and enduring ways. These new ISE platforms were developed to enhance public awareness in the areas
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryAnne Sinkey
The Ross Sea Project was a Broader Impact projects for an NSF sponsored research mission to the Ross Sea in Antarctica. The project, which began in the summer of 2010 and ended in May 2011, consisted of several components: (1) A multidisciplinary teacher-education team that included educators, scientists, Web 2.0 technology experts and storytellers, and a photographer/writer blogging team; (2) Twenty-five middle-school and high-school earth science teachers, mostly from New Jersey but also New York and California; (3) Weeklong summer teacher institute at Liberty Science Center (LSC) where teachers and scientists met, and teachers learned about questions to be investigated and technologies to be used during the mission, and how to do the science to be conducted in Antarctica; (4) COSEE NOW interactive community website where teachers, LSC staff and other COSEE NOW members shared lesson plans or activities and discussed issues related to implementing the mission-based science in their classrooms; (5) Technological support and consultations for teachers, plus online practice sessions on the use of Web 2.0 technologies (webinars, blogs, digital storytelling, etc.); (6)Daily shipboard blog from the Ross Sea created by Chris Linder and Hugh Powell (a professional photographer/writer team) and posted on the COSEE NOW website to keep teachers and students up-to-date in real-time on science experiments, discoveries and frustrations, as well as shipboard life; (7) Live webinar calls from the Ross Sea, facilitated by Rutgers and LSC staff, where students posed questions and interacted directly with shipboard researchers and staff; and (8) A follow-up gathering of teachers and scientists near the end of the school year to debrief on the mission and preliminary findings. What resulted from this project was not only the professional development of teachers, which extended into the classroom and to students, but also the development of a relationship that teachers and students felt they had with the scientists and the science. Via personal and virtual interactions, teachers and students connected to scientists personally, while engaged in the science process in the classroom and in the field.
Twin Cities Public Television in collaboration with a committee of STEM media professionals will organize a one-day conference devoted to network building and planning for an inaugural, multi-day STEM Media Producers Conference in 2013 or 2014. Professional organizations and conferences are well-known and effective means of building community and advancing practice within specific fields. Mass media – film, television, radio, and more recently, productions for online/digital platforms – have been a primary component of NSF’s support for informal science education (ISE) for more than three decades, drawing on the skills of an extremely diverse array of professionals. Yet despite the many common issues faced by these professionals and the increasingly cross-platform nature of ISE media projects in the NSF portfolio, at present no formal organization, professional society or annual conference exists for this community. An organization of media producers and a regular, annual meeting will provide a much-needed forum to address issues of training and professional development, facilitate cross-platform collaborations, increase the use of new media technologies, and synthesize evaluations and research into coherent statements of the powerful impact of STEM media – statements that can form the cornerstone of a STEM/ISE media awareness campaign. The event will take place in conjunction with the NSF PI Meeting in March 2012, capitalizing on the momentum generated at a media convening organized by the Center for the Advancement of Informal Science Education (CAISE) in July of 2011. The approximately 30 attendees will include participants in the July Convening and other STEM media professionals, all representing the subfields of Film, Television, Radio, and the increasingly important and diverse Online/Digital field, plus research and evaluation specialists and CAISE staff. The agenda will emphasize the potential of cross-platform collaborations and define a second agenda for a larger annual meeting that will include the larger community of STEM professionals.
This preliminary report, prepared by New Knowledge Organization Ltd. in collaboration with Pennsylvania State University, summarizes evaluation results from the development of an online and in-person national training program to support the creation of a National Network for Ocean Climate Change Interpretation (NNOCCI). The project also explored whether and how training might prove to be an effective and efficient vector for increased public literacy about ocean climate science at a national level.
DATE:
TEAM MEMBERS:
New England Aquarium CorporationJohn Fraser
This study assessed visitor outcomes from attending presentations by members of the National Network for Ocean Climate Change Interpretation [NNOCCI] community of practice at four test aquariums and two control site aquariums where climate change interpretation is delivered by professional environmental educators who have not received NNOCCI training. Four unique self-complete surveys were developed, each collecting comparable demographic data and then each uniquely querying: obligations to act on climate change information for people, animals or the ocean; confidence that actions will result
DATE:
TEAM MEMBERS:
New England Aquarium CorporationJohn Fraser