The National Science and Technology Council (NSTC) Committee on STEM Education (CoSTEM) was created to coordinate federal programs and activities that support STEM education pursuant to the requirements of Sec. 101 of the America COMPETES Reauthorization Act of 2010. The CoSTEM addresses a wide range of education and workforce policy issues including: research and development efforts that focus on STEM education at the PreK-12, undergraduate, graduate, and lifelong learning levels; and current and projected STEM workforce needs, trends, and issues. This paper describes the role of assessment
With increased resources and professionalism come increased expectations for the evaluation of individual projects to also provide field-wide evidence for the impact of ISE. But there has not been a significant growth in the use of psychometric measures that are validated to support field-wide assessments and norm-referenced tests for the field. This essay argues that expectations for the field to adopt normed assessments need to be contextualized in the practice and realities of ISE evaluation. While at the same time, evaluators of ISE projects need to build upon stepping stones such as
Recent work in the informal science education (ISE) field has begun to systematically categorize aspects of learning in a variety of ways. Most notable are the “Framework for Evaluating Impacts of Informal Science Education” (Friedman, A. (Ed.), 2008, henceforth ‘NSF’) and “Learning Science in Informal Environments” (LSIE, National Research Council, 2009, henceforth ‘NRC’). Both frameworks have potential implications for assessment as well as project planning.
A Study of Communication in the NISE Network (Network Communication Study), conducted during the sixth year of the grant, sought to learn how the four primary communication components that were developed in the first 5 years of NISE Net (NanoDays, face-to-face meetings, the regional hub structure, and the nisenet.org website) are functioning within the Network. In particular, the study explored how these components communicate information, ideas, and practices related to NISE Net between and within the three Network tiers.
Creating Museum Media for Everyone (CMME) is a proof-of-concept collaborative project between the Museum of Science (MOS) in Boston, WGBH's National Center for Accessible Media (NCAM) and Ideum (Funded by NSF-DRL, award number 1114549). The project aims to show how digital interactive museum exhibit devices can be designed and developed for visitors who have a wide range of disabilities. Current deliverables include two exemplar exhibition components in which museum visitors will learn STEM concepts by manipulating and analyzing real data. To create these deliverables, CMME utilized an
In the Communities of Learning for Urban Environments and Science (CLUES) project, the four museums of the Philadelphia-Camden Informal Science Education Collaborative worked to build informal science education (ISE) capacity in historically underserved communities. The program offered comprehensive professional development (PD) to Apprentices from 8-11 community-based organizations (CBO), enabling them to develop and deliver hands-on family science workshops. Apprentices, in turn, trained Presenters from the CBOs to assist in delivering the workshops. Families attended CLUES events both at the museums and in their own communities. The events focused on environmental topics that are especially relevant to urban communities, including broad topics such as climate change and the energy cycle to more specific topics such as animals and habitats in urban neighborhoods.
The Universally Designed Museum Programming project was envisioned as a way to create public programs that are more inclusive of people with disabilities. We used the concepts of universal design and Universal Design for Learning as well as our prior experiences with these topics in exhibition design and nanotechnology programming as a foundation for our work. Through this project, we gained insight into building a community of interest, facilitating a charrette in an inclusive way, using universal design guidelines to develop programs, and measuring the effectiveness of our process.
The CSMC-OMSI Partnership for Public Engagement (COPPE) project was developed to establish a strong and long-lasting partnership between the Center for Sustainable Materials Chemistry (CSMC) and the Oregon Museum of Science and Industry (OMSI). Through participation in this project, COPPE researchers and OMSI educators sought a deeper understanding of each other's profession while simultaneously developing a suite of Informal Science Education (ISE) outreach programs that engage the public in new and enduring ways. These new ISE platforms were developed to enhance public awareness in the areas
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryAnne Sinkey
This tool was created by Museum of Science, Boston Design Challenges educators and the Research and Evaluation team, intended to record observations of children’s engagement in the engineering design process during participation in design-based activities in a science museum setting. It consists of a checklist of behaviors corresponding with steps of the engineering design process, previously developed for the program based on state and national standards, educator input, and past evaluator observations. The behavioral checklist matches to parts of the engineering design process, including
The Ross Sea Project was a Broader Impact projects for an NSF sponsored research mission to the Ross Sea in Antarctica. The project, which began in the summer of 2010 and ended in May 2011, consisted of several components: (1) A multidisciplinary teacher-education team that included educators, scientists, Web 2.0 technology experts and storytellers, and a photographer/writer blogging team; (2) Twenty-five middle-school and high-school earth science teachers, mostly from New Jersey but also New York and California; (3) Weeklong summer teacher institute at Liberty Science Center (LSC) where teachers and scientists met, and teachers learned about questions to be investigated and technologies to be used during the mission, and how to do the science to be conducted in Antarctica; (4) COSEE NOW interactive community website where teachers, LSC staff and other COSEE NOW members shared lesson plans or activities and discussed issues related to implementing the mission-based science in their classrooms; (5) Technological support and consultations for teachers, plus online practice sessions on the use of Web 2.0 technologies (webinars, blogs, digital storytelling, etc.); (6)Daily shipboard blog from the Ross Sea created by Chris Linder and Hugh Powell (a professional photographer/writer team) and posted on the COSEE NOW website to keep teachers and students up-to-date in real-time on science experiments, discoveries and frustrations, as well as shipboard life; (7) Live webinar calls from the Ross Sea, facilitated by Rutgers and LSC staff, where students posed questions and interacted directly with shipboard researchers and staff; and (8) A follow-up gathering of teachers and scientists near the end of the school year to debrief on the mission and preliminary findings. What resulted from this project was not only the professional development of teachers, which extended into the classroom and to students, but also the development of a relationship that teachers and students felt they had with the scientists and the science. Via personal and virtual interactions, teachers and students connected to scientists personally, while engaged in the science process in the classroom and in the field.
This multiplatform media and science center project is designed to engage audiences in humanity's deepest questions like the nature of love, reality, time and death in both scientific and humanistic terms. Project deliverables include 5 hour-long radio programs for broadcast on NPR stations, public events/museum exhibits at the Exploratorium in San Francisco, kiosks in venues throughout the city, and a social media engagement campaign. The audience of the project is large and diverse using mass media and the internet. But the project will specifically target young, online, and minority audiences using various strategies. The project is designed to help a diverse audience understand the impact of new scientific developments as well as the basic science, technology, engineering and math needed to be responsible, informed citizens. Innovative elements of the project include the unique format of the radio programs that explore complex topics in an engaging and compelling way, the visitor engagement strategy at the Exploratorium, and the social media strategy that reaches niche audiences who might never listen to the radio broadcasts, but find the podcasts and blogs engaging. The Exploratorium will be opening a new building in 2013 and will include exhibits and programs that are testing grounds for this project. This is a new model that aligns the radio content with exhibitions, social media, and in person events at the Exploratorium, providing a unique holistic approach. The project is designed to inspire people to think and talk about science and want to find out more. The evaluation will measure the impacts on the targeted audiences reached by each of the key delivery methods. Data will be collected using focus groups; intercept interviews with people in public places, and longitudinal panels. The focus will be on 5 targeted audiences (young adults, families with children, non-NPR listeners, underrepresented minorities, and adults without college experience). This comprehensive evaluation will likely contribute important knowledge to the field based on this multiple-platform collaborative model.
QUEST Beyond Local is a consortium of six public media providers across the country coming together in a unique collaborative structure to foster widespread STEM literacy for general audiences; support formal and informal education outcomes in the sciences; and revive ailing science and environment journalism in the face of its rapid decline. QUEST Beyond Local is built on the success of the local, cross-editorial QUEST model, in which media making professionals from multiple disciplines--radio, television, web, and especially education--collaborate to distribute high-quality content to general and underserved audiences. Two years ago, KQED (serving Northern California) introduced a capacity-building effort with five other public media stations serving markets across the nation: Seattle (KCTS), Wisconsin (WPT/WPR), Nebraska (NET), Cleveland (ideastream), and North Carolina (UNC-TV). On the heels of this pilot process, QUEST Beyond Local will expand production in all markets and focus its multimedia efforts around the theme "Science of Sustainability" so as to achieve maximum effect on critical STEM outcomes in formal and informal education settings, and to foster science/environment literacy among a wide general audience. QUEST Beyond Local is defined by an organizationally and technologically innovative model of content creation: a newsroom structured according to a hub and spoke model; with common branding, technical, and style guidelines; and with a central coordinating and editorial office liaising between local production teams. Under the guidance of this central office, the collaborative seeks to create content with both local authority and national relevance. Building on existing media impact research, and previous research and evaluation of QUEST, research firm Rockman et al will apply evaluation theory to determine: (1) the structures and strategies to a successful STEM collaborative that contribute to a greater understanding of and engagement in science and environment topics; and (2) determine the interests, priorities, and media consumption habits of local and national STEM audiences. Primary project deliverables include three diverse multimedia packages for general and professional audiences, focusing on three main themes and anchored in STEM disciplines. In total, the three packages will include: 18 television segments; 6 half-hour television programs; 20 radio reports; 18 "web extras" (slide shows, maps, etc.); 12 web-based videos; 144 blog posts; 18 education "explainers"; 5 educator trainings; and a comprehensive distribution and social media campaign. All efforts will be supported by at least 18 science community partners, including zoos, museums, aquariums, research centers, and others. Through these efforts, the collaborative seeks to repair the systemic damage done by years of neglect to science/environment journalism--particularly the marked decline in this type of coverage over the last decade. This decline is perhaps related to the observed disconnect between the public and scientific knowledge, despite a demonstrated public appetite for science content and educators' reported desire for more resources and professional development opportunities focused on STEM topics. At a time when an evolving workforce and economy increasingly demand STEM skills and environmental literacy, QUEST Beyond Local will contribute resources to address these challenges.