Taking NPASS (National Partnerships for Afterschool Science) to Scale builds on a previously funded effort (DRL 0515549) designed to provide professional development for out-of-school time (OST) science trainers, administrators, and frontline staff in collaboration with the California School-Age Consortium, the Georgia Afterschool Investment Council, The After-School Institute, Minnesota School Age Child Care Alliance, University of Missouri-Columbia, University of New Hampshire, and the Ohio Child Care Resource and Referral Association. Rutgers University-New Brunswick. The primary target audiences for this project are OST science trainers, administrators of statewide OST networks and frontline staff as well as youth participating in afterschool programs, most of whom are from traditionally underserved and economically challenged groups. Deliverables include three-day, semi-annual train-the-trainer institutes; annual seminars for NPASS leaders; professional development tools; science kits; and the NPASS website. The project design consists of four levels of management and delivery. At Level 1, the NPASS2 primary partners, EDC and the Boston Children's Museum, provide three-day state-based OST Science Trainer Institutes on a semi-annual basis. The Science Trainer Institutes combine hands-on experience with pedagogical training in informal science learning, youth development, and the logistics of working with OST sites. During Level 2, the eight State Leadership Teams recruit two cohorts of OST practitioners to attend Science Trainer Institutes. The new Science Trainers then identify OST sites to attend a series of half-day science trainings in Level 3. Each session introduces and models new science projects for use in afterschool settings, including the NSF-funded Design It! or Explore It! materials. Finally, at Level 4, OST sites serving children from predominantly underserved and underrepresented populations are invited to join the NPASS2 initiative. OST sites receive a materials kit and guide for the activities at each training session. It is estimated that as many as 10 OST state leaders and 100 science trainers will be reached at 750 community sites serving 22,000 youth. The combined intervention has the potential to change the OST landscape. The project evaluation to be conducted by the Goodman Research Group (GRG) employs a longitudinal design to determine participants' growth over time and the magnitude of change among the variables. The formative evaluation is designed to assess the development of the project's deliverables while the summative evaluation focuses on professional audience impacts. The NPASS2 summative evaluation examines the OST science trainers, OST state network administrators, youth workers, and site administrators through a baseline survey, in addition to annual questionnaires and interviews of network administrators and OST site administrators. The pre-post design measures changes in trainers' understanding, attitudes, behavior, and skills related to informal STEM education research or practice. To maximize the efficiency and authenticity of the evaluation, GRG will use the SET/STEM Leader Competencies Rubric currently being developed jointly by EDC in collaboration with the National 4-H Council\'s SET PD Committee.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
The ScienceMakers: African Americans and Scientific Innovation is a three-year project designed to increase awareness of the contributions of African American scientists, raise awareness of STEM careers, and increase understanding of STEM concepts through the creation of education, media, and career resources. The project team is supplemented with an extensive advisory board of STEM education, museum, and community professionals, as well as representatives from partnering science centers. Project partners include the St. Louis Science Center, Liberty Science Center, New York Hall of Science, Pacific Science Center, Franklin Institute, COSI Columbus, Lawrence Hall of Science, SciWorks, Detroit Science Center, and MOSI Chicago. Additional collaborators include middle and high schools with high minority populations. Project deliverables include a fully accessible multi-media archive of video oral histories of 180 African American scientists and web resources and contests utilizing Web 2.0 and 3.0 applications such as social networking tools that foster engagement and build community around the ScienceMakers. Public programs for youth and adults at science museums, after-school programs, and community organizations highlight African American contributors, and encourage interest in science and science careers and the ScienceMakers DVD Toolkit expand the reach of this innovative project. Intended impacts for youth and adults consist of increased awareness of STEM concepts and career options, exposure to African American scientists, awareness of the contributions of minority scientists, and 21st century skills. Intended impacts on professional audiences include increased awareness and understanding of STEM careers and workforce diversity, 21st century skills, and STEM career options. The project evaluation, conducted by Knight-Williams Research Communications, utilizes a mixed-methods approach. The evaluation assesses the impact of the oral history archive, public programs, and other deliverables on public and professional audiences' knowledge, interest, and awareness of the contributions of African American scientists, STEM concepts, and STEM careers. The evaluation also includes an ethnography which examines factors that contribute to success in STEM careers by African-American scientists. The ScienceMakers significantly expands the world\'s largest searchable oral history archive and may have an enduring impact on research and practice in the field of informal science education. The project has the potential to enrich programs and exhibits, while raising awareness of the contributions of African-American scientists among informal science education professionals and the general public.
The Experiential Science Education Research Collaborative (XSci) at the University of Colorado Denver has established a museum educator/theater network of eight museums around the country, pairing larger with smaller institutions. The Association of Science-Technology Centers, the NASA Astrobiology Institute, and the Astronomical Society of the Pacific and several other organizations also are collaborators. The primary audience is informal science educators; secondary audiences are museum and science center visitors. The Science Theater Education Programming System (STEPS) is a technology the allows educators to create their own media-enhanced live theatrical presentations of science programs that include dynamic content, interactive virtual characters, and multiple plot-lines and endings to shows. The initial set of theater programs focus on astrobiology, along with a suite of training programs and communication formats for educators. The STEPS technology allows these programs to be delivered both on site and via outreach, depending on the goals of each organization. An in-depth research component is examining the impact of the project\'s designed community of practice structure utilizing team leadership theory in terms of professional identity construction for participating informal educators. Deliverables include: the museum partnership network, the STEPS system and programs, professional development tutorials and workshops, evaluation of the programs, and research products, among others.
When it comes to STEM education, the nation’s K–12 public schools cannot do it all. The nature of 21st century proficiency in science, technology, engineering, and mathematics is too complex for any single institution. The good news is that schools do not have to do it alone. Museums, zoos, nature centers, aquariums, and planetariums are among the several thousand informal science institutions in the United States that regularly engage young people in observing, learning, and using STEM knowledge and skills. Providing a richness of resources unavailable in any classroom, informal science
DATE:
TEAM MEMBERS:
Community for Advancing Discovery Research in Education (CADRE)
Science centers and museums are currently experimenting to strengthen the participation of the public in two-way conversations between the public and the institution. Eventually, these activities will lead to a stronger role of the public in the decision making process of the museum. We analyzed the current situation faced by science museums in Europe in light of the recent discourse on public engagement with science, and we identified the main barriers and obstacles that prevent actual decision making of the public within the institutions. Finally, suggestions for solutions are discussed.
Assessing science learning in informal environments involves a series of challenges that are difficult to address using traditional assessment practices (National Research Council, 2009). Some of the assessment challenges inherent in informal and afterschool environments include: (a) interactions in these environments are diverse in terms of duration, type of activity, number of people involved; (b) they usually include emerging behavior due to unpredictable interactions with other participants (e.g., peers, family members, and facilitators); and (c) these environments are characterized by a
Cross-national assessments of student learning in mathematics, science, reading, computer technology, and civics have been successfully conducted since the 1960’s. Each subject required professional researchers and educators from different cultural backgrounds to reach agreement on a common definition of the content areas and measurement techniques for formal schooling. Two international organizations, the International Association for the Evaluation of Educational Achievement (IEA) and the Organization for Economic and Cooperation and Development (OECD) are now continuously conducting
This background paper is intended to support consideration of assessments "in improving program quality and student learning outcomes in the field of informal science education." This includes three questions: (a) What definitions of engagement, interest, curiosity, and motivation might be used in evaluations of informal and after-school science learning programs and activities? (b) Given the diversity of learning experiences, what are the prospects for developing common definitions of engagement, interest, curiosity, and motivation? And, (c) Given the diversity of types of informal and after
The NRC Framework for K – 12 Science Education (2012) lists five major ideas that are essential to the design of assessments and learning environments: 1) limited number of core ideas of science, 2) cross-cutting concepts, 3) engaging students in scientific and engineering practices, 4) building integrated understanding as a developmental process, and 5) the coupling of scientific ideas and scientific and engineering practices to develop integrated understanding. What implications do these major ideas have for assessment in informal science setting? This paper will discuss each of these ideas
Observational instruments are receiving broad attention as measures of gauging the quality of interactions within formal educational settings (Bill and Melinda Gates Foundation, 2012). Scores from observations are used as critical pieces of information in the evaluation of teachers for purposes of making employment-related decisions and supporting professional development. Given the potential high-stakes use, a large body of research is emerging to address the validity of observation instruments as assessments of quality (Gitomer & Bell, in press). Using this research base, this paper focuses
The practice and use of assessments in the informal science education (ISE) realm is highly diverse and inconsistent, with differing stakeholders having dramatically different attitudes towards which assessments (if any) they value. This essay reviews the landscape of attitudes and uses of assessment on the part of informal science education stakeholders beyond the research community.