In late 2012, Providence Children’s Museum began a major three-year research project in collaboration with The Causality and Mind Lab at Brown University, funded by a grant from the National Science Foundation (1223777). Researchers at Brown examined how children develop scientific thinking skills and understand their own learning processes. The Museum examined what caregivers and informal educators understand about learning through play in its exhibits and how to support children’s metacognition – the ability to notice and reflect on their own thinking – and adults’ awareness and appreciation of kids’ thinking and learning through play. Drawing from fields like developmental psychology, informal education and museum visitor studies, the Museum’s exhibits team looked for indicators of children’s learning through play and interviewed parents and caregivers about what they noticed children doing in the exhibits, asking them to reflect on their children’s thinking. Based on the findings, the research team developed and tested new tools and activities to encourage caregivers to notice and appreciate the learning that takes place through play.
This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?
The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.
The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.
The Palo Alto Junior Museum & Zoo offers a satisfying mix of interactive exhibit experiences, close-up animal viewing, and a warm, welcoming staff in a small-scale setting which makes it easily manageable for families with special needs. In recent years the JMZ has attracted and embraced this audience of often close-knit friends and organizations. In addition to an ongoing dialog with visitors at the institution, on multiple occasions JMZ has invited families to participate in community conversations to share their perspectives, experiences and suggestions.
DATE:
-
TEAM MEMBERS:
Wendy MeluchPalo Alto Junior Museum & Zoo
A partnership between Carthage College and the Appalachian Mountain Club has delivered a successful public education and outreach program that merges natural environment topics and astronomy. Over the four years of activity, over 25,000 people have received programming. The effort has trained nature educators, permanent and seasonal AMC staff, and undergraduate physics and astronomy students to integrate diverse topical material and deliver high quality programming to the lay public. Unique to the program is the holistic nature of the material delivered - an 'atypical' astronomy program. Linking observable characteristics of the natural world with astronomical history and phenomena, and emphasizing the unique sequence of events that have led to human life on Earth, the program has changed attitudes and behaviors among the public participants. Successful interventions have included hands-on observing programs (day and night) that link nature content to the observed objects; table-talk presentations on nature/astronomy topics; dark skies preservation workshops; and hands-on activities developed for younger audiences, including schools, camps, and family groups. An extensive evaluation and assessment effort managed by a leading sociologist has demonstrated the effectiveness of the approach, and contributed to continuous improvement in the program content and methods.
The Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with the National Science Foundation Advancing Informal STEM Learning (AISL) program, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments (UPCLOSE), Oregon State University (OSU), the Great Lakes Science Center, KQED Public Media, advisors and other collaborators. CAISE works to support and resource ongoing improvement of, and NSF investments in, the national infrastructure for informal Science Technology Engineering and Mathematics (STEM) education. CAISE's roles are to build capacity and support continued professionalization for the field by fostering a community that bridges the many varied forms in which informal STEM learning experiences are developed and delivered for learners of all ages. To that end, CAISE activities also include: creating field-driven evidence databases about the impacts of informal STEM education; facilitating federated searches of those databases; furthering dialogue and knowledge transfer between learning research and practice; working to enhance the quality and diversity of evaluation knowledge and processes; and helping STEM researchers improve their efforts in informal STEM education, outreach and communication. For Principal Investigators (PIs) and potential PIs, CAISE provides resources that can assist in the development of evidence-based proposals. It also facilitates and strengthens networks through PI meetings, communications, and other methods that encourage sharing of deliverables, practices, outcomes and findings across projects. For the AISL Program at NSF, CAISE is assisting program officers in understanding the portfolio of awards, identifying the portfolio's impacts in key areas, and integrating the program's investments in education infrastructure.
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The State University of New York (SUNY) and the New York Academy of Sciences (NYAS) are collaborating to implement the SUNY/NYAS STEM Mentoring Program, a full scale development project designed to improve the science and math literacy of middle school youth. Building upon lessons learned through the implementation of national initiatives such as NSF's Graduate STEM Fellows in K-12 Education (GK-12) Program, university initiatives such as the UTeach model, and locally-run programs, this project's goals are to: 1) increase access to high quality, hands-on STEM programs in informal environments, 2) improve teaching and outreach skills of scientists in training (graduate and postdoctoral fellows), and 3) test hypotheses around scalable program elements. Together, SUNY and NYAS propose to carry out a comprehensive, systemic science education initiative to recruit graduate students and postdoctoral fellows studying science, technology, engineering, and mathematics (STEM) disciplines at colleges and universities statewide to serve as mentors in afterschool programs. SUNY campuses will partner with a community-based organization (CBO) to place mentors in afterschool programs serving middle school students in high-need, low-resource urban and rural communities. Project deliverables include a three-credit online graduate course for mentor training, six pilot sites, a best practices guide, and a model for national dissemination. The online course will prepare graduate and postdoctoral fellows to spend 12-15 weeks in afterschool programs, introducing students to life science, earth science, mathematics and engineering using curriculum modules that are aligned with the New York State standards. The project design includes three pre-selected sites (College of Nanoscale Science & Engineering at the University of Albany, SUNY Institute of Technology, and SUNY Downstate Medical Center) and three future sites to be selected through a competitive process, each of which will be paired with a CBO to create a locally designed STEM mentoring program. As a result, a minimum of 192 mentors will provide informal STEM education to 2,880 middle school students throughout New York State. The comprehensive, mixed-methods evaluation will address the following questions: 1) Does student participation in an afterschool model of informal education lead to an increase in STEM content knowledge, attitudes, self-efficacy, and interest in pursuing further STEM education and career pathways? 2) Do young scientists who participate in the program develop effective teaching and mentoring skills, and develop interest in teaching or mentoring career options that result in STEM retention? 3) What are the attributes of an effective STEM afterschool program and the elements of local adaptation and innovation that are necessary to achieve a successful scale-up to geographically diverse locations? 4) What is the role of the afterschool model in delivering informal STEM education? This innovative model includes a commitment to scale across the 64 SUNY campuses and 122 Councils of the Girl Scouts of the USA, use an online platform to deliver training, and place scientists-in-training in informal learning environments. It is hypothesized that as a result of greater access to STEM education in an informal setting, participating middle school youth will develop increased levels of STEM content knowledge, self-efficacy, confidence in STEM learning, and interest in STEM careers. Scientist mentors will: 1) gain an understanding of the context and characteristics of informal science education, 2) develop skills in mentoring and interpersonal communication, 3) learn and apply best practices of inquiry instruction, and 4) potentially develop interest in teaching as a viable career option. It is anticipated that the project will add to the research literature in several areas such as the effectiveness of incentives for graduate students; the design of mentor support systems; and the structure of pilot site programs in local communities. Findings and materials from this project will be disseminated through presentations at local, regional, and national conferences, publications in peer-reviewed journals focused on informal science education, and briefings sent to more than 25,000 NYAS members around the world.
WGBH Educational Foundation will create PEEP'S WORLD/EL MUNDO DE PEEP, a Web-based "Digital Hub," in both English and Spanish, to significantly increase the impact of the extensive collection of proven preschool science and math assets from the Emmy Award-winning TV show PEEP AND THE BIG WIDE WORLD®. This project will: (1) redesign the PEEP Web site, creating interactive media experiences that will contextualize existing content and take advantage of new Web design; (2) provide professional development for preschool educators; and (3) reach a new audience of family childcare educators, one that is woefully underserved when it comes to educational resources about science. Dissemination through a network of national organizations, including National Association of Family Child Care, National Association of Child Care Resource and Referral Agencies, National Head Start Association, National Education Association, AVANCE, and Committee for Hispanic Children and Families, will help engage the maximum number of educators and parents in the project. PEEP'S WORLD/EL MUNDO DE PEEP will provide resources for targeted audiences. Specifically these resources will provide: Children with multiple ways to engage with science or math content areas, including interactive games, animated stories, and live-action videos; Parents with guided experiences to facilitate their child's math and science play; Center-based preschool educators with a media-rich, year long science curriculum and professional development materials; and Family childcare educators with curriculum modules, integrated with media, focused on six science content areas, and professional development materials for home-care settings in English and in Spanish. The University of Massachusetts's Donahue Institute will conduct a formative evaluation of the family childcare educator resources: 200 Spanish-speaking and 200 English-speaking educators will pilot the curriculum modules and professional development videos. Concord Evaluation Group, Inc. will conduct a summative evaluation, consisting of a Family Web Site Experiment and a National Observational Study, to assess the extent to which the project is successful at achieving its intended impacts. A multifaceted national dissemination plan will include a robust social media strategy, implemented by a Spanish-speaking online community manager, to reach parents, and collaborations with early childhood education statewide systems to reach educators. The projects intended impacts are to: (1) help English- and Spanish-speaking preschoolers effectively apply science and mathematical inquiry and process skills; (2) empower English- and Spanish-speaking parents to feel more equipped and inclined to facilitate science and math exploration with their preschoolers; and, (3) provide center-based and family childcare educators with resources for incorporating math and science into their curricula and boosting their confidence in teaching these subjects. While many parents know how to read to their children, they do not typically know how to approach science or math investigations with their pre-schoolers. After parents, preschool educators are the most important promoters of a young child\'s learning. Yet, center-based and family childcare educators do not receive significant training in science, and thus lack confidence when conducting preschool science activities. By providing parents and educators resources for approaching preschool science and math, which meet their specific needs, PEEP will help alleviate these challenges.
ISE Research: Contextualizing Science Learning and Motivation in Rural and Indigenous Adolescents through Mapping Sustainable Practices is a three-year interdisciplinary research project. Researchers from the University of New Hampshire will investigate impacts of contextualization on science learning, motivation, and positive attitudes toward science of early adolescents from rural and Indigenous populations. The project will yield research findings that can help identify contextualization as a means to engage rural and Indigenous adolescents. The project team uses a systematic approach that incorporates mixed methods of data collection and analysis to learn more about how culture and community (contextualization) impact STEM learning. They hypothesize that contextualizing science learning to culture and community will enhance rural majority and Indigenous early adolescents' science knowledge and positively strengthen motivation and attitudes toward science. Local community and Indigenous group members provide expertise that contributes to the design of the research and the related curriculum as well as the interpretation of the findings. This project will contribute to what we know about how underserved and underrepresented youth engage in STEM learning in relation to their world views. This work will help advance the informal science education field in terms of providing rigorous evidence that can inform theory on learning and motivation among disadvantaged STEM learners as well as address practical issues around the design of STEM programs for rural and Indigenous groups.
DATE:
-
TEAM MEMBERS:
Eleanor AbramsThomas KellyLisa TownsonRuth VarnerMichael Middleton
Science STARS (Stars Tackling Authentic & Relevant Science) is an after-school program that will engage approximately 400 urban middle school girls in authentic inquiry-based scientific investigations and the creation of a science documentary that extends their research and situates their findings. The project has been piloted in Rochester, NY and will be expanded to sites in Lansing, MI and Seattle, WA. New elements have been added to enhance the project experience including the documentary video component, partnerships with local community outreach organizations, mentoring by local female scientists, leveraging embedded assessments to enhance the measurement of learning, and a conference and presentations to local stakeholders to showcase the work of the participants. Participants will meet during the school year plus three intensive weeks during the summer for a total of about 65 hours per year. A unique feature of this project is the use of pre-service teachers from local teacher preparation programs to facilitate the investigations. This in turn develops the capacity of pre-service teachers to implement and leverage inquiry-based learning in their practice. Project-level research will address questions of how models such as this encourage the development of positive science identities in girls and how situating science investigations in their community affects their understanding of science and local issues. The project evaluation will be conducted by Horizon Research and will focus on the quality of project activities, the quality of the project\'s research plan, and the impact on participants and pre-service teachers. Science STARS thoughtfully bridges formal and informal learning environments. While Science STARS largely situates its home base in schools in order to increase access to those who may not self-identify with science, the program is designed to capitalize on the unique affordances of informal settings and contribute to understanding how informal science education can be used to nurture positive science identities for urban middle school girls.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
Water for Life (WfL) is a full scale development youth and community based program; centered on freshwater literacy, water conservation and rainwater harvesting led by the Pacific Resources for Education Learning (PREL) in Hawaii. The goals of the project are to: (a) promote an understanding of water conservation and stewardship in areas lacking adequate quality water supplies and (b) build local capacity among rural communities to develop and employ site specific freshwater harvesting strategies proven to improve water quality. Rural communities within four Pacific Island entities in the U.S. affiliated Freely Associated States (FAS) will participate in WfL activities. PREL is collaborating with a host of organizations (such as the Federated States of Micronesia National Department of Education, Marshall Islands Conservation Society, and the Micronesian Conservation Trust, etc.) to develop and implement all phases of the initiative. This work is already improving the quality of life for hundreds of people in the FAS through water conversation education and improved water quality in local areas. Working closely with site-embedded PREL staff, Core Teams at each site - consisting of 4-6 local leaders from environmental agencies, water/sanitation systems, and education institutions - participated in a 5-day professional learning immersion in May, 2013, to buld capacities to develop and facilitate water conservation and catchment activities at the four target sites in the FAS. The Core Team members at each site now are recruiting and collaborating with local community members to implement site-specific projects that both educate and provide enhanced access to high quality drinking water. Both adults and youth are now engaging in a spectrum of proejcts that address loca needs and priorities through site-specific service learning activities. The site-specific focus in each locale, determined by the local Core Team, is distinct. In Palau, the Core Team has built broader community awareness of water conservation issues, raised the issue of water security in national conversations, engaged remote communities in improving natural rainwater drainage collection systems, and produced youth-oriented educational materials focused on local sites. In Yap, the Core Team members have collaborated with public utilities to install first-flush diverters into community rainwater catchment systems on Yap proper, and now are installing these devices in rainwater catchment systems on Yap's neighbor islands. In Chuuk, groundwater springs in remote communities are being upgraded for improved storage capacity, protection against contamination, and better public access. In Majuro (RMI), public school rainwater catchment systems are being repaired, repainted, cleaned, and upgraded so that schools can and will provide adequate drinking water to students (and to broader segments of the community during droughts). Broad segments of communities, including school classes and clubs, church and civic groups, etc. are becoming increasingly involved in building better water security and resilience for their communities, in preparation for a predicted drought, predicted to hit in the winter of 2014-2015, brought on by an El Nino event now edevelopig in the eastern Pacific. Water for Life has produced a range of locally relevant educational materials, including books, pamphlets, flyers, etc., some in English and others in local languages. Posters and billboards are being produced to enhance and maintain public awareness. Infrastructure projects are enabling better collection of more, higher quality water for drinking. A full-scale water handbook is under development, and this will serve as a basis for a self-contained water 'course' that will be offered through local community colleges. The experiences of project participants are being captured, analyzed, and reported in front-end, formative, and sumative evaluations conducted by David Heil & Associates. Thousands of individuals, comprising large segments of the participating countries' populations, will be directly impacted by the project. The results will be applicable to other remote and rural communities outside of the Pacific distressed by poor water quality and ineffective freshwater harvesting systems.