The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
In The Nature of Community: SCIENCES, we share the lessons learned from an innovative partnership designed to leverage the strengths of two nonprofit organizations—a large cultural institution and a smaller, deeply-rooted community-based organization, both of which offer informal science education expertise.
You’ll read first-hand reflections of how staff members, community leaders and members, children, and adults experienced this partnership: the expectations, surprises, challenges, successes, and lessons learned. We hope the description of this partnership inspires other organizations to
Growing Beyond Earth (GBE) is Fairchild’s NASA-funded classroom science project designed to advance research on growing plants aboard spacecraft. As NASA looks toward a long term human presence beyond Earth orbit, there are specific science, technology, engineering, and math (STEM) challenges related to food production. GBE is addressing those challenges by expanding the diversity and quality of edible plants that can be grown in space. On Earth, GBE is also improving technologies for gardening in urban, indoor, and other resource-limited settings.
GBE is unique in its focus on real
DATE:
TEAM MEMBERS:
Marion LitzingerCatherine RaymondCarl LewisAmy Padolf
The concept of One Health emphasizes the connection between human health, the health of animals and the health of the environment – with the goal of improving all health. The One Health approach supports collaborations between physicians, veterinarians, dentists, nurses, ecologists, and other science, health and environmentally-related disciplines. The One Health approach is increasingly important as our population rises, agriculture intensifies, and habitat destruction increases.
The goal of our “One Health” project is to increase adolescents’ understanding of One Health concepts and the importance of One Health collaborations. We will accomplish this by developing and disseminating: (1) Classroom lessons for high school students that are case-based, incorporate hands-on activities, and align with the Next Generation Science Standards, and; (2) Activities for middle and high school students that are suitable for use in a variety of informal (non-school) education settings. During this five-year project we will:
• Collaborate with scientists and life science teachers to develop case-based, hands-on One Health lessons for high school students.
• Develop and use a reliable and valid pre/post assessment to determine the impact of the One Health lessons on student learning.
• Implement a dissemination plan in which we will recruit, train and support a national network of “teacher-presenters” to lead professional development workshops for their peers throughout the US.
• Develop activities that will be used for middle school and high school One Health field trip programs at the University of Rochester’s Life Sciences Learning Center.
• Collaborate with informal educators to create One Health activities to be used in their outreach programs.
This project is significant because it will improve students’ understanding of the One Health approach to promoting the health of people, animals, and the environment. This project will also significantly impact teachers’ awareness of One Health, and how One Health concepts are aligned with NGSS and can be incorporated into their existing curriculums. This project is innovative because it will develop One Health lessons and activities for use in a variety of settings, through partnerships with scientists, science teachers, and informal science educators. This project will also feature an innovative model for disseminating the One Health lessons to teachers nationwide using peer-to-peer professional development.
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
During the school year of 2017-2018, Fairchild Tropical Botanic Garden (Fairchild) implemented the second year of a four-year project entitled: Growing Beyond Earth (GBE). NASA is providing funding support for project implementation as well as an external project evaluation. The evaluation activities conducted this year were focused on understanding project implementation and assessing project outcomes using data collected between September 2017 and May 2018. This report’s findings and accompanying recommendations inform next year’s project implementation and evaluation activities.
DATE:
TEAM MEMBERS:
Catherine RaymondMarion LitzingerCarl LewisAmy Padolf
Many urban New Yorkers believe that the Hudson River is so polluted that nothing could possibly live there. In reality, the estuary is thriving, and The River Project (TRP), a marine science field station in lower Manhattan, exists to showcase its vast biodiversity through place-based education. In 2014, TRP began collaborating on a city-wide initiative with New York Harbor Foundation and eight other partner organizations to integrate restoration science into Title I middle school curricula through the Curriculum and Community Enterprise for Restoration Science (CCERS). Teachers in the
DATE:
TEAM MEMBERS:
Elisa CarefMelissa RexAnnie LederbergGaylen Moore
resourceresearchPark, Outdoor, and Garden Programs
Science in the Learning Gardens (henceforth, SciLG) program was designed to address two well-documented, inter-related educational problems: under-representation in science of students from racial and ethnic minority groups and inadequacies of curriculum and pedagogy to address their cultural and motivational needs. Funded by the National Science Foundation, SciLG is a partnership between Portland Public Schools and Portland State University. The sixth- through eighth-grade SciLG curriculum aligns with Next Generation Science Standards and uses school gardens as the milieu for learning. This
DATE:
TEAM MEMBERS:
Dilafruz WilliamsHeather Anne BruleSybil Schantz KelleyEllen A. Skinner
Digital Observation Technology Skills (DOTS) is a framework for integrating modern, mobile technology into outdoor, experiential science education. DOTS addresses longstanding tensions between modern technology and classical outdoor education by carefully selecting appropriate digital technology for educational purposes and by situating these tools in classical experiential pedagogy.
DATE:
TEAM MEMBERS:
R. Justin HoughamMarc NutterCaitlin Graham
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceresearchPark, Outdoor, and Garden Programs
There is growing concern that opportunities for outdoor learning by school students in England have decreased substantially in recent years. In response to this, and recent Government calls for ‘schools to make better use of the outdoor classroom as a context for teaching and learning’, the Field Studies Council (FSC) and several partner organisations commissioned the National Foundation for Educational Research (NFER) to undertake a review of research on outdoor learning.
This document summarises the key findings of this review, which critically examined 150 pieces of research on outdoor
DATE:
TEAM MEMBERS:
Mark RickinsonJustin DillonKelly TeameyMarian MorrisMee Young ChoiDawn SandersPauline Benefield
resourceprojectProfessional Development, Conferences, and Networks
The University of Maine will address the grand challenge of increasing Native American participation in the science,technology, engineering and mathematics (STEM) enterprise in an NSF INCLUDES Design and Development Launch Pilot project addressing culturally relevant pedagogy, incorporating Community Elders, Cultural Knowledge Keepers, and mainstream secondary and higher education institutions in the development of STEM pedagogy that can be replicated to other underrepresented and underserved populations. Partners in the effort include the Wabanaki Youth in Science program (WaYS)(a non-profit organization), Salish Kootenai College (a Tribal College), Massachusetts Institute of Technology (a research university), the National Indian Education Association (a non-profit membership organization) and the current NSF INCLUDES Design and Development Launch Pilot project at the University of Maine (the Stormwater Research Management Team (SMART)). This NSF INCLUDES partnership provides students with evidence-based STEM activities involving culturally relevant internships, mentoring, STEM professional development activities and other support. Non-native students will reciprocally participate in Native American learning environments.
The foundation for the project's activities is based on the WaYS program in science education that incorporates Traditional Ecological Knowledge (TEK). The goals of the project are to: 1) create and integrate curriculum that embraces TEK and western science as equal partners; 2)develop and implement protocols to incorporate a continued mentorship program for WaYS and STREAM engineering students; 3)develop a framework to bridge the gap between high school and college; and 4) foster collaboration among Community Elders, Cultural Knowledge Keepers and University of Maine faculty in a model that could be transferred to other communities. Internal and external evaluation activities will add to the scholarly literature on educating Native Americans and non-native students in STEM disciplines. Dissemination of project results will include published peer-reviewed journal articles on newly developed pedagogy and conference presentations at the American Indian Science and Engineering (AISES) national conference, the National Diversity in STEM Conference, National Science Teachers Association, AAAS, ASEE and the National NSF INCLUDES Network.
DATE:
-
TEAM MEMBERS:
Darren RancoJohn DaigleMindy CrandallShaleen Jain