The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
The Science Center of Iowa will update its 10-year-old gallery, "What on Earth," to tell the story of how Iowa's habitats and animals are connected to each other and to humans. New exhibition components will include touch specimens, interactive elements, and an integrated storyline that connects the living specimens to the broader context of a delicate and changing ecosystem. The project will support the final phase of exhibition update, including the further development of specific content and experiences through an evaluative process, and the fabrication and installation of exhibitions, labels, and graphics. The museum will partner with the Science Museum of Minnesota to conduct a summative evaluation of the new content and experiences geared to a core audience of students in grades 3-5 and their caregivers.
This is the final evaluation report from RMC Research Corp. for the PES@LTERs project. Appendix includes instruments.
RMC Research designed evaluation activities to provide formative and summative feedback to Harvard Forest and the Hubbard Brook Research Foundation (Hubbard Brook) on their plan to embed public engagement with science (PES) into the cultures and practices of Long-Term Ecological Research Sites (LTERs) in the northeastern US. The purpose of this project was to build PES mechanisms into long-term ecosystem studies that create on-going, open exchanges between scientists and
Millions of people around the world watch live streaming wildlife cams, but they aren’t just watching: they are asking questions, trading information, and witnessing events that may be undocumented in the scientific literature. The goal of Bird Cams Lab was to design a digital space and framework enabling online communities to engage in a co-created scientific inquiry process utilizing wildlife cams to answer bird-related questions of common interest. To achieve this goal, the project engaged participants at every stage of the research process—including observation, generating and selecting
This document describes the summative project evaluation of 5 annual cohorts of STE(A)M teachers, mostly from California, Florida, and New Mexico participating in out-of-school authentic research experiences collecting fossils and learning about geology, biology, and the natural history along the Panama Canal, and their experiences with museums and research collections. The STEM content of this project is based on the Great American Biotic Interchange (GABI) of animals and plants across the Isthmus of Panama over the past 5 million years. This report also describes the efficacy of sustained
‘6 Degrees of Connection’ is an informative and memorable program that combines a one-hour Science On a Sphere® interactive presentation with a follow-up creative art activity – each aspect of which encourages middle school students to think of interconnections among phenomena on the planet, including the natural world and human activity.
The ‘6 Degrees of Connection’ program was developed by the Nurture Nature Center (Easton PA) in collaboration with the Maryland Science Center (Baltimore MD) through an extensive process of developing the concept, prototypes, and final program. Lehigh
The Computational Thinking in Ecosystems (CT-E) project is funded by the STEM+Computing Partnership (STEM+C) program, which seeks to advance new approaches to, and evidence-based understanding of, the integration of computing in STEM teaching and learning. The project is a collaboration between the New York Hall of Science (NYSCI), Columbia University's Center for International Earth Science Information Network, and Design I/O. It will address the need for improved data, modeling and computational literacy in young people through development and testing of a portable, computer-based simulation of interactions that occur within ecosystems and between coupled natural and human systems; computational thinking skills are required to advance farther in the simulation. On a tablet computer at NYSCI, each participant will receive a set of virtual "cards" that require them to enter a computer command, routine or algorithm to control the behavior of animals within a simulated ecosystem. As participants explore the animals' simulated habitat, they will learn increasingly more complex strategies needed for the animal's survival, will use similar computational ideas and skills that ecologists use to model complex, dynamic ecological systems, and will respond to the effects of the ecosystem changes that they and other participants elicit through interaction with the simulated environment. Research on this approach to understanding interactions among species within biological systems through integration of computing has potential to advance knowledge. Researchers will study how simulations that are similar to popular collectable card game formats can improve computational thinking and better prepare STEM learners to take an interest in, and advance knowledge in, the field of environmental science as their academic and career aspirations evolve. The project will also design and develop a practical approach to programing complex models, and develop skills in communities of young people to exercise agency in learning about modeling and acting within complex systems; deepening learning in young people about how to work toward sustainable solutions, solve complex engineering problems and be better prepared to address the challenges of a complex, global society.
Computational Thinking in the Ecosystems (CT-E) will use a design-based study to prototype and test this novel, tablet-based collectable card game-like intervention to develop innovative practices in middle school science. Through this approach, some of the most significant challenges to teaching practice in the Next Generation Science Standards will be addressed, through infusing computational thinking into life science learning. CT-E will develop a tablet-based simulation representing six dynamic, interconnected ecosystems in which students control the behaviors of creatures to intervene in habitats to accomplish goals and respond to changes in the health of their habitat and the ecosystems of which they are a part. Behaviors of creatures in the simulation are controlled through the virtual collectable "cards", with each representing a computational process (such as sequences, loops, variables, conditionals and events). Gameplay involves individual players choosing a creature and habitat, formulating strategies and programming that creature with tactics in that habitat (such as finding food, digging in the ground, diverting water, or removing or planting vegetation) to navigate that habitat and survive. Habitats chosen by the participant are part of particular kinds of biomes (such as desert, rain forest, marshlands and plains) that have their own characteristic flora, fauna, and climate. Because the environments represent complex dynamic interconnected environmental models, participants are challenged to explore how these models work, and test hypotheses about how the environment will respond to their creature's interventions; but also to the creatures of other players, since multiple participants can collaborate or compete similar to commercially available collectable card games (e.g., Magic and Yu-Go-Oh!). NYSCI will conduct participatory design based research to determine impacts on structured and unstructured learning settings and whether it overcomes barriers to learning complex environmental science.
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase student motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by designing, implementing, and testing an afterschool internship program that will engage older youth in work-based learning experiences in in STEM fields. The new model program will link the resources and learning approaches of the Global Learning and Observations to Benefit the Environment (GLOBE) program to career academies where youth from populations underrepresented in STEM fields will gain direct experiences in data collection and analysis through student-led investigations in the geosciences and environmental studies. Two key outcomes of this project will be: (a) Development of a replicable model of an afterschool STEM internship program for informal STEM learning environments and schools across the nation, and (b) Development of a set of measurement tools and approaches that can assess and promote understanding regarding how youth think and feel about science and their possible future roles in science careers. Participating youth will master scientific practices and become immersed in science culture through opportunities to develop research projects, interact with scientists, and collaborate with fellow student-researchers. In the process, they will develop collaboration and communication skills, and gain an increased sense of identity and agency in science fields. They will also learn new strategies to attain their career goals.
In developing and testing the new model of an afterschool program focusing on STEM careers, the project will draw on both existing and emerging knowledge from three areas of inquiry: informal STEM learning, youth development, and work-based learning. The project will bring together theory related to work-based learning and apprenticeship to knowledge about informal STEM learning and youth development, addressing the needs of older youth as they transition to adulthood. The program will also explore the use of measurement tools that address workforce-related student learning goals in addition to social-emotional learning and STEM learning goals, adapting existing tools and developing new tools as needed. The result will be a replicable model for an afterschool, career-focused internship that facilitates STEM learning and identity, employing youth development principles, such as experiential learning, peer collaboration, adult mentoring, and meaningful contributions to the world beyond school. The project will use a mixed-methods approach to investigate four research questions: (1) What aspects of the program are most important for promoting the development of scientific practices, socio-emotional learning, and career skills? (2) How can afterschool informal science learning be designed to address the perceptions and needs of diverse groups, especially those from populations underrepresented in STEM? (3) How do youth make gains in developing facility with STEM practices, key social-emotional outcomes needed in work and civic life, and career development knowledge? And (4) How do we accurately measure development of scientific practices, socio-emotional learning and career skills? The project will develop pretest and posttest self-report measures to gauge program influence on social-emotional outcomes and career-related outcomes, and performance-based assessments and rubrics will be used to assess culminating science projects. Other factors contributing to the success of the new model will be examined through analysis of coach instructional logs, surveys, and questions, as well as participant observations, interviews, and focus groups. Project participants will be youth of ages 14-18 recruited from ten inner-city schools having large populations of students from groups underrepresented in STEM fields. Participants will meet in teams of approximately 14 interns for a total of 2.5 hours per week for 32 weeks. Each team will also meet an additional 4-6 times for weekend or overnight outings associated with their study sites.
DATE:
-
TEAM MEMBERS:
Manuel AlonsoCathy RingstaffSvetlana Darche
In 2015, the Swinomish Indian Tribal Community (SITC) received a two-year NSF-AISL Pathways Grant (#1516742) entitled “Developing an Informal Environmental Health Education Model in Tribal Communities,” designed to develop a process model and curriculum for community-based environmental health outreach, grounded in cultural values and practices. The project deliverables included a curriculum and guiding document, intended to inform and inspire other tribal communities wishing to create a culture-based environmental or public health curriculum.
SITC contracted the Lifelong Learning Group
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceprojectProfessional Development, Conferences, and Networks
The University of Maine will address the grand challenge of increasing Native American participation in the science,technology, engineering and mathematics (STEM) enterprise in an NSF INCLUDES Design and Development Launch Pilot project addressing culturally relevant pedagogy, incorporating Community Elders, Cultural Knowledge Keepers, and mainstream secondary and higher education institutions in the development of STEM pedagogy that can be replicated to other underrepresented and underserved populations. Partners in the effort include the Wabanaki Youth in Science program (WaYS)(a non-profit organization), Salish Kootenai College (a Tribal College), Massachusetts Institute of Technology (a research university), the National Indian Education Association (a non-profit membership organization) and the current NSF INCLUDES Design and Development Launch Pilot project at the University of Maine (the Stormwater Research Management Team (SMART)). This NSF INCLUDES partnership provides students with evidence-based STEM activities involving culturally relevant internships, mentoring, STEM professional development activities and other support. Non-native students will reciprocally participate in Native American learning environments.
The foundation for the project's activities is based on the WaYS program in science education that incorporates Traditional Ecological Knowledge (TEK). The goals of the project are to: 1) create and integrate curriculum that embraces TEK and western science as equal partners; 2)develop and implement protocols to incorporate a continued mentorship program for WaYS and STREAM engineering students; 3)develop a framework to bridge the gap between high school and college; and 4) foster collaboration among Community Elders, Cultural Knowledge Keepers and University of Maine faculty in a model that could be transferred to other communities. Internal and external evaluation activities will add to the scholarly literature on educating Native Americans and non-native students in STEM disciplines. Dissemination of project results will include published peer-reviewed journal articles on newly developed pedagogy and conference presentations at the American Indian Science and Engineering (AISES) national conference, the National Diversity in STEM Conference, National Science Teachers Association, AAAS, ASEE and the National NSF INCLUDES Network.
DATE:
-
TEAM MEMBERS:
Darren RancoJohn DaigleMindy CrandallShaleen Jain
resourceprojectProfessional Development, Conferences, and Networks
This NSF INCUDES Design and Development Launch Pilot will increase the recruitment, retention, and matriculation of racial and ethnic minorities in STEM Ph.D. programs contributing to hazards and disaster research. Increasing STEM focused minorities on hazards mitigation, and disaster research areas will benefit society and contribute to the achievements of specific, desired societal outcomes following disasters. The Minority SURGE Capacity in Disasters (SURGE) launch pilot will provide the empirical research to identify substantial ways to increase the underrepresentation of minorities in STEM disciplines interested in hazards mitigation and disaster research. Increasing the involvement of qualified minorities will help solve the broader vulnerability concerns in these communities and help advance the body of knowledge through the diversity of thought and creative problem solving in scholarship and practice. Utilizing workshops and a multifaceted mentorship program SURGE creates a new model that addresses the diversity concerns in both STEM and disaster fields, and make American communities more resilient following natural disasters. This project will be of interest to policymakers, educators and the general public.
The Minority SURGE Capacity in Disasters (SURGE) NSF INCLUDES Design and Development Launch Pilot will enhance the social capital of racial and ethnic minority communities by increasing their networks, connections, and access to disaster management decision-making among members of their community from STEM fields. The four-fold goals of SURGE are to: (1) increase the number of minority graduate researchers in STEM fields with a disaster focus; (2) develop and guide well-trained, qualified disaster scholars from STEM fields; (3) provide academic and professional mentorship for next generation minority STEM scholars in hazards mitigation and disaster research; and (4) develop professional and research opportunities that involve outreach and problem solving for vulnerable communities in the U.S. The SURGE project is organized as a lead-organization network through the University of Nebraska at Omaha and includes community partners. As a pilot project, SURGE participation is limited to graduate students from research-intensive universities across the country. Each student will attend workshops and training programs developed by the project leads. SURGE investigators will conduct project evaluation and assessment of their workshops, training, and mentorship projects. Results from evaluations and assessments will be presented at STEM and disaster-related conferences and published in peer-reviewed academic journals.
DATE:
-
TEAM MEMBERS:
DeeDee BennettLori PeekTerri NortonHans Louis-Charles