The summative evaluation report for Project TRUE focuses on program implementation, participant experiences, organizational capacity outcomes and project scale-up over the five-year project.
Appendix includes logic model and instruments.
This video presents reflections on SCIENCES: Supporting a Community’s Informal Education Needs—Confidence and Empowerment in STEM. SCIENCES brought together Eden Place Nature Center and the Chicago Zoological Society to collaboratively support environmental conservation and lifelong scientific learning in the Fuller Park neighborhood of Chicago.
The SCIENCES project began in 2013 and focused on adapting existing educational programs into a suite of environmentally focused science learning opportunities for professional, student, and public audiences in the Fuller Park neighborhood
The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
In The Nature of Community: SCIENCES, we share the lessons learned from an innovative partnership designed to leverage the strengths of two nonprofit organizations—a large cultural institution and a smaller, deeply-rooted community-based organization, both of which offer informal science education expertise.
You’ll read first-hand reflections of how staff members, community leaders and members, children, and adults experienced this partnership: the expectations, surprises, challenges, successes, and lessons learned. We hope the description of this partnership inspires other organizations to
Consideration of the needs of individuals with a wide range of disabilities is not always considered in the early design stages of an informal STEM learning (ISL) activity or program. The primary access approach for people with disabilities becomes the provision of accommodations once the ISL product or environment is created. In contrast, the Universal Design approach considers users with a wide range of characteristics throughout the design process and works to create products and environments that are accessible, usable, and inclusive. This project, called AccessISL, led by the University of Washington's DO-IT (Disabilities, Opportunities, Internetworking and Technology) Center and Museology Program, includes an academic museology program and local ISL sites, representing museums, zoos, aquariums, makerspaces, science centers, and other sites of informal STEM learning. Insights will be gained through the engagement of people with disabilities, museology graduate students and faculty, and ISL practitioners. The AccessISL project model, composed of a set of approaches and interventions, builds on existing research and theory in the fields of education science, change management, effective ISL practices, and inclusive design processes. The project will collect evidence of policies and practices (or lack thereof) that improve the inclusiveness of ISL with respect to a wide range of disabilities and considers approaches for the design and development of new strategies; explores what stakeholders need to make change happen; uncovers challenges to the adoption of inclusive practices in public ISL settings and explores ways to overcome them; and proposes relevant content that might be included in museology curriculum. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project addresses the following two objectives:
For ISL personnel and museology faculty: to increase knowledge, skills, and actions to make ISL programs, facilities, courses, and resources more welcoming and accessible to participants with disabilities and embed relevant practices within their work.
For postsecondary STEM students with disabilities and museology students: to increase knowledge and skills in advocating for ISL offerings that are welcoming and accessible to everyone, including those with a wide variety of disabilities, and to encourage individuals with disabilities to pursue careers in ISL.
The project employs a student-centered approach and a set of practices that embrace the social model of disability, social justice education, disability as a diversity issue, intersectionality, and Universal Design. A leadership team of interns--each member a STEM student with a disability or a museology graduate student--along with project staff will engage with the University of Washington's Museology Program to identify and implement strategies for making ISL activities and courses more welcoming and accessible to individuals with disabilities. An online community of practice will be developed from project partners and others nationwide. A one-day capacity building institute will be held to include presentations, student/personnel panels for sharing project and related experiences, and group discussions to explore issues and further identify systemic changes to make ISL programs more welcoming and accessible to individuals with disabilities. As prototypes of the AccessISL Model are developed, evaluation activities will primarily be formative (looking for strengths and weaknesses) and remedial (identifying/implementing changes that could be made to improve the model). The model will continue to be fine-tuned through formative evaluation. Evaluation of the model components will focus on the experience of a range of stakeholders in the project. Specifically, quantitative data collected will include levels and quality of engagement, accessibility recommendations and products developed, and delivery of ISL services. Qualitative data will be collected through observations, surveys, focus groups, interviews, and case studies.
AccessISL project products will include proceedings of an end-of-project capacity building institute, promising practices, case studies, a video, and other online resources to help ISL practitioners and museology faculty that will result in making future ISL opportunities more inclusive of people with disabilities. AccessISL will advance knowledge and ensure long-term impact using multiple strategies:
broadening the STEM participation of people with disabilities as well as women, racial/ethnic minorities, and other underrepresented groups through the application of universal design
strengthening associations and creating synergy and durable relationships among stakeholders,
encouraging teaching about disability, accessibility, and universal design in museology courses,
empowering students with disabilities and current and future ISL practitioners to advocate for accessible ISL and develops an infrastructure to promote accessible ISL programs nationwide, and
contributing to the body of promising practices with products that will (a) enhance understanding of issues related to the inclusion of people with disabilities in ISL programs and (b) promote inclusive practices.
Outcomes will benefit society by making STEM opportunities available to more people and enhancing STEM fields with the talents and perspectives of people with disabilities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Increased integration and synergy between formal and informal learning environments is proposed to provide multiple benefits to science learners. In an effort to better bridge these two learning contexts, we developed an educational model that employs the charismatic nature of arachnids to engage the public of all ages in science learning; learning that aligns with the Next Generation Science Standards (NGSS Disciplinary Core Ideas associated with Biodiversity and Evolution). We created, implemented, and evaluated a family-focused, interactive science event—Eight-Legged Encounters (ELE)—which
The evaluation study supports the project Distance Learning Education Programs at the Saint Louis Zoo. To better understand what teachers want and need, and the characteristics of the settings in which their students learn, the Zoo conducted an online survey of the teachers of students with special needs in May 2014. The purpose of this evaluation was to clarify and expand the survey findings to support the design, development, and implementation of the Zoo distance learning curriculum so that it works effectively across a variety of school settings for K12 students with special needs and
The Ocean Science project integrates the Ocean Literacy Essential Principles and Fundamental Concepts into a Western Washington region-wide, coordinated program of formal and informal education consisting of: 1. Teacher professional development in the ocean sciences to integrate the Ocean Literacy Essential Principles and Fundamental Concepts into inquiry-based marine science education and instruction; 2. Evaluation and re-alignment of existing Sound Science ecosystems curricula into Ocean Science, incorporating NOAA data and promoting the Ocean Literacy Essential Principles and Fundamental Concepts; 3. Classroom programs, beach field investigations, and on-site programs at the Seattle Aquarium of the Olympic Coast national Marine Sanctuary's Olympic Coast Discovery Center for grades 4-5 students, their parents and teachers; 4. Parent training in ocean science content, the Ocean Literacy Essential Principles and Fundamental Concepts, and inquiry-based methods for supporting their children's science education; 5. Informal education for the general public via an interactive learning station linked to the Window on Washington Waters exhibit and designed to innovatively use NOAA data and information (videos, computer simulations and other creative media) to increase and evaluate ocean literacy in adults and children. Window on Washington Waters displays the outer coast marine environments and sea life of the Olympic Coast National Marine Sanctuary.
NatureStart Network brought together early childhood educators and environmental educators to support nature play, exploration, and inquiry for young children and their families within urban environments. Project partners included the Forest Preserves of Cook County and two established Head Start programs in the Chicago area, Mary Crane Center and El Valor. The foundation of the project was a series of three two-day professional learning sessions that took place over an eighteen month period. Through hands-on, collaborative learning and reflection activities, the participating educators
Project TRUE seeks to increase the interest of high school students in pursuing science, technology, engineering and mathematics majors by increasing participants’ exposure to urban ecology research conducted with college mentors. The Lifelong Learning Group is conducting research that explores the program’s longer-term influence on academic and career choices. More specifically, the research addresses the question: How do the four key elements of youth development in Project TRUE contribute to pursuit of advanced STEM study and career path in the short- and medium-term? This report presents
The primary goal of Project TRUE is to increase the interest of high school students in pursuing science, technology, engineering, and mathematics (STEM) majors, by increasing their exposure to urban ecology research conducted with college mentors. Project TRUE also establishes a research and education partnership between the Wildlife Conservation Society (WCS) and Fordham University, to implement and evaluate the effectiveness of a tiered mentorship educational model. The model leverages both formal (Fordham) and informal (WCS) educational practices and expertise. This evaluation report from