Inverness Research has been the external evaluator for CAISE for the past eight years. The year 8 and year 9 report, along with a brief executive summary, highlights findings from the external evaluation of CAISE for this award period, along with comparison data gathered from the previous years’ evaluation efforts. Our evaluation findings show that CAISE is important infrastructure for the ISE field, addressing important needs in the field through resources that are well known, high-quality, widely used, well-designed, accessible, valued and trustworthy.
This evaluation report highlights finding on the evaluation of the Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with NSF, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments, Oregon State University, Science Museum of Minnesota, Visitor Studies Association, KQED Public Media, Advisors and other collaborators. CAISE is working to support ongoing improvement of, and NSF investments in, the national infrastructure for informal
The University of Washington, the Exploratorium, the Education Development Center, Inverness Research, and the University of Colorado - Boulder have come together to form a Research+Practice (R+P) Collaboratory. The Collaboratory seeks to address and reframe the gap between research and practice in K-12 STEM education. This gap persists despite decades of work by many leading organizations, associations, and individuals. Attempts to close the gap have generally focused on creating resources and mechanisms that first explain or illustrate "what research says" and then invite educators to access and integrate findings into practice. Recently, however, attention has turned to the ways in which the medical sciences are addressing the gap between research and clinical practice through the developing field of "translational research." In medicine, the strategy has been to shift the focus from adoption to adaptation of research into practice. Implicit in the notion of adaptation is a bi-directional process of cultural exchange in which both researchers and practitioners come to understand how the knowledge products of each field can strengthen the professional activities in the other. Along these lines, the R+P Collaboratory is working with leading professional associations and STEM improvement efforts to leverage their existing knowledge and experience and to build sustainable strategies for closing the gap. Activities include:
Collecting, creating and synthesizing translational research resources to expand STEM educators' and educational leaders' access and awareness to current relevant research.
Supporting multiple opportunities for cross-sector (research and practice; education and social sciences; formal and informal) meetings to foster critical engagement and cultural exchange.
Testing, documenting and innovating new resources and mechanisms at Adaptation Sites and disseminating both products and results through the R+P Resource Center.
The R+P Collaboratory is developing an online 'Go-To' Resource Center website that houses the resources collected, created, and curated by the Collaboratory. The Resource Center also has significant 'Take-Out' features, with all materials meta-tagged so that they can be automatically uploaded, reformatted, and integrated into the existing communication and professional development mechanisms (e.g., newsletters, digests, conferences, and websites) of a dozen leading professional associations within a Professional Association Partner Network.
In light of new and emerging standards in the STEM disciplines, the Collaboratory is focusing its work on four salient and timely bodies of research: (a) STEM Practices, (b) Formative Assessment, (c) Cyberlearning, and (d) Learning as a Cross-Setting Phenomenon. Special emphasis is being placed on research and practice that focuses on the learning of children and youth from communities historically underrepresented in STEM fields.
The work of the R+P Collaboratory includes research and evaluation of its own efforts through studies aimed at answering the following questions:
How are Collaboratory resources and engagement activities accessed, experienced and leveraged by participants?
What resources, mechanisms and learning contexts support cultural exchange among STEM education researchers and practitioners?
What new kinds of practices result when research-based evidence is adapted into evidence-based practices, and how does it change learning opportunities for K-12 aged children?
How can effective strategies, mechanisms and resources of the Collaboratory be scaled and adapted to new contexts?
In 2018, the Croucher Foundation conducted its third annual mapping exercise for the out-of-school STEM learning ecosystem in Hong Kong.
The study reveals a rich and vibrant ecosystem for out-of-school STEM in Hong Kong with over 3,000 discrete activities covering a very wide range of science disciplines. This third report indicates extremely rapid growth in available out-of-school STEM activities compared to 2016 and an even larger increase in the number of organisations offering out-of-school STEM activities in Hong Kong.
STEM educators are eager to foster long term collaboration with each other, and with schools. At the same time, good working practice by schools, teachers, STEM educators and institutions that involves and engages local communities was discovered, showing the diversified modes of connection which could enhance the sustainability of STEM ecosystem.
We trust that this three-year study with its associated digital maps, provides a useful resource for schools, teachers, students, parents, STEM educators and education policy makers in Hong Kong.
This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2015. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from a Membership study, a formative evaluation of a new Makerspace exhibition, and program evaluation of a workshop for the
This article makes a case for the importance of brokering future learning opportunities to youth as a programmatic goal for informal learning organizations. Such brokering entails engaging in practices that connect youth to events, programs, internships, individuals and institutions related to their interests to support them beyond the window of a specific program or event. Brokering is especially critical for youth who are new to an area of interest: it helps them develop both a baseline understanding of the information landscape and a social network that will respond to their needs as they
Brokering Youth Pathways was created to share tools and techniques around the youth development practice of “brokering” or connecting youth to future learning opportunities and resources.
This toolkit shares ways in which various out-of-school educators and professionals have approached the challenge of brokering. It provides a framework, practice briefs and reports that focus on a particular issue or challenge and provide concrete examples, as well as illustrate how project partners partners worked through designing new brokering routines in partnership with a research team.
The Discovery Research K-12 program (DR-K12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. This project scales up the PBS NewsHour Student Reporting Labs (SRL), a model that trains teens to produce video reports on important STEM issues from a youth perspective. Participating schools receive a SRL journalism and digital media literacy curriculum, a mentor for students from a local PBS affiliate, professional development for educators, and support from the PBS NewsHour team. The production of news stories and student-oriented instruction in the classroom are designed to increase student learning of STEM content through student-centered inquiry and reflections on metacognition. Students will develop a deep understanding of the material to choose the best strategy to teach or tell the STEM story to others through digital media. Over the 4 years of the project, the model will be expanded from the current 70 schools to 150 in 40 states targeting schools with high populations of underrepresented youth. New components will be added to the model including STEM professional mentors and a social media and media analytics component. Project partners include local PBS stations, Project Lead the Way, and Share My Lesson educators.
The research study conducted by New Knowledge, LLC will add new knowledge about the growing field of youth science journalism and digital media. Front-end evaluation will assess students' understanding of contemporary STEM issues by deploying a web-based survey to crowd-source youth reactions, interest, questions, and thoughts about current science issues. A subset of questions will explore students' tendencies to pass newly-acquired information to members of the larger social networks. Formative evaluation will include qualitative and quantitative studies of multiple stakeholders at the Student Reporting Labs to refine the implementation of the program. Summative evaluation will track learning outcomes/changes such as: How does student reporting on STEM news increase their STEM literacy competencies? How does it affect their interest in STEM careers? Which strategies are most effective with underrepresented students? How do youth communicate with each other about science content, informing news media best practices? The research team will use data from pre/post and post-delayed surveys taken by 1700 students in the STEM Student Reporting Labs and 1700 from control groups. In addition, interviews with teachers will assess the curriculum and impressions of student engagement.
“Monkeying Around: Digital Media and Parent/Child Engagement Resources to Increase Preschool Computational Thinking” is a new project that uses animation, live-action videos, and hands-on activities to support joint engagement of children and caregivers around computational thinking concepts and practices. WGBH, a leading producer of educational STEM media, developed prototypes of videos and hands-on activities around the project’s computational thinking learning goals for young children. Education Development Center (EDC), WGBH’s research partner for the project, conducted a small formative
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. Techbridge Girls began offering after-school programming at elementary and middle schools in Greater Seattle in 2014, and in Washington, DC in 2015.
Education Development Center is conducting the formative and summative evaluation of the project. To assess the
The NSF INCLUDES program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The Algebra Project, in partnership with the Young People's Project, will convene a conference on inclusion in science, technology, engineering and mathematics(STEM) higher education in support of the National Science Foundation's Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) initiative. The conference will examine a critical question: What roles and structures are needed for a mini-backbone organization in order to scale a "bottom up" model of social change into an organized, full scale collective impact model? Additionally, the conference will develop participants' capacity to link action on the various design challenges, and backbone structures, to future actions that meet the needs of a potential Alliance on this Broadening Participation Challenge and others facing similar challenges.
Five pre-conference design teams will focus on key components to improve education of students from underrepresented and disadvantaged populations over a four-month period prior to the convening of the stakeholders in St. Louis, Missouri in 2017.
There is a growing need for citizens to be able to work with data and consider how data is represented. This work employs a design, make, play framework to create data modeling learning experiences for young children and their caregivers in an informal setting. The project develops and tests a curriculum for a workshop series for 5-8 year old children to engage them in playful exploration of data modeling. Children engage in data collection, data representation, and data analysis by drawing on their own experiences of museum exhibitions. The curriculum supports developing children's interest and engagement with data science and data literacy, which are foundational knowledge for a range of STEM careers and disciplines. This project advances efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM).
The project is grounded in a theoretical framework for young children's learning that focus on playful exploration, design, and building on children's own experiences and questions. The research examines how the curriculum needs to be designed to support families in data modeling, foster engagement in data modeling by both younger (ages 5-6) and older (ages 7-8) children, and provide evidence of active approaches to learning about STEM. The design and development project tests and investigates the materials using a design-based research framework. Children who participate in the workshop series should increase their confidence in solving problems, taking initiative, and drawing on available resources to pursue their own questions and respond to novel challenges. Data collected includes interviews with participants, artifacts of children's work throughout the series, and an observational instrument to document families' problem solving, persistence, and engagement with data science concepts.