This evaluation report highlights finding on the evaluation of the Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with NSF, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments, Oregon State University, Science Museum of Minnesota, Visitor Studies Association, KQED Public Media, Advisors and other collaborators. CAISE is working to support ongoing improvement of, and NSF investments in, the national infrastructure for informal
The University of Washington, the Exploratorium, the Education Development Center, Inverness Research, and the University of Colorado - Boulder have come together to form a Research+Practice (R+P) Collaboratory. The Collaboratory seeks to address and reframe the gap between research and practice in K-12 STEM education. This gap persists despite decades of work by many leading organizations, associations, and individuals. Attempts to close the gap have generally focused on creating resources and mechanisms that first explain or illustrate "what research says" and then invite educators to access and integrate findings into practice. Recently, however, attention has turned to the ways in which the medical sciences are addressing the gap between research and clinical practice through the developing field of "translational research." In medicine, the strategy has been to shift the focus from adoption to adaptation of research into practice. Implicit in the notion of adaptation is a bi-directional process of cultural exchange in which both researchers and practitioners come to understand how the knowledge products of each field can strengthen the professional activities in the other. Along these lines, the R+P Collaboratory is working with leading professional associations and STEM improvement efforts to leverage their existing knowledge and experience and to build sustainable strategies for closing the gap. Activities include:
Collecting, creating and synthesizing translational research resources to expand STEM educators' and educational leaders' access and awareness to current relevant research.
Supporting multiple opportunities for cross-sector (research and practice; education and social sciences; formal and informal) meetings to foster critical engagement and cultural exchange.
Testing, documenting and innovating new resources and mechanisms at Adaptation Sites and disseminating both products and results through the R+P Resource Center.
The R+P Collaboratory is developing an online 'Go-To' Resource Center website that houses the resources collected, created, and curated by the Collaboratory. The Resource Center also has significant 'Take-Out' features, with all materials meta-tagged so that they can be automatically uploaded, reformatted, and integrated into the existing communication and professional development mechanisms (e.g., newsletters, digests, conferences, and websites) of a dozen leading professional associations within a Professional Association Partner Network.
In light of new and emerging standards in the STEM disciplines, the Collaboratory is focusing its work on four salient and timely bodies of research: (a) STEM Practices, (b) Formative Assessment, (c) Cyberlearning, and (d) Learning as a Cross-Setting Phenomenon. Special emphasis is being placed on research and practice that focuses on the learning of children and youth from communities historically underrepresented in STEM fields.
The work of the R+P Collaboratory includes research and evaluation of its own efforts through studies aimed at answering the following questions:
How are Collaboratory resources and engagement activities accessed, experienced and leveraged by participants?
What resources, mechanisms and learning contexts support cultural exchange among STEM education researchers and practitioners?
What new kinds of practices result when research-based evidence is adapted into evidence-based practices, and how does it change learning opportunities for K-12 aged children?
How can effective strategies, mechanisms and resources of the Collaboratory be scaled and adapted to new contexts?
This article makes a case for the importance of brokering future learning opportunities to youth as a programmatic goal for informal learning organizations. Such brokering entails engaging in practices that connect youth to events, programs, internships, individuals and institutions related to their interests to support them beyond the window of a specific program or event. Brokering is especially critical for youth who are new to an area of interest: it helps them develop both a baseline understanding of the information landscape and a social network that will respond to their needs as they
Brokering Youth Pathways was created to share tools and techniques around the youth development practice of “brokering” or connecting youth to future learning opportunities and resources.
This toolkit shares ways in which various out-of-school educators and professionals have approached the challenge of brokering. It provides a framework, practice briefs and reports that focus on a particular issue or challenge and provide concrete examples, as well as illustrate how project partners partners worked through designing new brokering routines in partnership with a research team.
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
Video has become a key tool for scientific communication because it increases the outreach and impact of projects, furthers scientific research within and across fields of study, and offers an accessible medium to engage the public in the understanding of science. This project supports the expansion of an interactive, online STEM Videohall where hundreds of NSF-funded researchers share their work through brief video narratives and interactive discussion. While the Videohall is accessible year-round, periodic annual Showcase events are used to drive visitors to the site where they can engage with one another, the project investigators and trained facilitators. The Videohall is a multiplier of NSF's investments in individual projects because it allows STEM education researchers to become aware of, and learn from, related work that is funded across NSF programs and directorates, and other federal agencies. In 3-minute video narratives, investigators share ideas, resources, data, evidence of impact, strategies and challenges. The Videohall platform supports open access and is designed to foster communication in ways that scale beyond traditional formats such as academic conferences. Moreover, because the online STEM Videohall is open to the public, it allows STEM investigators to share their work with multiple stakeholder communities including K-12 educators and school leaders, informal educators and community organizations, the STEM industry, education policy makers and families. Finally, because each video narrative is accompanied by a facilitated online discussion thread, investigators have a unique and valuable mechanism for receiving feedback from these various stakeholder communities. The STEM Videohall project is funded by the Discovery Research K-12 program (DRK-12), which seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.
This project brings together seven NSF-funded resource centers who work with their respective communities to encourage Principal Investigators to share video narratives of their work through annual NSF STEM Showcase events. Each annual Showcase event presents videos created by 150-230 projects; many of the projects are affiliated with one of the seven resource centers, but others are from projects across NSF directorates and beyond. During a one-week period, Principal Investigators, their project staff, as well as the public at large, are invited to engage in interactive discourse, providing queries, comments, and feedback. Participants also vote for favorite presentations through "Presenters' Choice," "Public Choice," and "Facilitators' Choice," processes. This participant voting system serves to increase engagement and enhances outreach of the event through social media. After the one-week Showcase event concludes, all of the videos along with the related discourse remain available to the public online, who continue to access the Showcase throughout the year. Based on prior pilot work, it is estimated that over the course of a year, over 30,000 visitors, from over 150 countries, will engage with each annual Showcase. Videos from annual showcase events will be shared, reused, and repurposed to create new products with new constituencies. The project includes technical development efforts to iteratively improve its interactive platform, outreach efforts before each annual Showcase event, facilitation of the week-long event, and intensive dissemination efforts. A research component examines the extent of participation on various constituencies, the benefit of participation to projects, and the success of the events in terms of dissemination nationally and internationally.
Increasingly, the prosperity, innovation and security of individuals and communities depend on a big data literate society. Yet conspicuously absent from the big data revolution is the field of teaching and learning. The revolution in big data must match a complementary revolution in a new kind of literacy, through a significant infusion of STEM education with the kinds of skills that the revolution in 21st century data-driven science demands. This project represents a concerted effort to determine what it means to be a big data literate citizen, information worker, researcher, or policymaker; to identify the quality of learning resources and programs to improve big data literacy; and to chart a path forward that will bridge big data practice with big data learning, education and career readiness.
Through a process of inquiry research and capacity-building, New York Hall of Science will bring together experts from member institutions of the Northeast Big Data Innovation Hub to galvanize big data communities of practice around education, identify and articulate the nature and quality of extant big data education resources and draft a set of big data literacy principles. The results of this planning process will be a planning document for a Big Data Literacy Spoke that will form an initiative to develop frameworks, strategies and scope and sequence to advance lifelong big data literacy for grades P-20 and across learning settings; and devise, implement, and evaluate programs, curricula and interventions to improve big data literacy for all. The planning document will articulate the findings of the inquiry research and evaluation to provide a practical tool to inform and cultivate other initiatives in data literacy both within the Northeast Big Data Innovation Hub and beyond.
InformalScience.org is an online collection of resources designed to serve a broad community of professionals whose work relates to informal education in science, technology, engineering, and math (STEM). Funded by the National Science Foundation and managed by the Center for Advancement of Informal Science Education (CAISE), InformalScience hosts a variety of usercontributed resources, including a wiki of evidence-based information on the impacts of informal STEM and a database of over 7,000 reports, articles, project descriptions, and other items uploaded by CAISE and website members.
The
This one-year Collaborative Planning project seeks to bring together an interdisciplinary planning team of informal and formal STEM educators, researchers, scientists, community, and policy experts to identify the elements, activities, and community relationships necessary to cultivate and sustain a thriving regional early childhood (ages 3-6) STEM ecosystem. Based in Southeast San Diego, planning and research will focus on understanding the needs and interests of young Latino dual language learners from low income homes, as well as identify regional assets (e.g., museums, afterschool programs, universities, schools) that could coalesce efforts to systematically increase access to developmentally appropriate informal STEM activities and resources, particularly those focused on engineering and computational thinking. This project has the potential to enhance the infrastructure of early STEM education by providing a model for the planning and development of early childhood focused coalitions around the topic of STEM learning and engagement. In addition, identifying how to bridge STEM learning experiences between home, pre-k learning environments, and formal school addresses a longstanding challenge of sustaining STEM skills as young children transition between environments.
The planning process will use an iterative mixed-methods approach to develop both qualitative and quantitative and data. Specific planning strategies include the use of group facilitation techniques such as World Café, graphic recording, and live polling. Planning outcomes include: 1) a literature review on STEM ecosystems; 2) an Early Childhood STEM Community Asset Map of southeast San Diego; 3) a set of proposed design principles for identifying and creating early childhood STEM ecosystems in low income communities; and 4) a theory of action that could guide future design and research. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This summative evaluation report details the Broad Implementation of the Living Laboratory model--an initiative to promote partnership between museums and cognitive science researchers in order to promote professional learning and involve the public in scientific research. The evaluation investigated the extent of the dissemination effort’s depth, spread, sustainability, and shift in ownership, based on Coburn’s criteria for scale-up (2003). Evaluators collected data from surveys, interviews, focus groups, document review, and observations. Findings about depth suggest that adopters fully
This infographic presents a visual summary of a user study of the InformalScience.org website, which was conducted in 2016. The study used online surveys, task-based interviews, and web analytics to explore the following questions: (1) Who are the site's users and what content do they value? (2) Does the site clearly convey its purpose to visitors? and (3) Are users able to navigate the site and use search tools effectively?