Although virtual conferences have become commonplace in the age of COVID-19, this format poses both challenges and opportunities for organizers to design, implement, and engage participants in productive and connected ways. We created this brief to share an example of the process and lessons learned as we designed and hosted a virtual NSF-funded conference called: Mapping Connections Between STEM and Social-Emotional Development (SED) in Out-of-School Time (OST) Programs. This conference focused on identifying outcomes at the interface of STEM and SED in OST research and practice (e.g
Over the last decade there has been significant growth in the number of afterschool programs that offer science activities to youth. Measuring the quality and contributions of these programs to youth learning is important to both the afterschool organizations and the communities that support them, including participating youth and their families. To address the range and evolving interests and capacities of all young people within a community, there are, by necessity, a wide range of types of afterschool science programming. Such programming may vary by focus (e.g., botany, astronomy, computer science, engineering, or zoology), structure (e.g., hands-on, place-based, on-line, or in partnership with local industry) and other factors. Across the range of programming, there are different intended learning goals and opportunities for students. For these reasons, a range of measurement tools are needed to monitor the quality and outcomes of wide range of afterschool science programs. To explore the current state of evaluation and measurement tools for use in afterschool science programs, the University of Washington, in partnership with the Afterschool Alliance and the National Girls Collaborative, will design and host a conference for afterschool STEM leaders, researchers, and evaluators. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This conference is grounded in the programmatic priorities and strategies of afterschool organizations. The goals of the conference are to (a) articulate and map the range of intended outcomes of afterschool STEM programs; (b) identify how existing measurement and evaluation tools map on to intended outcomes; and (c) identify overlaps, complementarities, and gaps in the available tools in order to provide guidance to (i) practitioners on how and why to select current evaluation tools and (ii) researchers on directions for future tool development. Tangible convening products include:
*A detailed, visual representation ("intended outcomes map") of the range of outcomes afterschool programs are seeking to achieve, related to student learning, educator capacity, program quality, family impacts, learning ecosystems connectivity;
*A taxonomy of current evaluation instruments aligned to these outcomes, with an explanation of how they overlap or differentiate both methodologically and theoretically;
*The identification of the areas where further work is needed, including further specification of learning outcomes and future development of evaluation tools.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Coalition for Science After School was launched January 28, 2004 at the Santa Fe Institute, home to the world’s leading researchers on the study of complexity. Against the dazzling backdrop of the New Mexican mesa, 40 educational leaders from diverse but overlapping domains—science, technology, engineering and mathematics education and after-school programs—met to grapple with three emerging, important trends in youth development and science learning in this country: 1. An explosion in the number of U.S. youth attending after-school programs, and increasing links between school and after
DATE:
TEAM MEMBERS:
The Coalition for Science After SchoolLeah Reisman
Goodman Research Group, Inc. conducted a comprehensive multi-method external evaluation of the first season of the Design Squad TV series and outreach initiative. The broad evaluation goals were to: assess the extent to which children's knowledge, interest, and awareness of engineering increased as a result of watching the Design Squad series, document the implementation of community events resulting form the November 2006 Engineering Summit, and assess the effectiveness of the Afterschool Educators Guide with leaders and students.
DATE:
TEAM MEMBERS:
Peggy VaughanEmilee PressmanIrene GoodmanWGBH
This collaboration between the Franklin Institute and the Free Library of Philadelphia Foundation identifies the role of crucial intermediaries in the science learning of children and points to the opportunities offered through a museum and library partnership to provide engaging science resources in under-resourced communities where many adults lack science expertise and confidence. Through an emphasis on literacy and science, LEAP into Science builds the capacity of after school leaders, teens and parents to be competent science learners and facilitators and to connect science centers, parents and libraries in support of the science learning and achievement of children. Project features include a workshop model for families with K-4 children, enrichment sessions for after school students, family events at the museum, professional development for library and after school youth staff, and a national expansion conference. The conference introduces the project to potential national implementation sites. Case studies of sites from this conference inform a research study investigating the obstacles, modifications and necessary support to initiate and sustain the program model. The formative and summative evaluation measure the impact of this program on children, parents, librarians, and teen workers at the libraries. Fifty-three Philadelphia libraries in addition to libraries in three cities selected from the implementation conference have a direct program impact on 10,000 people nationally, including 300 after school facilitators and children's librarians.
After-school programs are a source of powerful, positive experiences for an estimated eight to ten million youth, especially those in low-income, under-represented populations (the majority of youth in these programs). Through this conference grant, TERC, along with the Exploratorium and the Lawrence Hall of Science, proposes to launch a national initiative to create, support and sustain engaging, research-based science and mathematics activities in the after-school community. This planning conference will bring together the leaders and experts who run exemplary after-school programs, create quality science and mathematics materials, and provide effective staff training to identify the challenges, goals and questions of greatest interest and value to the national community. Intellectual merit and broader impact are evidenced by the gathering of key players, promotion of dialog and the facilitation of connections between developer and after-school communities.
The Lawrence Hall of Science will host a follow-up conference to the January, 2004 conference of the National Coalition for Science in After-school. The goal of this 2nd conference is to take the emerging National Coalition for Science in After-school further, bringing in additional organizations and points of view, to take the vision the next step into action plans that will establish an infrastructure, a research agenda and framework, an advocacy campaign and a plan for sustainability that will include further networking among participants. The conference will contribute to the enhancement of science education for the more than ten percent of the Nation's youth who currently participate in after-school programs, many of whom are least well served in the formal educational system. The conference will bring together leaders in science education and after-school programs to combine their best thinking about ways to share current ideas and to create new partnerships, models, research initiatives and organizational structures to advance their work. The conference will allow current and potential leaders in STEM and after-school organizations to inform one another, share best practices and form strategic alliances. In addition to traditional dissemination mechanisms (website, listserv, conference report), the conference will result in an action plan that includes extending membership in the Coalition to additional organizations and its messages to new audiences, including those who work with students with disabilities, community organizations and parent advocates. In addition to Lawrence Hall, the lead organizations in the Coalition are the Exploratorium, TERC, the Children's Aid Society, the National Afterschool Association and The After School Corporation.