Although virtual conferences have become commonplace in the age of COVID-19, this format poses both challenges and opportunities for organizers to design, implement, and engage participants in productive and connected ways. We created this brief to share an example of the process and lessons learned as we designed and hosted a virtual NSF-funded conference called: Mapping Connections Between STEM and Social-Emotional Development (SED) in Out-of-School Time (OST) Programs. This conference focused on identifying outcomes at the interface of STEM and SED in OST research and practice (e.g
Over the last decade there has been significant growth in the number of afterschool programs that offer science activities to youth. Measuring the quality and contributions of these programs to youth learning is important to both the afterschool organizations and the communities that support them, including participating youth and their families. To address the range and evolving interests and capacities of all young people within a community, there are, by necessity, a wide range of types of afterschool science programming. Such programming may vary by focus (e.g., botany, astronomy, computer science, engineering, or zoology), structure (e.g., hands-on, place-based, on-line, or in partnership with local industry) and other factors. Across the range of programming, there are different intended learning goals and opportunities for students. For these reasons, a range of measurement tools are needed to monitor the quality and outcomes of wide range of afterschool science programs. To explore the current state of evaluation and measurement tools for use in afterschool science programs, the University of Washington, in partnership with the Afterschool Alliance and the National Girls Collaborative, will design and host a conference for afterschool STEM leaders, researchers, and evaluators. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This conference is grounded in the programmatic priorities and strategies of afterschool organizations. The goals of the conference are to (a) articulate and map the range of intended outcomes of afterschool STEM programs; (b) identify how existing measurement and evaluation tools map on to intended outcomes; and (c) identify overlaps, complementarities, and gaps in the available tools in order to provide guidance to (i) practitioners on how and why to select current evaluation tools and (ii) researchers on directions for future tool development. Tangible convening products include:
*A detailed, visual representation ("intended outcomes map") of the range of outcomes afterschool programs are seeking to achieve, related to student learning, educator capacity, program quality, family impacts, learning ecosystems connectivity;
*A taxonomy of current evaluation instruments aligned to these outcomes, with an explanation of how they overlap or differentiate both methodologically and theoretically;
*The identification of the areas where further work is needed, including further specification of learning outcomes and future development of evaluation tools.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This evaluation reports on the Mission: Solar System project, a 2-year project funded by NASA. The goal of the Mission: Solar System was to create a collection of resources that integrates digital media with hands-on science and engineering activities to support kids’ exploration in formal and informal education settings. Our goal in creating the resources were: For youth: (1) Provide opportunities to use science, technology, engineering, and math to solve challenges related to exploring our solar system, (2) Build and hone critical thinking, problem-solving, and design process skills, (3)
SRI’s Afterschool Science Networks (ASN) study provides new insights and empirical findings regarding the offering of science learning opportunities at scale. Four meetings of afterschool and informal science stakeholders were held in March and April 2014 to discuss the ASN findings generated from 5 years of research (see research summary on page 12). These stakeholders helped SRI Education researchers generate a vision of science in afterschool settings, as well as recommendations for strengthening the field. This document presents this vision of powerful afterschool science and provides a
DATE:
TEAM MEMBERS:
Ann HouseCarlin LlorenteTiffany Leones
The Coalition for Science After School was initiated through two NSF-funded meetings in 2004 and 2005 that brought science education and out-of-school time leaders together to explore strategies for further merging the two fields. Through the second conference, held in Marina del Ray, CA, a blueprint for CSAS was designed and finalized. Under the leadership of an eight-member Executive Committee, an expanded 20-member Steering Committee, and acting director Bronwyn Bevan, CSAS was launched with 40 members. The meeting report, A Blueprint for Action (2007), laid out CSAS priorities and
DATE:
TEAM MEMBERS:
The Coalition for Science After SchoolThe Coalition for Science After School
In 2009 the Coalition for Science After School hosted the First National Conference on Science and Technology in Out-of-School Time. Funded by the Noyce Foundation, with additional support from Science Chicago, the Motorola Foundation, and the United States Department of Education, the meeting took place in Chicago, IL and resulted in a 2009 report, "A Watershed Moment."
DATE:
TEAM MEMBERS:
The Coalition for Science After SchoolThe Coalition for Science After SchoolProject Exploration
In preparation for its sunset of operations, the Coalition for Science After School Steering Committee decided to organize a Summit, Passing the Torch: Advancing Opportunity for Quality Science Learning. The meeting took place in March 2014, hosted by the Exploratorium in San Francisco. An invited group of sixty leaders came together from across the STEM education, youth development, and out-of-school time communities to assess the accomplishments, challenges, gaps, and essential resources needed to provide quality STEM learning opportunities for all youth, and to pass the torch for making
DATE:
TEAM MEMBERS:
The Coalition for Science After SchoolKaren Stratvert
The Coalition for Science After School was launched January 28, 2004 at the Santa Fe Institute, home to the world’s leading researchers on the study of complexity. Against the dazzling backdrop of the New Mexican mesa, 40 educational leaders from diverse but overlapping domains—science, technology, engineering and mathematics education and after-school programs—met to grapple with three emerging, important trends in youth development and science learning in this country: 1. An explosion in the number of U.S. youth attending after-school programs, and increasing links between school and after
DATE:
TEAM MEMBERS:
The Coalition for Science After SchoolLeah Reisman
From March 26-28, 2014, the Coalition for Science After School (CSAS) hosted its final summit, Passing the Torch: Advancing Opportunity for Quality Science Learning. The Summit was intended to: (1) celebrate a decade of progress in strengthening and expanding STEM learning opportunities in out-of-school time; (2) call attention to critical issues in ensuring that all young people have opportunities for quality STEM experiences in their local communities; and (3) stimulate ideas, strategies, partnerships and commitments to continue to increase opportunities for quality STEM experiences across
DATE:
TEAM MEMBERS:
The Coalition for Science After SchoolLeah Reisman
Goodman Research Group, Inc. conducted a comprehensive multi-method external evaluation of the first season of the Design Squad TV series and outreach initiative. The broad evaluation goals were to: assess the extent to which children's knowledge, interest, and awareness of engineering increased as a result of watching the Design Squad series, document the implementation of community events resulting form the November 2006 Engineering Summit, and assess the effectiveness of the Afterschool Educators Guide with leaders and students.
DATE:
TEAM MEMBERS:
Peggy VaughanEmilee PressmanIrene GoodmanWGBH
This collaboration between the Franklin Institute and the Free Library of Philadelphia Foundation identifies the role of crucial intermediaries in the science learning of children and points to the opportunities offered through a museum and library partnership to provide engaging science resources in under-resourced communities where many adults lack science expertise and confidence. Through an emphasis on literacy and science, LEAP into Science builds the capacity of after school leaders, teens and parents to be competent science learners and facilitators and to connect science centers, parents and libraries in support of the science learning and achievement of children. Project features include a workshop model for families with K-4 children, enrichment sessions for after school students, family events at the museum, professional development for library and after school youth staff, and a national expansion conference. The conference introduces the project to potential national implementation sites. Case studies of sites from this conference inform a research study investigating the obstacles, modifications and necessary support to initiate and sustain the program model. The formative and summative evaluation measure the impact of this program on children, parents, librarians, and teen workers at the libraries. Fifty-three Philadelphia libraries in addition to libraries in three cities selected from the implementation conference have a direct program impact on 10,000 people nationally, including 300 after school facilitators and children's librarians.
After-school programs are a source of powerful, positive experiences for an estimated eight to ten million youth, especially those in low-income, under-represented populations (the majority of youth in these programs). Through this conference grant, TERC, along with the Exploratorium and the Lawrence Hall of Science, proposes to launch a national initiative to create, support and sustain engaging, research-based science and mathematics activities in the after-school community. This planning conference will bring together the leaders and experts who run exemplary after-school programs, create quality science and mathematics materials, and provide effective staff training to identify the challenges, goals and questions of greatest interest and value to the national community. Intellectual merit and broader impact are evidenced by the gathering of key players, promotion of dialog and the facilitation of connections between developer and after-school communities.