'Be a Scientist!' is a full-scale development project that examines the impact of a scalable, STEM afterschool program which trains engineers to develop and teach inquiry-based Family Science Workshops (FSWs) in underserved communities. This project builds on three years of FSWs which demonstrate improvements in participants' science interest, knowledge, and self-efficacy and tests the model for scale, breadth, and depth. The project partners include the Viterbi School of Engineering at the University of Southern California, the Albert Nerken Engineering Department at the Cooper Union, the Los Angeles Museum of Natural History, and the New York Hall of Science. The content emphasis is physics and engineering and includes topics such as aerodynamics, animal locomotion, automotive engineering, biomechanics, computer architecture, optics, sensors, and transformers. The project targets underserved youth in grades 1-5 in Los Angeles and New York, their parents, and engineering professionals. The design is grounded in motivation theory and is intended to foster participants' intrinsic motivation and self-direction while the comprehensive design takes into account the cultural, social, and intellectual needs of diverse families. The science activities are provided in a series of Family Science Workshops which take place in afterschool programs in eight partner schools in Los Angeles and at the New York Hall of Science in New York City. The FSWs are taught by undergraduate and graduate engineering students with support from practicing engineers who serve as mentors. The primary project deliverable is a five-year longitudinal evaluation designed to assess (1) the impact of intensive training for engineering professionals who deliver family science activities in community settings and (2) families' interest in and understanding of science. Additional project deliverables include a 16-week training program for engineering professionals, 20 physics-based workshops and lesson plans, Family Science Workshops (40 in LA and 5 in NY), a Parent Leadership Program and social networking site, and 5 science training videos. This project will reach nearly one thousand students, parents, and student engineers. The multi-method evaluation will be conducted by the Center for Children and Technology at the Education Development Center. The evaluation questions are as follows: Are activities such as recruitment, training, and FSWs aligned with the project's goals? What is the impact on families' interest in and understanding of science? What is the impact on engineers' communication skills and perspectives about their work? Is the project scalable and able to produce effective technology tools and develop long-term partnerships with schools? Stage 1 begins with the creation of a logic model by stakeholders and the collection of baseline data on families' STEM experiences and knowledge. Stage 2 includes the collection of formative evaluation data over four years on recruitment, training, co-teaching by informal educators, curriculum development, FSWs, and Parent Leadership Program implementation. Finally, a summative evaluation addresses how well the project met the goals associated with improving families' understanding of science, family involvement, social networking, longitudinal impact, and scalability. A comprehensive dissemination plan extends the project's broader impacts in the museum, engineering, evaluation, and education professional communities through publications, conference presentations, as well as web 2.0 tools such as blogs, YouTube, an online social networking forum for parents, and websites. 'Be a Scientist!' advances the field through the development and evaluation of a model for sustained STEM learning experiences that helps informal science education organizations broaden participation, foster collaborations between universities and informal science education organizations, increase STEM-based social capital in underserved communities, identify factors that develop sustained interest in STEM, and empower parents to co-invest and sustain a STEM program in their communities.
Explore the Galaxy involved teens from Chicago Public Schools (CPS) in planning for an upcoming exhibition and its interpretation. The Adler Planetarium worked with teens from several CPS high schools, with a special focus on the CPS Air Force Academy High School (AFAHS). The goals were to develop institutional partnerships and capacity for a teen docent program as well as to do formative evaluation for an upcoming exhibition. All goals were met. The Adler is now in year 4 of a comprehensive partnership with the AFAHS involving students from all four grades in field trips, activities, after-school clubs and Adler internships. The AFAHS students are now participants in an active teen internship program that places students in different Adler professional departments every summer. As well the Adler employs volunteer and paid teen interpreters on school year weekends. These relationships and programs depend on the foundations laid through the work of this grant. In the realm of exhibition design, teens also interviewed visitors about prior conceptions and interest in several areas related to cosmology including how gravity works and the size and age of the universe. Their comments influenced design of, The Universe a Walk through Space and Time, which opened in summer of 2012.
The project will conduct a mapping study to describe the contexts, characteristics and practices of a national sample of science-focused Out-of-School Time (OST) programs. The study targets OST programs for middle- and high-school-aged youth, including after-school programs, camps, workshops, internships, and other models. While millions of dollars are invested in these programs, and tens of thousands of students participate , as a community, we have no truly comprehensive view of the wide variety of formats, audiences, and approaches that are represented by the many active programs. Where, when, and by whom are these science-rich programs conducted? What types of experiences do they offer to what kinds of students, with what goals? What organizational and experiential factors affect the outcomes for these youth? Ultimately, we wish to understand how these differences in program design are related to youth outcomes such as STEM learning, attitudes and interest, and their later career and educational choices. To answer these questions, we are gathering data through documents, interviews, and the online MOST-Science Questionnaire.
Youth Action Crews map the youth development programs and places in their neighborhoods in order to raise public awareness of the opportunities—and of where such opportunities don’t exist.
Self-assessment can be a powerful tool for evaluating program quality, yet the available self-assessment instruments do not comprehensively address practices that promote academic enrichment.
This technical report summarizes the statistical analyses used to determine how well the Measuring Activation (MA) instrument developed through the Science Learning Activation Lab project gathers appropriate information about the five dimensions of activation. The MA instrument was designed to evaluate the impact of science-learning programs and experiences on activation, and contains a series of survey items organized around five identified dimensions of activation. The five dimensions of activation are: fascination, values, perceived autonomy, competency beliefs, and scientific sensemaking.
This research study involves collaboration between researchers at the University of Maryland, College Park and Bowie State University, an HBCU, to examine a multi-component pre-service model for preparing minority students to teach upper elementary and middle level science. The treatment consists of (1) focused recruitment efforts by the collaborating universities; (2) a pre-service science content course emphasizing inquiry and the mathematics of data management; (3) an internship in an after school program serving minority students; (4) field placements in Prince Georges County minority-serving professional development schools; and (5) mentoring support during the induction year. The research agenda will examine each aspect of the intervention using quantitative and qualitative methods and a small number of case studies.
DATE:
-
TEAM MEMBERS:
James McginnisSpencer BensonScott Dantley
The intent of this project is to use social network methods to study networks of afterschool and informal science stakeholders. It would attempt to create knowledge that improves afterschool programs access to informal science learning materials. This is an applied research study that applies research methods to improving access to and enactment of informal science education programs across a range of settings. The investigators plan to collect data from 600 community- and afterschool programs in California, conduct case studies of 10 of these programs, and conduct surveys of supporting intermediary organizations. The analysis of the data will provide descriptions of the duration, intensity, and nature of the networks among afterschool programs and intermediary agencies, and the diffusion patterns of science learning materials in afterschool programs. The project will yield actionable knowledge that will be disseminated among afterschool programs, intermediary organizations, funding agencies, and policymakers to improve the dissemination and support of afterschool science learning opportunities. The project is focused on free-choice settings where every day the largest numbers of children attend afterschool programs at schools and in other community settings. It seeks information about what conditions are necessary for informal science programs to significantly impact the largest possible number of children in these settings.
DATE:
-
TEAM MEMBERS:
Barbara MeansAnn HouseCarlin LlorenteRaymond McGhee
All youth in the Science Museum of Minnesota's Kitty Andersen Youth Science Center (KAYSC) are invited to complete a web-based exit survey upon leaving their current team. The survey is the same across all KAYSC teams, with the addition of some questions specific to a team experience and outcomes. This report includes select data from the exit surveys for the Invention, Design, Engineering, and Art (IDEA) Cooperative high school team, called the Invention Crew. The purpose of the exit surveys were to understand youth's overall experience on the IDEA Coop as well as the impact of the IDEA Coop
All youth in the Science Museum of Minnesota's Kitty Andersen Youth Science Center (KAYSC) are invited to complete a web-based exit survey upon leaving their current team. The survey is the same across all KAYSC teams, with the addition of some questions specific to a teamâs experience and outcomes. This report includes select data from the exit surveys for the Invention, Design, Engineering, and Art (IDEA) Cooperative middle school team, called the Design Team. The purpose of the exit surveys were to understand youth's overall experience on the IDEA Coop as well as the impact of the IDEA
Presentation on NSF grant DRL-0917536 (""Studying and Improving Networks for Disseminating STEM Educational Materials in After-School Programs"") presented at the CAISE Convening on Organizational Networks, November 17th, 2011.
In this article, the author describes the process and result of a statewide effort in New York to develop an afterschool quality framework and assessment tool that can be used to guide program design, reflection, and assessment. One benefit of the tool is that it can be used by program stakeholders without the participation (i.e., the expense) of an external observer. This article might be of interest to ISE educators seeking to adopt existing program evaluation tools that do not require the participation of external evaluators.