This study explored the effect of depth of learning (as measured in hours) on creativity, curiosity, persistence and self-efficacy. We engaged ~900 parents and 900 students across 21 sites in Washington, Chicago, Los Angeles, New York, Alabama, Virginia and the United Arab Emirates, in 5-week (10-hr) Curiosity Machine programs. Iridescent trained partners to implement the programs. Thus, this analysis was also trying to establish a baseline to measure any loss in impact from scaling our programs and moving to a “train-the-trainer” model. We analyzed 769 surveys out of which 126 were paired. On
This poster was presented at the 2014 AISL PI Meeting in Washington DC. It describes the CLUES project that provides STEM education opportunities to families.
DATE:
TEAM MEMBERS:
New Jersey Academy for Aquatic SciencesBarbara Kelly
resourceprojectProfessional Development, Conferences, and Networks
The Coalition for Science After School (CSAS) was established in 2004 in response to the growing need for more STEM (science, technology, engineering, and mathematics) learning opportunities in out-of-school time. CSAS sought to build this field by uniting STEM education goals with out-of-school time opportunities and a focus on youth development. Over a decade of work, CSAS Steering Committee members, staff and partners advocated for STEM in out-of-school-time settings, convened leaders, and created resources to support this work. CSAS leadership decided to conclude CSAS operations in 2014, as the STEM in out-of-school time movement had experienced tremendous growth of programming and attention to science-related out-of-school time opportunities on a national level. In its ten-year strategic plan, CSAS took as its vision the full integration of the STEM education and out-of-school time communities to ensure that quality out-of-school time STEM opportunities became prevalent and available to learners nationwide. Key CSAS activities included: (1) Setting and advancing a collective agenda by working with members to identify gaps in the field, organizing others to create solutions that meet the needs, identifying policy needs in the field and supporting advocates to advance them; (2) Developing and linking committed communities by providing opportunities for focused networking and learning through conferences, webinars, and other outreach activities; and (3) Identifying, collecting, capturing, and sharing information and available research and resources in the field. The leadership of the Coalition for Science After School is deeply grateful to the funders, partners, supporters, and constituents that worked together to advance STEM in out-of-school time during the last decade, and that make up today's rich and varied STEM in out-of-school time landscape. We have much to be proud of, but as a movement there is much more work to be done. As this work continues to expand and deepen, it is appropriate for the Coalition for Science After School to step down as the many other organizations that have emerged over the last decade take on leadership for the critical work that remains to be done. A timeline and summary of CSAS activities, products, and accomplishments is available for download on this page. All resources noted in the narrative are also available for download below.
The Coalition for Science After School was launched January 28, 2004 at the Santa Fe Institute, home to the world’s leading researchers on the study of complexity. Against the dazzling backdrop of the New Mexican mesa, 40 educational leaders from diverse but overlapping domains—science, technology, engineering and mathematics education and after-school programs—met to grapple with three emerging, important trends in youth development and science learning in this country: 1. An explosion in the number of U.S. youth attending after-school programs, and increasing links between school and after
DATE:
TEAM MEMBERS:
The Coalition for Science After SchoolLeah Reisman
The goal of this project is to advance STEM education in Hawaii by creating a series of educational products, based on NASA Earth Systems Science, for students (grades 3-5) and general public. Bishop Museum (Honolulu HI) is the lead institution. NASA Goddard Space Flight Center is the primary NASA center involved in the project. Partners include Hawaii Department of Education and a volunteer advisory board. The evaluation team includes Doris Ash Associates (UC Santa Cruz) and Wendy Meluch of Visitor Studies Inc. Key to this project: the NASA STEM Cohort, a team of six current classroom teachers whom the Museum will hire. The cohort will not only develop curricula on NASA earth science systems but also provide guidance to Bishop Museum on creating museum educational programming that best meets the needs of teachers and students. The overall goal of Celestial Islands is to advance STEM education in Hawaii through the use of NASA Earth Science Systems content. Products include: 1) combined digital planetarium/Science on a Sphere® program; 2) traveling version of that program, using a digital planetarium and Magic Planet; 3) curricula; 4) new exhibit at Bishop Museum on NASA ESS; 5) 24 teacher workshops to distribute curricula; 6) 12 community science events. The project's target audience is teachers and students in grades 3-5. Secondary audiences include families and other members of the general public. A total of 545,000 people will be served, including at least 44,000 students.
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.
The National Federation of the Blind (NFB), with six science centers across the U.S., will develop, implement, and evaluate the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through partnerships and companion research, the NCBYS will lead to greater capacity to engage the blind in informal STEM learning. The NCBYS confronts a critical area of need in STEM education, and a priority for the AISL program: the underrepresentation of people with disabilities in STEM. Educators are often unaware of methods to deliver STEM concepts to blind students, and students do not have the experience with which to advocate for accommodations. Many parents of blind students are ill-equipped to provide support or request accessible STEM adaptations. The NCBYS will expose blind youth to non-visual methods that facilitate their involvement in STEM; introduce science centers to additional non-visual methods that facilitate the involvement of the blind in their exhibits; educate parents as to their students' ability to be independent both inside and outside the STEM classroom; provide preservice teachers of blind students with hands-on experience with blind students in STEM; and conduct research to inform a field that is lacking in published material. The NCBYS will a) conduct six regional, two-day science programs for a total of 180 blind youth, one day taking place at a local science center; b) conduct concurrent onsite parent training sessions; c) incorporate preservice teachers of blind students in hands-on activities; and d) perform separate, week-long, advanced-study residential programs for 60 blind high school juniors and seniors focused on the design process and preparation for post-secondary STEM education. The NCBYS will advance knowledge and understanding in informal settings, particularly as they pertain to the underrepresented disability demographic; but it is also expected that benefits realized from the program will translate to formal arenas. The proposed team represents the varied fields that the project seeks to inform, and holds expertise in blindness education, STEM education, museum education, parent outreach, teacher training, disability research, and project management. The initiative is a unique opportunity for science centers and the disability population to collaborate for mutual benefit, with lasting implications in informal STEM delivery, parent engagement, and teacher training. It is also an innovative approach to inspiring problem-solving skills in blind high school students through the design process. A panel of experts in various STEM fields will inform content development. NCBYS advances the discovery and understanding of STEM learning for blind students by integrating significant research alongside interactive programs. The audience includes students and those responsible for delivering STEM content and educational services to blind students. For students, the program will demonstrate their ability to interface with science center activities. Students will also gain mentoring experience through activities paired with younger blind students. Parents and teachers of blind students, as well as science center personnel, will gain understanding in the experiences of the blind in STEM, and steps to facilitate their complete involvement. Older students will pursue design inquiries into STEM at a more advanced level, processes that would be explored in post-secondary pursuits. By engaging these groups, the NCBYS will build infrastructure in the informal and formal arenas. Society benefits from the inclusion of new scientific minds, resulting in a diverse workforce. The possibility for advanced study and eventual employment for blind students also reduces the possibility that they would be dependent upon society for daily care in the future. The results of the proposed project will be disseminated and published broadly through Web sites; e-mail lists; social media; student-developed e-portfolios of the design program; an audio-described video; and presentations at workshops for STEM educators, teachers of blind students, blind consumer groups, researchers in disability education, and museum personnel.
This article briefly outlines the unique evaluation strategy developed by staff at the Science Museum in London as part of the £50 million Wellcome Wing expansion project. The project aimed to produce "visit-centered" exhibitions that illustrate the impact of contemporary science and technology on ordinary people's lives.
This paper reports a formative evaluation of an interactive exhibit in the Museum of Science, Boston, that encouraged visitors to create a model using everyday materials. The materials provided for visitors to create their models changed during the period of the evaluation, and visitors were observed and interviewed as they engaged with the various prototypes. Evaluation results show that the type of modeling material presented influenced the visitors' model making process and individual learning and behaviors as well as the interactions visitors had with each other.
Backyard Mystery is an NSF-funded curriculum, focused on diseases, pathogens and careers, using interactive paper and physical activities. Content is for middle school participants in afterschool settings, like 4-H and other similar venues. The curriculum engages student interest in genetics and genomics and in the bioSTEM workforce. The curriculum storyline is placed in a familiar setting to students--the backyard--and explores fungi, bacteria, viruses and parasites in a way that is engaging fun and informative. It can be tailored to specific audiences, e.g. participants interested in animal science will gain from focusing on the parasite panel. The curriculum is available in two forms: a combined lesson that brings all of the elements together in one session and another in which the content is broken out into three separate lessons. We would like to share this curriculum with facilitators and educators for both out-of-school time and classroom settings. It is available electronically and free to use. We only ask for users to complete a brief survey to give us feedback, which is helpful for NSF.
Roto, an exhibition design and production firm, contracted Randi Korn & Associates, Inc. (RK&A) to conduct a front-end evaluation of Speed, an exhibition being developed for The Science Museum of Virginia (SMV) in Richmond, Virginia. RK&A explored visitors’ thoughts, perceptions, and understandings of exhibition concepts related to speed, defined as change over time. How did we approach this study? RK&A worked closely with Roto to identify the goals and objectives for the Speed exhibition. Findings from the front-end evaluation were designed to help Roto and SMV find common ground between
This summative evaluation of the exhibition Robots & Us was designed to investigate how visitor audiences used and experienced this exhibition in relation to the project’s objectives and challenges. Visitors’ expectations and perceptions in relation to the project’s content goals prompted the summative evaluation to focus on specific challenges including: attitudes and perceptions about technology, connections between robots and people, appeal to a broad audience, and reactions to specific exhibits.
DATE:
TEAM MEMBERS:
Jeff HaywardJolene HartScience Museum of Minnesota