The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
This Integrative Graduate Education and Research Training (IGERT) award supports the establishment of an interdisciplinary graduate training program in Cognitive, Computational, and Systems Neuroscience at Washington University in Saint Louis. Understanding how the brain works under normal circumstances and how it fails are among the most important problems in science. The purpose of this program is to train a new generation of systems-level neuroscientists who will combine experimental and computational approaches from the fields of psychology, neurobiology, and engineering to study brain function in unique ways. Students will participate in a five-course core curriculum that provides a broad base of knowledge in each of the core disciplines, and culminates in a pair of highly integrative and interactive courses that emphasize critical thinking and analysis skills, as well as practical skills for developing interdisciplinary research projects. This program also includes workshops aimed at developing the personal and professional skills that students need to become successful independent investigators and educators, as well as outreach programs aimed at communicating the goals and promise of integrative neuroscience to the general public. This training program will be tightly coupled to a new research focus involving neuro-imaging in nonhuman primates. By building upon existing strengths at Washington University, this research and training initiative will provide critical new insights into how the non-invasive measurements of brain function that are available in humans (e.g. from functional MRI) are related to the underlying activity patterns in neuronal circuits of the brain. IGERT is an NSF-wide program intended to meet the challenges of educating U.S. Ph.D. scientists and engineers with the interdisciplinary background, deep knowledge in a chosen discipline, and the technical, professional, and personal skills needed for the career demands of the future. The program is intended to catalyze a cultural change in graduate education by establishing innovative new models for graduate education and training in a fertile environment for collaborative research that transcends traditional disciplinary boundaries.
DATE:
-
TEAM MEMBERS:
Kurt ThoroughmanGregory DeAngelisRandy BucknerSteven PetersenDora Angelaki
This evaluator reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It reflects on the nature of learning and challenges assumptions of outcomes from engaging in informal learning experiences.
This funder reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It describes the importance of evaluation to funders, and provides some prompts and questions for thinking about evaluation with relation to funding.
This leadership reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It provides an organizational leadership perspective on evaluation.
This practitioner reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It discusses improving practice through reflection.
Listening to and empowering children is a main objective of the EU project SIS Catalyst – Children as Change Agents for Science in Society. Within this frame, a training workshop was held with researchers from the University Innsbruck (Austria) who are involved in the children’s University Junge Uni Innsbruck. We analysed the discussions of the scientists about the reasons why they engage in science in society activities, and why they think that children are interested in participating in such activities, and we compared these outcomes with similar discussions carried out by children in the
DATE:
TEAM MEMBERS:
Andrea Bou-VinalsSilvia Prock
resourceprojectProfessional Development, Conferences, and Networks
QuarkNet is a national program that partners high school science teachers and students with particle physicists working in experiments at the scientific frontier. These experiments are searching for answers to fundamental questions about the origin of mass, the dimensionality of spacetime and the nature of symmetries that govern physical processes. Among the experimental projects at the energy frontier with which QuarkNet is affiliated is the Large Hadron Collider, which is poised at the horizon of discovery. The LHC will come on line during the 5-years of this program. QuarkNet is led by a group of teachers, educators and physicists with many years of experience in professional development workshops and institutes, materials development and teacher research programs. The project consists of 52 centers at universities and research labs in 25 states and Puerto Rico. It is proposed that Quarknet be funded as a partnership among the ESIE program of EHR; the Office of Multidisciplinary Activities and the Elementary Particle Physics Program (Division of Physics), both within MPS; as well as the Division of High Energy Physics at DOE.
DATE:
-
TEAM MEMBERS:
Mitchell WayneRandal RuchtiDaniel Karmgard
resourceprojectProfessional Development, Conferences, and Networks
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The State University of New York (SUNY) and the New York Academy of Sciences (NYAS) are collaborating to implement the SUNY/NYAS STEM Mentoring Program, a full scale development project designed to improve the science and math literacy of middle school youth. Building upon lessons learned through the implementation of national initiatives such as NSF's Graduate STEM Fellows in K-12 Education (GK-12) Program, university initiatives such as the UTeach model, and locally-run programs, this project's goals are to: 1) increase access to high quality, hands-on STEM programs in informal environments, 2) improve teaching and outreach skills of scientists in training (graduate and postdoctoral fellows), and 3) test hypotheses around scalable program elements. Together, SUNY and NYAS propose to carry out a comprehensive, systemic science education initiative to recruit graduate students and postdoctoral fellows studying science, technology, engineering, and mathematics (STEM) disciplines at colleges and universities statewide to serve as mentors in afterschool programs. SUNY campuses will partner with a community-based organization (CBO) to place mentors in afterschool programs serving middle school students in high-need, low-resource urban and rural communities. Project deliverables include a three-credit online graduate course for mentor training, six pilot sites, a best practices guide, and a model for national dissemination. The online course will prepare graduate and postdoctoral fellows to spend 12-15 weeks in afterschool programs, introducing students to life science, earth science, mathematics and engineering using curriculum modules that are aligned with the New York State standards. The project design includes three pre-selected sites (College of Nanoscale Science & Engineering at the University of Albany, SUNY Institute of Technology, and SUNY Downstate Medical Center) and three future sites to be selected through a competitive process, each of which will be paired with a CBO to create a locally designed STEM mentoring program. As a result, a minimum of 192 mentors will provide informal STEM education to 2,880 middle school students throughout New York State. The comprehensive, mixed-methods evaluation will address the following questions: 1) Does student participation in an afterschool model of informal education lead to an increase in STEM content knowledge, attitudes, self-efficacy, and interest in pursuing further STEM education and career pathways? 2) Do young scientists who participate in the program develop effective teaching and mentoring skills, and develop interest in teaching or mentoring career options that result in STEM retention? 3) What are the attributes of an effective STEM afterschool program and the elements of local adaptation and innovation that are necessary to achieve a successful scale-up to geographically diverse locations? 4) What is the role of the afterschool model in delivering informal STEM education? This innovative model includes a commitment to scale across the 64 SUNY campuses and 122 Councils of the Girl Scouts of the USA, use an online platform to deliver training, and place scientists-in-training in informal learning environments. It is hypothesized that as a result of greater access to STEM education in an informal setting, participating middle school youth will develop increased levels of STEM content knowledge, self-efficacy, confidence in STEM learning, and interest in STEM careers. Scientist mentors will: 1) gain an understanding of the context and characteristics of informal science education, 2) develop skills in mentoring and interpersonal communication, 3) learn and apply best practices of inquiry instruction, and 4) potentially develop interest in teaching as a viable career option. It is anticipated that the project will add to the research literature in several areas such as the effectiveness of incentives for graduate students; the design of mentor support systems; and the structure of pilot site programs in local communities. Findings and materials from this project will be disseminated through presentations at local, regional, and national conferences, publications in peer-reviewed journals focused on informal science education, and briefings sent to more than 25,000 NYAS members around the world.
WGBH Educational Foundation will create PEEP'S WORLD/EL MUNDO DE PEEP, a Web-based "Digital Hub," in both English and Spanish, to significantly increase the impact of the extensive collection of proven preschool science and math assets from the Emmy Award-winning TV show PEEP AND THE BIG WIDE WORLD®. This project will: (1) redesign the PEEP Web site, creating interactive media experiences that will contextualize existing content and take advantage of new Web design; (2) provide professional development for preschool educators; and (3) reach a new audience of family childcare educators, one that is woefully underserved when it comes to educational resources about science. Dissemination through a network of national organizations, including National Association of Family Child Care, National Association of Child Care Resource and Referral Agencies, National Head Start Association, National Education Association, AVANCE, and Committee for Hispanic Children and Families, will help engage the maximum number of educators and parents in the project. PEEP'S WORLD/EL MUNDO DE PEEP will provide resources for targeted audiences. Specifically these resources will provide: Children with multiple ways to engage with science or math content areas, including interactive games, animated stories, and live-action videos; Parents with guided experiences to facilitate their child's math and science play; Center-based preschool educators with a media-rich, year long science curriculum and professional development materials; and Family childcare educators with curriculum modules, integrated with media, focused on six science content areas, and professional development materials for home-care settings in English and in Spanish. The University of Massachusetts's Donahue Institute will conduct a formative evaluation of the family childcare educator resources: 200 Spanish-speaking and 200 English-speaking educators will pilot the curriculum modules and professional development videos. Concord Evaluation Group, Inc. will conduct a summative evaluation, consisting of a Family Web Site Experiment and a National Observational Study, to assess the extent to which the project is successful at achieving its intended impacts. A multifaceted national dissemination plan will include a robust social media strategy, implemented by a Spanish-speaking online community manager, to reach parents, and collaborations with early childhood education statewide systems to reach educators. The projects intended impacts are to: (1) help English- and Spanish-speaking preschoolers effectively apply science and mathematical inquiry and process skills; (2) empower English- and Spanish-speaking parents to feel more equipped and inclined to facilitate science and math exploration with their preschoolers; and, (3) provide center-based and family childcare educators with resources for incorporating math and science into their curricula and boosting their confidence in teaching these subjects. While many parents know how to read to their children, they do not typically know how to approach science or math investigations with their pre-schoolers. After parents, preschool educators are the most important promoters of a young child\'s learning. Yet, center-based and family childcare educators do not receive significant training in science, and thus lack confidence when conducting preschool science activities. By providing parents and educators resources for approaching preschool science and math, which meet their specific needs, PEEP will help alleviate these challenges.
'Be a Scientist!' is a full-scale development project that examines the impact of a scalable, STEM afterschool program which trains engineers to develop and teach inquiry-based Family Science Workshops (FSWs) in underserved communities. This project builds on three years of FSWs which demonstrate improvements in participants' science interest, knowledge, and self-efficacy and tests the model for scale, breadth, and depth. The project partners include the Viterbi School of Engineering at the University of Southern California, the Albert Nerken Engineering Department at the Cooper Union, the Los Angeles Museum of Natural History, and the New York Hall of Science. The content emphasis is physics and engineering and includes topics such as aerodynamics, animal locomotion, automotive engineering, biomechanics, computer architecture, optics, sensors, and transformers. The project targets underserved youth in grades 1-5 in Los Angeles and New York, their parents, and engineering professionals. The design is grounded in motivation theory and is intended to foster participants' intrinsic motivation and self-direction while the comprehensive design takes into account the cultural, social, and intellectual needs of diverse families. The science activities are provided in a series of Family Science Workshops which take place in afterschool programs in eight partner schools in Los Angeles and at the New York Hall of Science in New York City. The FSWs are taught by undergraduate and graduate engineering students with support from practicing engineers who serve as mentors. The primary project deliverable is a five-year longitudinal evaluation designed to assess (1) the impact of intensive training for engineering professionals who deliver family science activities in community settings and (2) families' interest in and understanding of science. Additional project deliverables include a 16-week training program for engineering professionals, 20 physics-based workshops and lesson plans, Family Science Workshops (40 in LA and 5 in NY), a Parent Leadership Program and social networking site, and 5 science training videos. This project will reach nearly one thousand students, parents, and student engineers. The multi-method evaluation will be conducted by the Center for Children and Technology at the Education Development Center. The evaluation questions are as follows: Are activities such as recruitment, training, and FSWs aligned with the project's goals? What is the impact on families' interest in and understanding of science? What is the impact on engineers' communication skills and perspectives about their work? Is the project scalable and able to produce effective technology tools and develop long-term partnerships with schools? Stage 1 begins with the creation of a logic model by stakeholders and the collection of baseline data on families' STEM experiences and knowledge. Stage 2 includes the collection of formative evaluation data over four years on recruitment, training, co-teaching by informal educators, curriculum development, FSWs, and Parent Leadership Program implementation. Finally, a summative evaluation addresses how well the project met the goals associated with improving families' understanding of science, family involvement, social networking, longitudinal impact, and scalability. A comprehensive dissemination plan extends the project's broader impacts in the museum, engineering, evaluation, and education professional communities through publications, conference presentations, as well as web 2.0 tools such as blogs, YouTube, an online social networking forum for parents, and websites. 'Be a Scientist!' advances the field through the development and evaluation of a model for sustained STEM learning experiences that helps informal science education organizations broaden participation, foster collaborations between universities and informal science education organizations, increase STEM-based social capital in underserved communities, identify factors that develop sustained interest in STEM, and empower parents to co-invest and sustain a STEM program in their communities.