The Center for the Advancement of Informal Science Education (CAISE) is mid-way through year five of a five-year cooperative agreement with the National Science Foundation. The NSF funded CAISE in 2007 in order to serve as a resource center to the informal science education (ISE) program, its grantees, and the larger ISE field. Inverness Research has served as the external evaluator for the past five years, documenting the development of CAISE, and the quality and value of its work to key audiences and stakeholders.
This report is a reflection on the progress of CAISE that draws upon our
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
This is the first volume of the annual proceedings for the Games+Learning+Society (GLS). The GLS conference is a premier event for those from both academia and industry interested in videogames and learning. The GLS conference is one of the few destinations where the people who create high-quality digital learning media can gather for a serious think about what is happening in the field and how the field can serve the public interest. The conference offers an opportunity for in-depth conversation and social networking across diverse disciplines including game studies, education research
DATE:
TEAM MEMBERS:
Constance SteinkuehlerCrystle MartinAmanda Ochsner
Living Liquid will identify strategies for creating visualization tools that can actively engage the public with emerging research about the ocean's microbes and their impact on our planet. It addresses a critical issue for the ISE field: creating ways for visitors to ask and answer their own questions about emerging areas of science with visualizations. This Pathway project will provide important lessons learned for a future full-scale development project at the Exploratorium's new location over San Francisco Bay, and for informal science educators and other professionals working to create interactive visualization tools using the vast data sets now available. Living Liquid is a collaboration between developers, educators and learning researchers at the Exploratorium, computer scientists at the Visualization Interface and Design Innovation Group at UC Davis, and marine scientists at the Center for Microbial Oceanography Research and Education. The project's research and development process includes a front-end study of visitors' interests and prior knowledge related to ocean microbes, interviews with scientists to identify potential datasets and activities, a survey of candidate visualizations, and a series of prototypes to identify promising strategies to engage visitors with and allow visitors to explore large scientific datasets through visualization tools.
'Be a Scientist!' is a full-scale development project that examines the impact of a scalable, STEM afterschool program which trains engineers to develop and teach inquiry-based Family Science Workshops (FSWs) in underserved communities. This project builds on three years of FSWs which demonstrate improvements in participants' science interest, knowledge, and self-efficacy and tests the model for scale, breadth, and depth. The project partners include the Viterbi School of Engineering at the University of Southern California, the Albert Nerken Engineering Department at the Cooper Union, the Los Angeles Museum of Natural History, and the New York Hall of Science. The content emphasis is physics and engineering and includes topics such as aerodynamics, animal locomotion, automotive engineering, biomechanics, computer architecture, optics, sensors, and transformers. The project targets underserved youth in grades 1-5 in Los Angeles and New York, their parents, and engineering professionals. The design is grounded in motivation theory and is intended to foster participants' intrinsic motivation and self-direction while the comprehensive design takes into account the cultural, social, and intellectual needs of diverse families. The science activities are provided in a series of Family Science Workshops which take place in afterschool programs in eight partner schools in Los Angeles and at the New York Hall of Science in New York City. The FSWs are taught by undergraduate and graduate engineering students with support from practicing engineers who serve as mentors. The primary project deliverable is a five-year longitudinal evaluation designed to assess (1) the impact of intensive training for engineering professionals who deliver family science activities in community settings and (2) families' interest in and understanding of science. Additional project deliverables include a 16-week training program for engineering professionals, 20 physics-based workshops and lesson plans, Family Science Workshops (40 in LA and 5 in NY), a Parent Leadership Program and social networking site, and 5 science training videos. This project will reach nearly one thousand students, parents, and student engineers. The multi-method evaluation will be conducted by the Center for Children and Technology at the Education Development Center. The evaluation questions are as follows: Are activities such as recruitment, training, and FSWs aligned with the project's goals? What is the impact on families' interest in and understanding of science? What is the impact on engineers' communication skills and perspectives about their work? Is the project scalable and able to produce effective technology tools and develop long-term partnerships with schools? Stage 1 begins with the creation of a logic model by stakeholders and the collection of baseline data on families' STEM experiences and knowledge. Stage 2 includes the collection of formative evaluation data over four years on recruitment, training, co-teaching by informal educators, curriculum development, FSWs, and Parent Leadership Program implementation. Finally, a summative evaluation addresses how well the project met the goals associated with improving families' understanding of science, family involvement, social networking, longitudinal impact, and scalability. A comprehensive dissemination plan extends the project's broader impacts in the museum, engineering, evaluation, and education professional communities through publications, conference presentations, as well as web 2.0 tools such as blogs, YouTube, an online social networking forum for parents, and websites. 'Be a Scientist!' advances the field through the development and evaluation of a model for sustained STEM learning experiences that helps informal science education organizations broaden participation, foster collaborations between universities and informal science education organizations, increase STEM-based social capital in underserved communities, identify factors that develop sustained interest in STEM, and empower parents to co-invest and sustain a STEM program in their communities.
In spring 2009, the Denver Museum of Nature & Science (Museum) contracted with JVA Consulting, LLC (JVA) to conduct a comprehensive process and outcome evaluation of the Passport to Health (P2H) program. The Museum designed P2H, originally a three-year program funded by the Colorado Health Foundation (the Foundation), to improve health outcomes for fifth-grade students as well as their families and teachers throughout the Denver metro area. Appendix includes survey.
DATE:
TEAM MEMBERS:
JVA Consulting, LLC
resourceprojectProfessional Development, Conferences, and Networks
The Coalition for Science After School (CSAS) was established in 2004 in response to the growing need for more STEM (science, technology, engineering, and mathematics) learning opportunities in out-of-school time. CSAS sought to build this field by uniting STEM education goals with out-of-school time opportunities and a focus on youth development. Over a decade of work, CSAS Steering Committee members, staff and partners advocated for STEM in out-of-school-time settings, convened leaders, and created resources to support this work. CSAS leadership decided to conclude CSAS operations in 2014, as the STEM in out-of-school time movement had experienced tremendous growth of programming and attention to science-related out-of-school time opportunities on a national level. In its ten-year strategic plan, CSAS took as its vision the full integration of the STEM education and out-of-school time communities to ensure that quality out-of-school time STEM opportunities became prevalent and available to learners nationwide. Key CSAS activities included: (1) Setting and advancing a collective agenda by working with members to identify gaps in the field, organizing others to create solutions that meet the needs, identifying policy needs in the field and supporting advocates to advance them; (2) Developing and linking committed communities by providing opportunities for focused networking and learning through conferences, webinars, and other outreach activities; and (3) Identifying, collecting, capturing, and sharing information and available research and resources in the field. The leadership of the Coalition for Science After School is deeply grateful to the funders, partners, supporters, and constituents that worked together to advance STEM in out-of-school time during the last decade, and that make up today's rich and varied STEM in out-of-school time landscape. We have much to be proud of, but as a movement there is much more work to be done. As this work continues to expand and deepen, it is appropriate for the Coalition for Science After School to step down as the many other organizations that have emerged over the last decade take on leadership for the critical work that remains to be done. A timeline and summary of CSAS activities, products, and accomplishments is available for download on this page. All resources noted in the narrative are also available for download below.
This website is set up to provide easy to use tips to design, implement and assess the quality of evaluations on programs and projects to improve the quality, quantity and diversity of the STEM workforce. However, most of the tips and other information can be of use to a broad range of researchers and evaluators and those who fund them.
DATE:
TEAM MEMBERS:
Science Museum of MinnesotaEric JollyPatricia CampbellTom Kibler
resourceresearchProfessional Development, Conferences, and Networks
In order for the United States to maintain the global leadership and competitiveness in science and technology that are critical to achieving national goals, we must invest in research, encourage innovation, and grow a strong and talented science and technology workforce. This book explores the role of diversity in the science, technology, engineering and mathematics (STEM) workforce and its value in keeping America innovative and competitive. According to the book, the U.S. labor market is projected to grow faster in science and engineering than in any other sector in the coming years, making
DATE:
TEAM MEMBERS:
National Research CouncilCommittee on Underrepresented Groups and the Expansion of the Science and Engineering Workforce PipelineCommittee on Science, Engineering, and Public Policy (COSEPUP)Policy and Global Affairs (PGA)National Academy of SciencesNational Academy of EngineeringInstitute of Medicine (IOM)
The Principal Investigator's Guide: Managing Evaluation in Informal STEM Education Projects (PI Guide) is designed to help principal investigators and other leaders of informal STEM (Science, Technology, Engineering, and Math) education projects integrate evaluation into all phases of project design, development, and implementation. Such projects include exhibits, media projects, websites, community science projects, afterschool programs, festivals, family activities, online games, citizen science projects, and other efforts to help people learn about science in the course of their everyday
Realizing the power of CyberLearning to transform education will require vision, strategy, and an engaged, talented community. Activities are needed to energize the community, refine and sharpen the path forward, and provide a more active and ongoing forum for clarifying the big ideas and challenging questions. In response to this need, SRI International, together with the Lawrence Hall of Science and with key support from the National Geographic Society, will organize a set of activities to advance a shared vision of the future of learning, encompassing the systems, people, and technology dimensions mutually necessary for any scalable and lasting advances in education. The innovative format for these activities is inspired by the TED talks, Wikipedia, and social networking. As in TED, a small set of leading researchers will be selected to give very short, very high quality, stimulating talks. These CyberLearning Talks will be featured at a 1-day summit meeting in Washington, DC, streamed so that local cyberlearning research communities may participate at a distance, and posted on a website. As in Wikipedia, CyberLearning Pages will be created, each page featuring a synopsis of a big idea in CyberLearning and the relevant research challenges. The 1-day conference will be followed by a small 1-day workshop focusing on how to evaluate cyberlearning efforts, identify progress, and identify important new directions. Finally, to disseminate and stimulate conversation about both the video talks and Wikipedia entries, a presence for the community will be created on social networking sites. The target outcomes of the effort will be (i) a cyberlearning research community with participants from across the many current constituent communities, and fostered awareness and appreciation of the broad range of expertise and interests across that wider community; (ii) foundations for sustained discussion of big ideas, insights, and challenges to help this new community define a more engaged, crisper vision of its own future, (iii) a community resource that can become a site for interconnecting stakeholders in the CyberLearning community and supporting investigators in improving field-generated proposals, and (iv) an emerging sense of direction for CyberLearning among a wider audience of leaders. Such community building and awareness is expected to foster collaborations that will lead to innovative and research-grounded ways of using technology to transform education -- formal and informal and across a lifetime.
This research study involves collaboration between researchers at the University of Maryland, College Park and Bowie State University, an HBCU, to examine a multi-component pre-service model for preparing minority students to teach upper elementary and middle level science. The treatment consists of (1) focused recruitment efforts by the collaborating universities; (2) a pre-service science content course emphasizing inquiry and the mathematics of data management; (3) an internship in an after school program serving minority students; (4) field placements in Prince Georges County minority-serving professional development schools; and (5) mentoring support during the induction year. The research agenda will examine each aspect of the intervention using quantitative and qualitative methods and a small number of case studies.
DATE:
-
TEAM MEMBERS:
James McginnisSpencer BensonScott Dantley