The Museum of Science will launch the "Collaboration for Ongoing Visitor Experience Studies" (COVES) project to construct an infrastructure for collaboration, which will unite science centers across the country in the systematic collection, analysis, and reporting of visitor experience data. The COVES program will develop common instruments for studying visitors in science museums and provide staff training on how to use these instruments and how to make sense of findings. The collaborative effort will enable participating science centers to become data-driven organizations focused on their audiences and will allow museums to learn from one another.
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
Zoo and Aquarium Research Collaborative (ZAARC) is a NSF-funded research project by TERC and Oregon State University (co-PI’s Andee Rubin and John Falk) that is exploring a collaborative model for action research as a form of professional development for zoo and aquarium educators. Over the past three years, ZAARC has engaged education staff from six zoos and aquariums from across the country in learning about and conducting action research pertinent to their institutions. Dr. Cynthia Char of Char Associates, an independent consulting firm specializing in program evaluation, has been a member
This is the fourth volume of the annual proceedings for the Games+Learning+Society (GLS). The GLS conference is a premier event for those from both academia and industry interested in videogames and learning. The GLS conference is one of the few destinations where the people who create high-quality digital learning media can gather for a serious think about what is happening in the field and how the field can serve the public interest. The conference offers an opportunity for in-depth conversation and social networking across diverse disciplines including game studies, education research
DATE:
TEAM MEMBERS:
Amanda OchsnerJeremy DietmeierCaroline WilliamsConstance Steinkuehler
This is the third volume of the annual proceedings for the Games+Learning+Society (GLS). The GLS conference is a premier event for those from both academia and industry interested in videogames and learning. The GLS conference is one of the few destinations where the people who create high-quality digital learning media can gather for a serious think about what is happening in the field and how the field can serve the public interest. The conference offers an opportunity for in-depth conversation and social networking across diverse disciplines including game studies, education research
DATE:
TEAM MEMBERS:
Caroline WilliamsAmanda OchsnerJeremy DietmeierConstance Steinkuehler
The independent evaluation firm Multimedia Research conducted an evaluation of the television component of SciGirls Season Two, including an experimental study of the impact of the TV series on girls' abilities to take part in science and engineering projects.2 During the same period, the independent evaluation team from Knight Williams Inc. conducted an evaluation of the implementation of the outreach activities among the member institutions of the National Girls Collaborative Project (NGCP) network.
While some public works are monumental civil engineering structures like the Eiffel Tower or the Sydney Harbour Bridge, most are commonplace, even invisible, and they are taken for granted. The reason for existence of public works is to provide basic services, but both large and small infrastructure facilities also present opportunities to engage the public in understanding fundamental concepts of Science, Technology, Engineering, and Mathematics (STEM). We review here lessons learned in the National Science Foundation-funded Golden Gate Bridge Outdoor Exhibition project. Using the title of
The Complex Adaptive Systems as a Model for Network Evaluations (CASNET) study was a four-year research project investigating evaluation capacity building (ECB) within a network using a complexity theory lens. The study used a case study approach to examine and understand evaluation capacity building within the Nanoscale Informal Science Education Network (NISE Net). NISE Net is a national community of researchers and informal science educators dedicated to fostering public awareness, engagement, and understanding of nanoscale science, engineering, and technology. Instituted in 2005 through NSF funding (DRL-0532536 and 0940143), NISE Net has continuously expanded and is currently comprised of close to 600 science museum and university partners. The intent of the CASNET project was to provide insights on (1) the implications of complexity theory for promoting widespread and systemic use of evaluation within a network, and (2) complex system conditions that foster or impede ECB within a network, i.e., in this case, within the NISE Net.
Design-based research (DBR) is used to study learning in environments that are designed and systematically changed by the researcher. DBR is not a fixed “cookbook” method; it is a collection of approaches that involve a commitment to studying activity in naturalistic settings, many of which are designed and systematically changed by the researcher, with the goal of advancing theory at the same time directly impacting practice. The goal of DBR (sometimes also referred to as design experiments) is to use the close study of learning as it unfolds within a naturalistic context that contains
DATE:
TEAM MEMBERS:
Sasha Barab
resourceresearchProfessional Development, Conferences, and Networks
Design research is strongly associated with the learning sciences community, and in the 2 decades since its conception it has become broadly accepted. Yet within and without the learning sciences there remains confusion about how to do design research, with most scholarship on the approach describing what it is rather than how to do it. This article describes a technique for mapping conjectures through a learning environment design, distinguishing conjectures about how the design should function from theoretical conjectures that explain how that function produces intended outcomes.
Even in the best-resourced science communication institutions, poor quality evaluation methods are routinely employed. This leads to questionable data, specious conclusions and stunted growth in the quality and effectiveness of science communication practice. Good impact evaluation requires upstream planning, clear objectives from practitioners, relevant research skills and a commitment to improving practice based on evaluation evidence.