NOVA Wonders is a multi-platform media project from the producers of NOVA exploring the biggest questions on the frontiers of science. From the mysteries of astrophysics to the secrets of the body to the challenges of inventing technologies that could rival—and even surpass—the abilities of the human mind. With content delivered across broadcast, digital and social platforms, the project’s total video content was viewed approximately 17 million times, reaching a range of audiences. The centerpiece was a six-part PBS series which premiered on April 25, 2018, hosted by a team of young
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This project, conducted by the University of Pittsburgh and the University of California, Berkeley, seeks to discover what makes middle school students engaged in science, technology, engineering, and mathematics (STEM). The researchers have developed a concept known as science learning activation, including dispositions, practices, and knowledge leading to successful STEM learning and engagement. The project is intended to develop and validate a method of measuring science learning activation.
The first stage of the project involves developing the questions to measure science activation, with up to 300 8th graders participating. The second stage is a 16-month longitudinal study of approximately 500 6th and 8th graders, examining how science learning activation changes over time. The key question is what are the influencers on science activation, e.g., student background, classroom activities, and outside activities.
This project addresses important past research showing that middle school interest in STEM is predictive of actually completing a STEM degree, suggesting that experiences in middle school and even earlier may be crucial to developing interest in STEM. This research goes beyond past work to find out what are the factors leading to STEM interest in middle school.
This work helps the Education and Human Resources directorate, and the Division of Research on Learning, pursue the mission of supporting STEM education research. In particular, this project focuses on improving STEM learning, as well as broadening participation in STEM education and ultimately the STEM workforce.
Zoo and Aquarium Research Collaborative (ZAARC) is a NSF-funded research project by TERC and Oregon State University (co-PI’s Andee Rubin and John Falk) that is exploring a collaborative model for action research as a form of professional development for zoo and aquarium educators. Over the past three years, ZAARC has engaged education staff from six zoos and aquariums from across the country in learning about and conducting action research pertinent to their institutions. Dr. Cynthia Char of Char Associates, an independent consulting firm specializing in program evaluation, has been a member
In late 2012, Providence Children’s Museum began a major three-year research project in collaboration with The Causality and Mind Lab at Brown University, funded by a grant from the National Science Foundation (1223777). Researchers at Brown examined how children develop scientific thinking skills and understand their own learning processes. The Museum examined what caregivers and informal educators understand about learning through play in its exhibits and how to support children’s metacognition – the ability to notice and reflect on their own thinking – and adults’ awareness and appreciation of kids’ thinking and learning through play. Drawing from fields like developmental psychology, informal education and museum visitor studies, the Museum’s exhibits team looked for indicators of children’s learning through play and interviewed parents and caregivers about what they noticed children doing in the exhibits, asking them to reflect on their children’s thinking. Based on the findings, the research team developed and tested new tools and activities to encourage caregivers to notice and appreciate the learning that takes place through play.
The independent evaluation firm Multimedia Research conducted an evaluation of the television component of SciGirls Season Two, including an experimental study of the impact of the TV series on girls' abilities to take part in science and engineering projects.2 During the same period, the independent evaluation team from Knight Williams Inc. conducted an evaluation of the implementation of the outreach activities among the member institutions of the National Girls Collaborative Project (NGCP) network.
While some public works are monumental civil engineering structures like the Eiffel Tower or the Sydney Harbour Bridge, most are commonplace, even invisible, and they are taken for granted. The reason for existence of public works is to provide basic services, but both large and small infrastructure facilities also present opportunities to engage the public in understanding fundamental concepts of Science, Technology, Engineering, and Mathematics (STEM). We review here lessons learned in the National Science Foundation-funded Golden Gate Bridge Outdoor Exhibition project. Using the title of
The Complex Adaptive Systems as a Model for Network Evaluations (CASNET) study was a four-year research project investigating evaluation capacity building (ECB) within a network using a complexity theory lens. The study used a case study approach to examine and understand evaluation capacity building within the Nanoscale Informal Science Education Network (NISE Net). NISE Net is a national community of researchers and informal science educators dedicated to fostering public awareness, engagement, and understanding of nanoscale science, engineering, and technology. Instituted in 2005 through NSF funding (DRL-0532536 and 0940143), NISE Net has continuously expanded and is currently comprised of close to 600 science museum and university partners. The intent of the CASNET project was to provide insights on (1) the implications of complexity theory for promoting widespread and systemic use of evaluation within a network, and (2) complex system conditions that foster or impede ECB within a network, i.e., in this case, within the NISE Net.
The Wildlife Conservation Society and Good Shepherd Services (a youth development and education agency) are implementing and evaluating a school-to-career model program that consists of afterschool and weekend programming for high school students at four New York City area zoos and an aquarium, followed by post-participation tracking, support, and mentoring. The goal is to promote affective, cognitive and behavioral outcomes among 150 low-income minority youth necessary to pursue careers in the wildlife sciences.
The Bridging the Gap project is (1) developing a science career program that includes hands-on, technology-enriched, science learning experiences at zoos/aquaria; career building services, mentoring, and long-term tracking and support, (2) forming a community of minority students who have the knowledge and skills to pursue wildlife careers, (3) generating research findings on the short-term and long-term effectiveness of the program, and (4) disseminating information about the project's resources and findings to other informal science education institutions around the nation for replication. The evaluation plan measures a variety of outputs, outcomes and impacts that include short-term and long-term cognitive and affective variables. Data collection methods include student activity monitoring and pre-post testing.
The project addresses a compelling personnel issue documented by the American Zoo and Aquarium Association - the small number of minority science professionals working in zoos and aquariums. Because few programs currently exist to help minority students enter the wildlife science professions, this project fills an important programmatic need and serves as a model workforce program that can be replicated by other informal science education organizations around the country. The project's key strategic impact is its capacity to broaden participation in the wildlife sciences by expanding the science professional pipeline beginning in high school.
DATE:
-
TEAM MEMBERS:
Karen TingleyChanda BennettDon LisowyBrian JohnsonEmily StoethCourtney Wiggins
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
Creating Museum Media for Everyone is an NSF-funded collaborative project of the Museum of Science, the WGBH National Center for Accessible Media, Ideum, and Audience Viewpoints, to further the science museum field's understanding of ways to research, develop, and evaluate digital interactives that are inclusive of all people. As a part of this effort to enable museums to integrate more accessible media into their exhibits to make them more welcoming and educational for visitors with disabilities as well as general audiences, this paper provides an overview of approaches to media accessibility