Summative evaluation study for the Space Earth and Informal Science Education (SEISE) project examining professional impacts including project reach, partnerships, professional knowledge, and professionals' use of the project’s public-facing products and their implementation of practices for engaging the public
Over the course of the five-year NASA grant, the Space and Earth Informal STEM Education (SEISE) project offered a range of free professional development opportunities and resources to support informal educators’ ability to offer Earth and space programming and to partner with others
NASA's Universe of Learning provides resources and experiences that enable diverse audiences to explore fundamental questions in astronomy, experience how science is done, and discover the universe for themselves. Using its direct connection to science and science experts, NASA's Universe of Learning creates and delivers timely and authentic resources and experiences for youth, families, and lifelong learners. The goal is to strengthen science learning and literacy, and to enable learners to discover the universe for themselves in innovative, interactive ways that meet today's 21st century needs. The program includes astronomical data tools, multimedia resources, exhibits and community programs, and professional learning experiences for informal educators. It is developed through a unique partnership between the Space Telescope Science Institute, Caltech/IPAC, the Jet Propulsion Laboratory, the Smithsonian Astrophysical Observatory, and Sonoma State University.
DATE:
-
TEAM MEMBERS:
Denise SmithGordon SquiresKathy LestitionAnya BifernoLynn Cominsky
The Space and Earth Informal STEM Education (SEISE) project, led by the Arizona State University with partners Science Museum of Minnesota, Museum of Science, Boston, and the University of California Berkeley’s Lawrence Hall of Science and Space Sciences Laboratory, is raising the capacity of museums and informal science educators to engage the public in Heliophysics, Earth Science, Planetary Science, and Astrophysics, and their social dimensions through the National Informal STEM Education Network (NISE Net). SEISE will also partner on a network-to-network basis with other existing coalitions and professional associations dedicated to informal and lifelong STEM learning, including the Afterschool Alliance, National Girls Collaborative Project, NASA Museum Alliance, STAR_Net, and members of the Association of Children’s Museums and Association of Science-Technology Centers. The goals for this project include engaging multiple and diverse public audiences in STEM, improving the knowledge and skills of informal educators, and encouraging local partnerships.
In collaboration with the NASA Science Mission Directorate (SMD), SEISE is leveraging NASA subject matter experts (SMEs), SMD assets and data, and existing educational products and online portals to create compelling learning experiences that will be widely use to share the story, science, and adventure of NASA’s scientific explorations of planet Earth, our solar system, and the universe beyond. Collaborative goals include enabling STEM education, improving U.S. scientific literacy, advancing national educational goals, and leveraging science activities through partnerships. Efforts will focus on providing opportunities for learners explore and build skills in the core science and engineering content, skills, and processes related to Earth and space sciences. SEISE is creating hands-on activity toolkits (250-350 toolkits per year over four years), small footprint exhibitions (50 identical copies), and professional development opportunities (including online workshops).
Evaluation for the project will include front-end and formative data to inform the development of products and help with project decision gates, as well as summative data that will allow stakeholders to understand the project’s reach and outcomes.
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
Informal learning opportunities are increasingly being recognized as important for youth participation in authentic experiences at the intersection of science, technology, engineering, and math (STEM) (Dorsen, Carlson, and Goodyear 2006). These experiences may involve specialized equipment and dedicated time for learners to gain familiarity with the relevant scientific and engineering practices (i.e., designing experiments on their own, struggling to make sense of data, learning from their own mistakes and the results of peers), which often go beyond the classroom. However, the educators who
DATE:
TEAM MEMBERS:
Kathryn WilliamsonSue Ann HeatherlyVivian HoetteEva Erdosne TothDavid Beer
Flying Higher will develop a permanent hands-on exhibit that conveys the fundamentals of flight, technology, materials science, and NASA’s role in aeronautics for learners ages 3-12 years and their parents/caregivers and teachers. The exhibit, public programs, school and teacher programs, and teacher professional development will develop a pipeline of skilled workers to support community workforce needs and communicate NASA’s contributions to the nation and world. An innovative partnership with Claflin University (an historically black college) and Columbia College (a women’s liberal arts college) will provide undergraduate coursework in informal science education to support pre-service learning opportunities and paid employment for students seeking careers in education and/or STEM fields. The projects goals are:
1) To educate multi-generational family audiences about the principles and the future of aeronautics; provide hands-on, accessible, and immersive opportunities to explore state-of-the-art NASA technology; and demonstrate the cultural impact of flight in our global community.
2) To provide educational standards-based programming to teachers and students in grades K–8 on NASA-driven research topics, giving the students opportunities to explore these topics and gain exposure to science careers at NASA; and to offer teachers support in presenting STEM topics.
3) To create and implement a professional development program to engage pre-service teachers in presenting museum-based programs focused on aeronautics and engineering. This program will provide undergraduate degree credits, service learning, and paid employment to students that supports STEM instruction in the classroom, explores the benefits of informal science education, and encourages post-graduate opportunities in STEM fields.
Our Place in Space (OPIS), an inquiry-based curriculum in space science, observation, and exploration for middle school teachers, will be developed by the Museum of Science and Industry (MSI) Chicago, through a committed partnership with the Advanced Concepts Office in NASA's Marshall Space Flight Center (MSFC) and with endorsement from the Chicago Public Schools. The goals are to:
Design, test, and deliver OPIS curricula for a year-long course at MSI for science teachers (grades 4-8) that focuses on space observations and explorations using NASA assets and inquiry processes that combine informal learning traditions with the rigor of national and state education standards for middle school science;
Facilitate teachers' use of NASA's digital media and visualization technologies;
Modify and disseminate OPIS curriculum to 248 out-of-school program leaders and 10,440 youth at community sites affiliated with MSI’s Science Minors Clubs located throughout northeastern Illinois and northwestern Indiana.
The MSFC Advanced Concepts Office will coordinate the participation of MSFC scientists who will ensure accuracy of content, keep the curriculum up to date with emerging technologies and discoveries, and mentor OPIS teachers and Science Minors Clubs’ leaders through NASA's Digital Learning Network. The OPIS curriculum is aligned with Next Generation Science Standards, and will enable teachers to integrate instruction in the fundamental principles of space science with cross-cutting concepts while also presenting engineering and design challenges that exercise students' inventiveness, critical thinking, and problem-solving skills. Design challenges in OPIS encourage teachers and their students to wrestle with the same engineering problems that intrigue NASA scientists themselves.
The University of Chicago's Yerkes Observatory, the National Radio Astronomy Observatory, the University of North Carolina, the Astronomical Society of the Pacific, and 4-H are collaborating to provide professional development to 180 4-H leaders and other informal science educators, and engage 1,400 middle school youth in using research-grade robotic telescopes and data analysis tools to explore the Universe. Youth participating in 4H-based out-of-school programs in Wisconsin, West Virginia and North Carolina are learning about the universe and preparing for STEM careers by conducting authentic astronomy research, completing astronomy-related hands-on modeling activities, interacting with astronomers and other professionals who are part of the Skynet Robotic Telescope Network, and interacting with other youth who part of the Skynet Junior Scholars virtual community. The project is innovative because it is providing a diverse community of 4-H youth (including sight- and hearing-challenged youth and those from underrepresented groups) with opportunities to use high-quality, remotely located, Internet-controlled telescopes to explore the heavens by surveying galaxies, tracking asteroids, monitoring variable stars, and learn about the nature and methods of science. Deliverables include (1) online access to optical and radio telescopes, data analysis tools, and professional astronomers, (2) an age-appropriate web-based interface for controlling remote telescopes, (3) inquiry-based standards-aligned instructional modules, (4) face-to-face and online professional development for 4-H leaders and informal science educators, (5) programming for youth in out-of-school clubs and clubs, (6) evaluation findings on the impacts of program activities on participants, and (7) research findings on how web-based interactions between youth and scientists can promote student interest in and preparedness for STEM careers. The evaluation plan is measuring the effectiveness of program activities in (1) increasing youths' knowledge, skills, interest, self-efficacy, and identity in science, including youth who are sight- and hearing-impaired, (2) increasing educators' competency in implementing inquiry-based instruction and their ability to interact with scientists, and (3) increasing the number of Skynet scientists who are involved in education and public outreach.
The National Science Festival Network project, also operating as the Science Festival Alliance, is designed to create a sustainable national network of science festivals that engages all facets of the general public in science learning. Science Festivals, clearly distinct from "science fairs", are community-wide activities engaging professional scientists and informal and K-12 educators targeting underrepresented segments of local communities historically underserved by formal or informal STEM educational activities. The initiative builds on previous work in other parts of the world (e.g. Europe, Australasia) and on recent efforts in the U.S. to create science festivals. The target audiences are families, children and youth ages 5-18, adults, professional scientists and educators in K-12 and informal science institutions, and underserved and underrepresented communities. Project partners include the MIT Museum in Cambridge, UC San Diego, UC San Francisco, and the Franklin Institute in Philadelphia. The deliverables include annual science festivals in these four cities supported by year-round related activities for K-12 and informal audiences, a partnership network, a web portal, and two national conferences. Ten science festivals will be convened in total over the 3 years of the project, each reaching 15,000 to 60,000 participants per year. STEM content includes earth and space science, oceanography, biological/biomedical science, bioinformatics, and computer, behavioral, aeronautical, nanotechnology, environmental, and nuclear science. An independent evaluator will systematically assess audience participation and perceptions, level/types of science interest stimulated in target groups, growth of partnering support at individual sites, and increasing interactions between ISE and formal K-12 education. A variety of qualitative and quantitative assessments will be designed and utilized. The project has the potential to transform public communication and understanding of science and increase the numbers of youth interested in pursuing science.
DATE:
-
TEAM MEMBERS:
Loren ThompsonJeremy BabendureBen Wiehe
This evaluation reports on the Mission: Solar System project, a 2-year project funded by NASA. The goal of the Mission: Solar System was to create a collection of resources that integrates digital media with hands-on science and engineering activities to support kids’ exploration in formal and informal education settings. Our goal in creating the resources were: For youth: (1) Provide opportunities to use science, technology, engineering, and math to solve challenges related to exploring our solar system, (2) Build and hone critical thinking, problem-solving, and design process skills, (3)
Based on the premise that one component of NASA's pre-college education program is intended to support and enact school reform, the Committee for the Evaluation and Review of NASA's Pre-College Education Program requested an analysis of how the NASA Explorer School (NES) Model aligns with other national models of school-wide improvement and reform. The purpose and focus of this paper is to summarize key elements of major school improvement and reform models as well as specific content reform models from the literature, and to analyze the extent to which there is alignment between these models