EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
resourceprojectProfessional Development, Conferences, and Networks
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
The STAR Library Education Network: a hands-on learning program for libraries and their communities, (STAR_Net for short) is led by the National Center for Interactive Learning (NCIL) at the Space Science Institute (PI: Paul Dusenbery). STAR stands for Science-Technology, Activities and Resources. Team members include NCIL staff, the American Library Association (ALA), Lunar and Planetary Institute (LPI), and the National Girls Collaborative Project (NGCP). STAR_Net is developing two comprehensive, informal education programs: Discover Earth and Discover Tech. The project also includes a comprehensive evaluation plan and a research component that explores how public libraries can serve as a STEM learning center in rural, underserved communities. STAR_Net is supported through a grant from the National Science Foundation. The STAR_Net project includes two traveling library exhibits: Discover Earth: A Century of Change and Discover Tech: Engineers Make a World of Difference. The Discover Earth exhibition features interactive, multimedia displays that allow exhibit visitors to interact with digital information in a dynamic way, encouraging new perspectives on our planet. Discover Tech introduces the many extraordinary ways that engineers solve problems to help people and societies around the world. Similar to a science center experience, visitors and families will be able to explore and tinker with their own engineering solutions. A number of STEM activities and resources will be developed by project staff and by other organizations to help librarians and community partners offer a wide variety of programs for their patrons. Besides the traveling exhibits and programs, STAR_Net also includes library staff training (online and in-person) and a Community of Practice (CoP) for librarians (including non-host librarians) to interact and partner with STEM professionals and organizations. NCI's Kate Haley Goldman and staff from Evaluation and Research Associates are conducting the project's evaluation.
The Ross Sea Project was a Broader Impact projects for an NSF sponsored research mission to the Ross Sea in Antarctica. The project, which began in the summer of 2010 and ended in May 2011, consisted of several components: (1) A multidisciplinary teacher-education team that included educators, scientists, Web 2.0 technology experts and storytellers, and a photographer/writer blogging team; (2) Twenty-five middle-school and high-school earth science teachers, mostly from New Jersey but also New York and California; (3) Weeklong summer teacher institute at Liberty Science Center (LSC) where teachers and scientists met, and teachers learned about questions to be investigated and technologies to be used during the mission, and how to do the science to be conducted in Antarctica; (4) COSEE NOW interactive community website where teachers, LSC staff and other COSEE NOW members shared lesson plans or activities and discussed issues related to implementing the mission-based science in their classrooms; (5) Technological support and consultations for teachers, plus online practice sessions on the use of Web 2.0 technologies (webinars, blogs, digital storytelling, etc.); (6)Daily shipboard blog from the Ross Sea created by Chris Linder and Hugh Powell (a professional photographer/writer team) and posted on the COSEE NOW website to keep teachers and students up-to-date in real-time on science experiments, discoveries and frustrations, as well as shipboard life; (7) Live webinar calls from the Ross Sea, facilitated by Rutgers and LSC staff, where students posed questions and interacted directly with shipboard researchers and staff; and (8) A follow-up gathering of teachers and scientists near the end of the school year to debrief on the mission and preliminary findings. What resulted from this project was not only the professional development of teachers, which extended into the classroom and to students, but also the development of a relationship that teachers and students felt they had with the scientists and the science. Via personal and virtual interactions, teachers and students connected to scientists personally, while engaged in the science process in the classroom and in the field.
This document evaluates a meeting held by the New Mexico ISE Network (NM ISE Net) to link research and informal education institutions with one another to build capacity for informal science education.
This is a Broad Implementation proposal. Our goal is to create a vibrant, sustained community of practice around the established Café Scientifique New Mexico model for engaging high school teens in science, technology, engineering and math; scale-up will be accomplished via a national network of committed partners. The adult Cafe Scientifique model for engaging citizens in science has proven very effective and has been implemented widely. The interaction in a social setting with a scientist-presenter around a hot science topic is the key to the model’s success. With ISE funding, the model has been adapted by Science Education Solutions for the high school teen audience. Cafe Scientifique New Mexico, now starting its fifth year, has had documented success in providing teens with increased STEM literacy and a more realistic picture of scientists as real people leading interesting lives. Teens come to better understand the nature of science and are more likely to see the relevance of science to their lives. Scientists express strong satisfaction with the nature of our coaching and the resulting quality of their science communication. The program has been continually evaluated and improved, and is now ready for broad implementation. Intellectual Merit: Teenagers are the adult citizens and workforce of tomorrow. Teens are reaching a critical life juncture and are making choices that affect their future life style, life-long learning behaviors, and careers. Yet they are increasingly dropping out of the STEM pipeline in school. Even teens interested in STEM often know little about science and engineering careers and the nature of scientific research. Teen Cafés can play an important role in addressing these challenges. We have two major objectives: 1. Implement the Café Scientifique model of Teen Cafés in a national network of sites committed to adopting and adapting the program and validating its impacts with diverse audiences; and 2. Create a vibrant and sustainable community of practice comprised of ISE and STEM professionals interested in engaging teens in STEM through Teen Cafés. We have formed a core network of six initial partners: Southern Illinois University Edwardsville, Center for STEM Research, Education, and Outreach; The Florida Teen SciCafé Partnership; North Carolina Museum of Natural Sciences, Raleigh; Science Discovery, University of Colorado; The Pacific Science Center in Seattle; and The Missouri AfterSchool Network (MASN) – Project LIFTOF. We will add two more core partners in Year 3. The core partners will join the Teen Cafe Network in a staged fashion in years 1 - 3. Each will reach sustainability over a three-year funding period. Each node has a local area network of partners consisting of organizations that will host local Cafes; scientific organizations with potential presenters; schools and other organizations for recruiting teens; and entities capable of contributing to financial sustainability. The network will provide a structure for a dynamic, growing, and sustainable community of practice to implement the Teen Café model, in which high school teens will gain skills in scientific discourse, thought, and exploration. STEM professionals will gain improved skills for communicating with public audiences and a new perspective on their research from a broader societal perspective. ISE professionals will gain capacity to adapt, implement, test, and further disseminate the Teen Café model and increased capability for preparing STEM experts to communicate effectively with teen audiences, along with tools, resources, and expertise to help them do so. Science Education Solutions will manage the project and provide the resources to support the community of practice, while continuing Cafe Scientifique New Mexico as a ninth network node. We will stimulate intensive ongoing communication of lessons learned across the network as partners start up their Cafe programs; external observers will be able to watch the program unfold. Broader Impacts: We will build capacity for serving teens and effective communication of science in the broad ISE and STEM communities by encouraging and nurturing others wishing to start a Cafe program and join the network. We have partnered with 10 large science and science education organizations, each with its own extensive network, which will allow us to further propagate the Teen Cafe Network. They are: National Ecological Observatory Network (NEON). Nanoscale Informal Science Education Network (NISE Net), The American Institute of Physics (AIP), Science Cafés.org (to include NOVA), Science Festival Alliance, Consortium of Universities for the Advancement of Hydrologic Science (CUAHSI), Informalscience.org, Project Liftoff: Elevating Science Afterschool, ITEST Learning Resource Center, and The Center for Multiscale Modeling of Atmospheric Processes (CMMAP). Each partner will also target underserved and diverse teen audiences for their programs.
Science museums play a role in creating visitor experiences that relate to contemporary issues in science, and in linking audiences to the scientific enterprise and the community of scientists. In the Portal to the Public approach, science researchers are trained by museum educators with experience in inquiry-based learning, and are then given opportunities to translate their current research for museum audiences. Portal to the Public offers one solution to museums seeking to sustain a commitment to delivering experiences that reflect the dynamic pace of research, and the need to connect local
The analysis contained in this report was prepared for the CAISE Convening on Broader Impacts & ISE. The report summarizes interviews with researchers in STEM subjects who were asked about: 1) their perceptions about broader impacts, 2) the planning and process that researchers undertake for broader impacts activities, 3) the resources and supports that currently exist and that researchers would like to exist for broader impacts activities, and 4) how the informal science education field might "market" itself as a potential place to find partners or venues for doing broader impacts activities
The Global Soundscapes! Big Data, Big Screens, Open Ears Project uses the new science of soundscape ecology to design a variety of informal science learning experiences that engage participants through acoustic discovery Soundscape ecology is an interdisciplinary science that studies how humans relate to place through sound and how humans influence the environment through the alteration of natural sound composition. The project includes: (1) an interface to the NSF-funded Global Sustainable Soundscapes Network, which includes 12 universities around the world; (2) sound-based learning experiences targeting middle-school students (grades 5-8), visually impaired and urban students, and the general public; and (3) professional development for informal science educators. Project educational components include: the first interactive, sound-based digital theater experience; hands-on Your Ecosystem Listening Labs (YELLS), a 1-2 day program for school classes and out-of school groups; a soundscape database that will assist researchers in developing a soundscape Big Database; and iListen, a virtual online portal for learning and discovery about soundscape. The project team includes Purdue-based researchers involved in soundscape and other ecological research; Foxfire Interactive, an award-winning educational media company; science museum partners with digital theaters; the National Audubon Society and its national network of field stations; the Perkins School for the Blind; and Multimedia Research (as the external evaluator).
The Climate Interpretation Coalition is maturing beyond a set of discrete institutions to become a collective voice for communicating climate change and the ocean. As the three‐year funded NOAA program and the empowerment evaluation end, the question of how to build ongoing communities of support arises. The findings are based upon an interview‐based exploration of individuals who participated in the 2012 Baltimore summit and who represent a broad spectrum of engagement (highly engaged with creating the coalition through to limited engagement in a single summit). The interviews were nested