EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by producing empirical findings and/or research tools that contribute to knowledge about which models and interventions with K-12 students and teachers are most likely to increase capacity in the STEM and STEM cognate intensive workforce of the future.
The LinCT (Linking Educators, Youth, and Learners in Computational Thinking) project at the Science Museum of Minnesota (SMM) will engage female teachers-in-training and youth from underrepresented demographics in immersive technology experiences and STEM education. LinCT will guide teachers to develop their understanding and use of technology in the classroom, as well as prepare youth for a future where technology plays a key role in a wide range of professional opportunities. The project aims to inspire teachers and youth to see the possibilities of technological competencies, as well as why the incorporation of technology can build meaningful learning experiences and opportunities for all learners. The LinCT program model offers learning and application experiences for participating teachers and youth and provides an introduction of technological tools used in SMM educational programs and professional development on approaches for engaging all learners in STEM. Both groups will provide instruction in SMM technology-based Summer Camps, reaching 1,000 young people every year. In each following school year, project educators will develop and deliver technology-based programs to nearly 1,000 under-served and underrepresented elementary students. The project will allow teachers and youth to deliver exciting and engaging technology-based programs to nearly 4,000 diverse young learners. As a result, all participants in this project will be better equipped to incorporate technology in their future careers.
The LinCT project will investigate effective approaches for broadening the participation of underrepresented populations by providing female pre-service teachers and female youth with opportunities to lead programming at the Science Museum of Minnesota (SMM). Over three years, the LinCT project will employ 8-12 female teachers-in-training [Teacher Tech Cadres (TTC)] and 12-24 female youth [Youth Teaching Tech Crews (Y-TTC)] from demographics that are underrepresented in STEM fields. The integration of these groups will result in relationships fostered within an educational program, where all participants are learners and teachers, mentors and mentees. The results of this unique program model will be assessed through the experiences of this focused professional learning and teaching community. The LinCT research study will focus on three aspects of the project. First, it will seek to understand how the teachers-in-training and youth experience the project model's varied learning environments. Next, the study will explore how the TTC's and the Y-TTC's motivation, confidence, and self-efficacy with integrating technology across educational settings change because of the program. Finally, the study will seek to understand the lasting aspects of culture, training, and community building on SMM's internal teams and LinCT partner institutions (University of St. Catherine's National Center for STEM Elementary Education and Metropolitan State University's School of Urban Education).
Flying Higher will develop a permanent hands-on exhibit that conveys the fundamentals of flight, technology, materials science, and NASA’s role in aeronautics for learners ages 3-12 years and their parents/caregivers and teachers. The exhibit, public programs, school and teacher programs, and teacher professional development will develop a pipeline of skilled workers to support community workforce needs and communicate NASA’s contributions to the nation and world. An innovative partnership with Claflin University (an historically black college) and Columbia College (a women’s liberal arts college) will provide undergraduate coursework in informal science education to support pre-service learning opportunities and paid employment for students seeking careers in education and/or STEM fields. The projects goals are:
1) To educate multi-generational family audiences about the principles and the future of aeronautics; provide hands-on, accessible, and immersive opportunities to explore state-of-the-art NASA technology; and demonstrate the cultural impact of flight in our global community.
2) To provide educational standards-based programming to teachers and students in grades K–8 on NASA-driven research topics, giving the students opportunities to explore these topics and gain exposure to science careers at NASA; and to offer teachers support in presenting STEM topics.
3) To create and implement a professional development program to engage pre-service teachers in presenting museum-based programs focused on aeronautics and engineering. This program will provide undergraduate degree credits, service learning, and paid employment to students that supports STEM instruction in the classroom, explores the benefits of informal science education, and encourages post-graduate opportunities in STEM fields.
The number of Latinos and Native Americans represented in library and information science professions is extremely low. The University of Arizona School of Information Resources and Library Science will address this inequity in its Connected Learning in Digital Heritage Curation project, which focuses on archives and special collections, medical librarianship, and public librarianship. The project will educate 24 culturally competent master’s degree students to serve Latino and Native American communities in the digital world. Students will gain hands-on experience working as graduate assistants with project partners: the University of Arizona Libraries, Center for Creative Photography, Arizona Health Sciences Library, Pima County Public Library, Arizona Historical Society, Arizona State Museum, Labriola National American Indian Data Center, American Indian Film Gallery, Laboratory of Tree-Ring Research and the Arizona State Library, Archives and Public Records.
This University of Wisconsin System will conduct research to understand how the Madison Public Library (MPL) is building a production-oriented approach to literacy and learning through their maker-focused program, the Bubbler. On a national level, this project speaks to educational research communities, professionals, members of informal learning institutions, and organizers of designed makerspaces. At the local level, it addresses underserved populations in the Madison area and MPL in evaluating and developing the Bubbler. Findings will be shared through conference presentations, journal articles, and networks of library professionals.
DATE:
-
TEAM MEMBERS:
Rebekah Willett
resourceprojectProfessional Development, Conferences, and Networks
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The University of Chicago's Yerkes Observatory, the National Radio Astronomy Observatory, the University of North Carolina, the Astronomical Society of the Pacific, and 4-H are collaborating to provide professional development to 180 4-H leaders and other informal science educators, and engage 1,400 middle school youth in using research-grade robotic telescopes and data analysis tools to explore the Universe. Youth participating in 4H-based out-of-school programs in Wisconsin, West Virginia and North Carolina are learning about the universe and preparing for STEM careers by conducting authentic astronomy research, completing astronomy-related hands-on modeling activities, interacting with astronomers and other professionals who are part of the Skynet Robotic Telescope Network, and interacting with other youth who part of the Skynet Junior Scholars virtual community. The project is innovative because it is providing a diverse community of 4-H youth (including sight- and hearing-challenged youth and those from underrepresented groups) with opportunities to use high-quality, remotely located, Internet-controlled telescopes to explore the heavens by surveying galaxies, tracking asteroids, monitoring variable stars, and learn about the nature and methods of science. Deliverables include (1) online access to optical and radio telescopes, data analysis tools, and professional astronomers, (2) an age-appropriate web-based interface for controlling remote telescopes, (3) inquiry-based standards-aligned instructional modules, (4) face-to-face and online professional development for 4-H leaders and informal science educators, (5) programming for youth in out-of-school clubs and clubs, (6) evaluation findings on the impacts of program activities on participants, and (7) research findings on how web-based interactions between youth and scientists can promote student interest in and preparedness for STEM careers. The evaluation plan is measuring the effectiveness of program activities in (1) increasing youths' knowledge, skills, interest, self-efficacy, and identity in science, including youth who are sight- and hearing-impaired, (2) increasing educators' competency in implementing inquiry-based instruction and their ability to interact with scientists, and (3) increasing the number of Skynet scientists who are involved in education and public outreach.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
This evaluation reports on the Mission: Solar System project, a 2-year project funded by NASA. The goal of the Mission: Solar System was to create a collection of resources that integrates digital media with hands-on science and engineering activities to support kids’ exploration in formal and informal education settings. Our goal in creating the resources were: For youth: (1) Provide opportunities to use science, technology, engineering, and math to solve challenges related to exploring our solar system, (2) Build and hone critical thinking, problem-solving, and design process skills, (3)
Researchers and practitioners in the US and the UK, organized by Twin Cities Public Television in collaboration with co-PIs from Indiana University and the University of Bradford in the UK, will develop a research agenda focused on understanding how participation by youth in various online environments, called "affinity spaces," can promote and enable new approaches to informal STEM learning. Affinity spaces provide opportunities for youth to develop deep interest and engagement in specific topics as well as to interact in groups with others who share common interests. By focusing on affinity spaces, this Science Learning+ project will contribute to the collective understanding of how digital media supports STEM learning. Of particular interest is the potential of these spaces to offer multiple interest-driven trajectories, opportunities to learn with others, and paths toward becoming authentic participants in the discussions. Specifically, the collaborators will: (1) produce a literature review on affinity spaces and informal science learning; (2) organize and convene a two-day workshop to review and refine primary research questions; and (3) produce a white paper summarizing outcomes. Affinity spaces have the ability to connect millions of learners. Developing a research agenda to learn how these spaces can involve youth in experiences across the entire spectrum of STEM disciplines promises to reveal new ways to enhance and enrich the entire ecosystem of informal science learning. In addition, the project will enhance the international research and education infrastructure by facilitating collaborations among researchers in the U.S. and the UK who work at the frontiers of social media and learning.
This conference at Arizona State University is an early-stage activity inspired by the upcoming 2016 - 2018 bicentennial of the conception, writing and publication of Mary Shelley's "Frankenstein - or The Modern Prometheus." That book, and the dozens of films produced subsequently, have provoked questions for researchers and citizens that have endured for two centuries and are relevant today. - How have we gone from a world in which Mary Shelley could watch public demonstrations of voltaic power on dead animals to one in which the dissection of animals in classrooms is frowned upon, but the creation of new life forms via an international synthetic biology competition (iGEM) is celebrated? - How do literary, artistic and other cultural portrayals of science and engineering inspire and inflect STEM research? - What steps do contemporary scientists and engineers need to take in order to proceed with their innovative activity in a responsible fashion? - What role do lay citizens have in making decisions about science and technology?- How can we understand the broad relationship between creativity and responsibility? The convening brings together a USA and international group of educators in informal science education and multi-disciplinary scholars who study various aspects of the interactions of science, technology and society (STS). This team of natural and social scientists, engineers, museum professionals (Museum of Science, Boston (MOS); Science Museum of Minnesota (SMM)), artists and humanities scholars will begin to formulate plans for producing exhibits, educational programs and demonstrations, fiction and nonfiction writing contests, performances, and curricula that explore science education, ethics and artistry. An overarching goal is to establish a process that could create a national and global network of collaborators to plan programs worldwide and establish new professional collaborations of researchers beyond the bicentennial. The workshop, a first step toward a possible larger initiative, could be significant both for the public's engagement with contemporary issues of science and society and for stimulating new inter-disciplinary research on such issues.