EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
Through a comparative case study, Sheridan and colleagues explore how makerspaces may function as learning environments. Drawing on field observations, interviews, and analysis of artifacts, videos, and other documents, the authors describe features of three makerspaces and how participants learn and develop through complex design and making practices. They describe how the makerspaces help individuals identify problems, build models, learn and apply skills, revise ideas, and share new knowledge with others. The authors conclude with a discussion of the implications of their findings for this
In this essay, Erica Halverson and Kimberly Sheridan provide the context for research on the maker movement as they consider the emerging role of making in education. The authors describe the theoretical roots of the movement and draw connections to related research on formal and informal education. They present points of tension between making and formal education practices as they come into contact with one another, exploring whether the newness attributed to the maker movement is really all that new and reflecting on its potential pedagogical impacts on teaching and learning.
The Cyberlearning and Future Learning Technologies Program funds efforts that support envisioning the future of learning technologies and advance what we know about how people learn in technology-rich environments. In this Cyberlearning EAGER project, the project team is developing foundations for using "paper mechatronics" as a learning technology. Paper mechatronics makes possible a craft-oriented approach to engineering and computing education that integrates key concepts from mechanical engineering, electrical engineering, control systems, and computer programming, while using paper as the primary material for learner design, exploration, and inquiry. In this approach, learners will design foldable paper components and assemblies; program motors, sensors and controls; test their ideas iteratively; and share their designs on a website. This paper-based modeling approach to learning concepts in and practices of mechanical engineering, electrical engineering, control systems, and computer programming ultimately aims to make it possible for all learners to have exposure to and the opportunity to participate in creative engineering, design, and computer programming.
The approach to learning through designing and making through paper mechatronics is made possible by a convergence of many different technological factors -- the array of small computers, sensors, and actuators that are becoming available at low cost and a size that children can use; availability of a wide variety of manipulable conductive materials (threads, paints, fabrics); low-cost and precise desktop and laser cutters for paper and similar materials; a wide variety of novel paper-like materials; and new ways of interacting with the computer. The approach has its foundations in Papert's constructionism and in the current maker movement, but it has potential beyond constructionism itself, both in practice and with respect to what can potentially be learned about learning and development in in context of its use.
The Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with the National Science Foundation Advancing Informal STEM Learning (AISL) program, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments (UPCLOSE), Oregon State University (OSU), the Great Lakes Science Center, KQED Public Media, advisors and other collaborators. CAISE works to support and resource ongoing improvement of, and NSF investments in, the national infrastructure for informal Science Technology Engineering and Mathematics (STEM) education. CAISE's roles are to build capacity and support continued professionalization for the field by fostering a community that bridges the many varied forms in which informal STEM learning experiences are developed and delivered for learners of all ages. To that end, CAISE activities also include: creating field-driven evidence databases about the impacts of informal STEM education; facilitating federated searches of those databases; furthering dialogue and knowledge transfer between learning research and practice; working to enhance the quality and diversity of evaluation knowledge and processes; and helping STEM researchers improve their efforts in informal STEM education, outreach and communication. For Principal Investigators (PIs) and potential PIs, CAISE provides resources that can assist in the development of evidence-based proposals. It also facilitates and strengthens networks through PI meetings, communications, and other methods that encourage sharing of deliverables, practices, outcomes and findings across projects. For the AISL Program at NSF, CAISE is assisting program officers in understanding the portfolio of awards, identifying the portfolio's impacts in key areas, and integrating the program's investments in education infrastructure.
This pathways project will study how audiences in public spaces, in this case those in a museum setting, relate to and make sense of large data displays. The project is preliminary to development of a traveling, hands-on exhibition enabling users to create and utilize representations of big data displays such as maps and charts. As the test case, the project will use science maps that provide an overview of science generally and specific areas of STEM, charting and exploring the history and future of science and technology. The data collection portion of the project will take place at the New York Hall of Science, the Marian Koshland Science Museum, COSI in Columbus, Ohio, and WonderLab Museum in Bloomington, Indiana. The project will create a foundation for the design of museum exhibits and educational programs that teach museum visitors how to explore, engage and make better sense of big data. The project is potentially transformative because big data is becoming ubiquitous and making sense out of large data displays is necessary in order to understand big data sets.
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
This pathways project would refine and test a game based on the Kinect technology gaming tool to teach seismology concepts in an informal education setting and how they apply to phenomenon in other STEM fields. The game will be developed as a companion tool to the "Quake Catcher Network" a low-cost network of seismic sensors in schools, homes and offices world-wide and tie-ins with seismology programs such as the great California ShakeOut with a participant base of 8.6 million. The project design would select three new learning modules, chosen by a group of scientists and educators, to incorporate into the game and evaluate player experience and knowledge gain. The activities will be conducted at a partner test site, an aquarium, frequented by area youth 8 - 12 years old. The focus of the effort is to add to the knowledge of how gaming can be used effectively in informal learning environments The game places the player as a scientist, allowing the player to make decisions about seismic station deployment strategies following an earthquake, installing the sensors and monitoring incoming data. The game has levels of difficulty and players accrue points by acting swiftly and correctly. Learning goals for the project include making abstract math concepts understandable; involve participants in data collection and the process of scientific investigation, plus demonstrate how scientists and mathematicians use tools of their fields to address real-world issues.
The University of Chicago's Yerkes Observatory, the National Radio Astronomy Observatory, the University of North Carolina, the Astronomical Society of the Pacific, and 4-H are collaborating to provide professional development to 180 4-H leaders and other informal science educators, and engage 1,400 middle school youth in using research-grade robotic telescopes and data analysis tools to explore the Universe. Youth participating in 4H-based out-of-school programs in Wisconsin, West Virginia and North Carolina are learning about the universe and preparing for STEM careers by conducting authentic astronomy research, completing astronomy-related hands-on modeling activities, interacting with astronomers and other professionals who are part of the Skynet Robotic Telescope Network, and interacting with other youth who part of the Skynet Junior Scholars virtual community. The project is innovative because it is providing a diverse community of 4-H youth (including sight- and hearing-challenged youth and those from underrepresented groups) with opportunities to use high-quality, remotely located, Internet-controlled telescopes to explore the heavens by surveying galaxies, tracking asteroids, monitoring variable stars, and learn about the nature and methods of science. Deliverables include (1) online access to optical and radio telescopes, data analysis tools, and professional astronomers, (2) an age-appropriate web-based interface for controlling remote telescopes, (3) inquiry-based standards-aligned instructional modules, (4) face-to-face and online professional development for 4-H leaders and informal science educators, (5) programming for youth in out-of-school clubs and clubs, (6) evaluation findings on the impacts of program activities on participants, and (7) research findings on how web-based interactions between youth and scientists can promote student interest in and preparedness for STEM careers. The evaluation plan is measuring the effectiveness of program activities in (1) increasing youths' knowledge, skills, interest, self-efficacy, and identity in science, including youth who are sight- and hearing-impaired, (2) increasing educators' competency in implementing inquiry-based instruction and their ability to interact with scientists, and (3) increasing the number of Skynet scientists who are involved in education and public outreach.
StarTalk Radio will develop a highly innovative new genre of science radio that bridges the intersection between popular culture and science education. Host of the show and project PI is Dr. Neil deGrasse Tyson, renowned scientist, astrophysicist, popular science author and director of the Hayden Planetarium in New York City. The radio programs will combine comedy, references to pop culture, and public fascination with space science to reach an untapped audience for the informal science field--those who listen to commercial talk radio call-in shows. The STEM content will include astronomy, astrophysics, astrobiology, space exploration, earth system science, and associated technologies. Goals and intended outcomes of the project include increasing knowledge and interest of space science topics, and motivating audiences to pursue additional learning acitivities as the result of listening to the programs. This project builds on a previous SGER grant (#0852400) which produced 13 pilot programs and was evaluated by Multimedia Research. Project deliverables include 39 one-hour live call-in shows a year for a total of 117 shows over three years, a website, and a business strategy that projects making the radio programs self-sustaining. Dr. Tyson will be the host, and each program will include a celebrity guest who has a strong interest in science. The target audience for the show is the "blue collar intellectual" audience segment who listens to commercial talk radio, has a high school education or less and is in the 25-44 year old range. It is estimated that there will be one million listeners per week by the end of the project. People with disabilities (deaf and visually impaired) will have access to the products through captioning and other features on the website. Project partners include CBS Radio, CBS/AOL, and Discover Magazine. Formative evaluation of these new shows and website will be conducted by Multimedia Research. The Goodman Research Group (GRG) will conduct the summative evluation to assess the extent to which the project accomplishes the goals and specifically will gather and analyze data on the previously untappped and underserved audiences. The evaluation will examine the differences in impact on Science Novices and Science Enthusiasts, asking questions about how the programs increase awareness of scientific issues, and their effects on society and culture, as well as factual knowledge. Methods include multi-level, quasi-experimental, and longitudinal episode assessments. Potential impacts on the field of informal science education include opening up a new commercial radio audience for informal science learning, increasing knowledge about effective approaches to combining humor and science, and demonstrating an effective business model that results in a self-supporting show about science on commercial radio.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.