EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
Exoplanets Exploration is an interactive exhibition to explore exoplanets for the primary audience of students grades 5th through 12th with a secondary audience of younger children and adults. The exhibition is located in the astronomy wing of the Boonshoft Museum of Discovery (Dayton, Ohio). The project goals are to provide a STEM base for visitors from which to explore exoplanet discoveries; for them to have a basic understanding of exoplanet missions, instruments used in the discoveries, and the science knowledge necessary to understand the discoveries; to learn about the exoplanet discoveries through hands-on tactile, auditory, visual, and kinesthetic interactive exhibition components; and to challenge visitors to contemplate the possibility of life elsewhere in the universe. Aspects of the exhibition are integrated into space-related programming by linking to school visits, Distance Learning programs, summer Discovery Camps, FIRST LEGO league, and homeschool programming. Components of the exhibition addresse relevant Ohio Academic Content Standards for Earth and Space Science and will evolve to incorporate new Next Generation Science Standards. With the STEM career information presented along with scientific learning, students will be able to visualize the possibilities that NASA and space science represents.
Empowering the Next Generation of Explorers is a program that uses space science and technology to provide informal STEM education and STEM career inspiration for students in regional Head Start programs, as well as underrepresented/underserved student groups in schools with a high Native American student population. The program is run by the staff of the U.S. Space & Rocket Center, the Official Visitor Center for NASA Marshall Space Flight Center in Huntsville, Alabama. The goal of Empowering the Next Generation of Explorers is to educate students about NASA’s overall mission, raise student interest and engagement in STEM subjects, and make students aware of STEM career opportunities. In 2012, 252 third through fifth grade students and 344 Head Start children participated in this program. Empowering the Next Generation of Explorers consists of an annual Native American Heritage Day and an annual Head Start Field Trip Day. On Native American Heritage Day, students participate in a guided field trip of the USSRC’s collection of space hardware and artifacts and take part in a hands-on STEM workshop, which includes elements from Native American Culture. Students also hear about the past, present and future of Native Americans in NASA programs, talk with Native American employees of MSFC, and watch a presentation on Native American culture. Head Start Day consists of a guided tour of the USSRC, including hands-on STEM-based activities for pre-K students about NASA’s current missions, like the Mars Curiosity Rover.
Families and school-aged constituents at 30 urban, inner-city neighborhood community-based organizations and teachers and students in earth science classes in 40 middle schools. Intent: This project will prepare neighborhood and community leaders in Philadelphia to use simple but effective observation tools and NASA’s educational web content to help their inner-city Philadelphia neighbors learn about space science and technology – and about their city and themselves – by knowledgably exploring the sky. Project Goals: 1. Create multiple opportunities for inner-city children, adults and families to observe and learn about the solar system through neighborhood and city-wide events. 2. Equip CBO’s with the knowledge, skills and materials they need to make space science-related events and activities a sustained part of programming for their constituents. 3. Stimulate interest and engagement in NASA’s missions and resources among residents of traditionally underserved, inner-city neighborhoods through astronomy experiences and NASA’s websites. 4. Create and strengthen collaborative ties between The Franklin Institute, CBO’s, city residents, and local amateur astronomers. Programs/Products produced: 1. Repeatable ‘Galileoscope’ workshops and activities in 30 CBO’s 2. Solar observing activities for 30 CBO’s and 40 middle schools. 3. School assembly-type audience interactive program about observational astronomy for use in schools and community organizations. 4. Recurring neighborhood star parties facilitated through on-going partnerships with local amateur astronomy clubs. 5. Participation in city-wide star party as part of the annual Philadelphia Science Festival.
The goal of this project is to advance STEM education in Hawaii by creating a series of educational products, based on NASA Earth Systems Science, for students (grades 3-5) and general public. Bishop Museum (Honolulu HI) is the lead institution. NASA Goddard Space Flight Center is the primary NASA center involved in the project. Partners include Hawaii Department of Education and a volunteer advisory board. The evaluation team includes Doris Ash Associates (UC Santa Cruz) and Wendy Meluch of Visitor Studies Inc. Key to this project: the NASA STEM Cohort, a team of six current classroom teachers whom the Museum will hire. The cohort will not only develop curricula on NASA earth science systems but also provide guidance to Bishop Museum on creating museum educational programming that best meets the needs of teachers and students. The overall goal of Celestial Islands is to advance STEM education in Hawaii through the use of NASA Earth Science Systems content. Products include: 1) combined digital planetarium/Science on a Sphere® program; 2) traveling version of that program, using a digital planetarium and Magic Planet; 3) curricula; 4) new exhibit at Bishop Museum on NASA ESS; 5) 24 teacher workshops to distribute curricula; 6) 12 community science events. The project's target audience is teachers and students in grades 3-5. Secondary audiences include families and other members of the general public. A total of 545,000 people will be served, including at least 44,000 students.
The National Girls Collaborative Project (NGCP) seeks to maximize access to shared resources within projects and with public and private sector organizations and institutions interested in expanding girls’ participation in science, technology, engineering, and mathematics (STEM). Funded primarily by the National Science Foundation, the NGCP is a robust national network of more than 3,000 girl-serving STEM organizations. Currently, 31 Collaboratives, serving 40 states, facilitate collaboration between more than 12,800 organizations who serve more than 7.7 million girls and 4.4 million boys. The NGCP occupies a unique role in the STEM community because it facilitates collaboration with all stakeholders who benefit from increasing diversity and engagement of women in STEM. These stakeholders form Regional Collaboratives, who are connected to local girl-serving STEM programs. Regional Collaboratives are led by leadership teams and advisory boards with representatives from K-12 education, higher education, community-based organizations, professional organizations, and industry. NGCP strengthens the capacity of girl-serving STEM projects by facilitating collaboration among programs and organizations and by sharing promising practice research, program models, and products through webinars, collaboration training, and institutes. This is accomplished through a tested comprehensive program of change that uses collaboration to expand and strengthen STEM-related opportunities for girls and women. In each replication state, the NGCP model creates a network of professionals, researchers, and practitioners, facilitating collaboration within this network, and delivering high-quality research-based professional development. Participating programs can also receive mini-grant funding to develop collaborative STEM-focused projects. To date, over 27,000 participants have been served in 241 mini-grant projects, and over 17,000 practitioners have been served through in-person events and webinars. The NGCP’s collaborative model changes the way practitioners and educators work to advance girls’ participation in STEM. It facilitates the development of practitioners in their knowledge of good gender equitable educational practices, awareness of the role of K-12 education in STEM workforce development, and mutual support of peers locally and across the United States.
SciGirls CONNECT is a broad national outreach effort to encourage educators, both formal and informal, to adopt new, research-based strategies to engage girls in STEM. SciGirls (pbskids.org/scigirls) is an Emmy award-winning television program and outreach program that draws on cutting-edge research about what engages girls in science, technology, engineering and math (STEM) learning and careers. The PBS television show, kids' website, and educational outreach program have reached over 14 million girls, educators, and families, making it the most widely accessed girls' STEM program available nationally. SciGirls' videos, interactive website and hands-on activities work together to address a singular but powerful goal: to inspire, enable, and maximize STEM learning and participation for all girls, with an eye toward future STEM careers. The goal of SciGirls is to change how millions of girls think about STEM. SciGirls CONNECT (scigirlsconnect.org) includes 60 partner organizations located in schools, museums, community organizations and universities who host SciGirls clubs, camps and afterschool programs for girls. This number is intended grow to over 100 by the end of the project in 2016. SciGirls CONNECT provides mini-grants, leader training and educational resources to partner organizations. Each partner training session involves educators from a score of regional educational institutions. To date, over 700 educators have received training from over 250 affiliated organizations. The SciGirls CONNECT network is a supportive community of dedicated educators who provide the spark, the excitement and the promise of a new generation of women in STEM careers. Through our partner, the National Girls Collaborative Project, we have networked educational organizations hosting SciGirls programs with dozens of female role models from a variety of STEM fields. The SciGirls CONNECT website hosts monthly webinars, a quarterly newsletter, gender equity resources, SciGirls videos and hands-on activities. SciGirls also promotes the television, website and outreach program to thousands of elementary and middle school girls and their teachers both locally and nationally at various events.
The Education and Outreach (EO) program is an essential part of the CRISP MRSEC located at Yale and SCSU. CRISP offers activities that promote the interdisciplinary and innovative aspects of materials science to a diverse group of participants. The objective of the program is to enhance the education of future scientists, science teachers, K-12 students, parents, and the general public. CRISP’s primary informal science activities include public lectures, family science nights, New Haven Science Fair and museum partnerships.