Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
DATE:
TEAM MEMBERS:
Ginger Fitzwater
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
The Center for Advancement of Informal Science Education (CAISE), a cooperative agreement with the National Science Foundation Advancing Informal STEM Learning (AISL) program, is a partnership of the Association of Science-Technology Centers with faculty and professionals from the University of Pittsburgh Center for Learning in Out-of-School Environments (UPCLOSE), Oregon State University (OSU), the Great Lakes Science Center, KQED Public Media, advisors and other collaborators. CAISE works to support and resource ongoing improvement of, and NSF investments in, the national infrastructure for informal Science Technology Engineering and Mathematics (STEM) education. CAISE's roles are to build capacity and support continued professionalization for the field by fostering a community that bridges the many varied forms in which informal STEM learning experiences are developed and delivered for learners of all ages. To that end, CAISE activities also include: creating field-driven evidence databases about the impacts of informal STEM education; facilitating federated searches of those databases; furthering dialogue and knowledge transfer between learning research and practice; working to enhance the quality and diversity of evaluation knowledge and processes; and helping STEM researchers improve their efforts in informal STEM education, outreach and communication. For Principal Investigators (PIs) and potential PIs, CAISE provides resources that can assist in the development of evidence-based proposals. It also facilitates and strengthens networks through PI meetings, communications, and other methods that encourage sharing of deliverables, practices, outcomes and findings across projects. For the AISL Program at NSF, CAISE is assisting program officers in understanding the portfolio of awards, identifying the portfolio's impacts in key areas, and integrating the program's investments in education infrastructure.
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
The University of Chicago's Yerkes Observatory, the National Radio Astronomy Observatory, the University of North Carolina, the Astronomical Society of the Pacific, and 4-H are collaborating to provide professional development to 180 4-H leaders and other informal science educators, and engage 1,400 middle school youth in using research-grade robotic telescopes and data analysis tools to explore the Universe. Youth participating in 4H-based out-of-school programs in Wisconsin, West Virginia and North Carolina are learning about the universe and preparing for STEM careers by conducting authentic astronomy research, completing astronomy-related hands-on modeling activities, interacting with astronomers and other professionals who are part of the Skynet Robotic Telescope Network, and interacting with other youth who part of the Skynet Junior Scholars virtual community. The project is innovative because it is providing a diverse community of 4-H youth (including sight- and hearing-challenged youth and those from underrepresented groups) with opportunities to use high-quality, remotely located, Internet-controlled telescopes to explore the heavens by surveying galaxies, tracking asteroids, monitoring variable stars, and learn about the nature and methods of science. Deliverables include (1) online access to optical and radio telescopes, data analysis tools, and professional astronomers, (2) an age-appropriate web-based interface for controlling remote telescopes, (3) inquiry-based standards-aligned instructional modules, (4) face-to-face and online professional development for 4-H leaders and informal science educators, (5) programming for youth in out-of-school clubs and clubs, (6) evaluation findings on the impacts of program activities on participants, and (7) research findings on how web-based interactions between youth and scientists can promote student interest in and preparedness for STEM careers. The evaluation plan is measuring the effectiveness of program activities in (1) increasing youths' knowledge, skills, interest, self-efficacy, and identity in science, including youth who are sight- and hearing-impaired, (2) increasing educators' competency in implementing inquiry-based instruction and their ability to interact with scientists, and (3) increasing the number of Skynet scientists who are involved in education and public outreach.
Tornado Alley is a large-format 2D/3D film and comprehensive outreach program exploring the science behind severe weather events. The project focuses on cutting-edge developments in the fields of meteorology and earth science, demonstrating weather monitoring technologies. The project spotlights the current research of the VORTEX 2 (V2) project--the most ambitious effort ever to understand the origins, structure and evolution of tornadoes. The principle target audiences are science museum audiences, with additional special attention to under-served, rural mid-western communities, which will be served by digital 3D screenings. The film will be produced by Graphic Films and Giant Screen Films and distributed by Giant Screen Films. The Franklin Institute will create and manage outreach to professional audiences. Informal Learning Solutions will conduct formative evaluation; RMC Research Corporation will conduct summative evaluation of the project. The film, produced by Paul Novros (PI) and directed by Sean Casey, will collaborate closely with the V2 team, led by Dr. Josh Wurman, and consult with the project advisors to assure clarity and accuracy of the science being presented. A distance-learning initiative to serve educators--both formal and informal--will be managed by Karen Elinich (co-PI) of The Franklin Institute. The project's innovative outreach strategies leverage the mobility of the tornado intercept vehicle (TIV) built by Sean Casey, and the Doppler on Wheels and MGAUS (weather balloon vehicles) to bring scientists and weather-monitoring technology into direct contact with audiences. Outreach to underserved audiences, especially rural audiences, will provide opportunities for interactions with V2 PIs and their students, who serve as role models in science careers. In addition, cyber infrastructure will allow groups of educators to interact remotely with V2 researchers and experience visualizations of weather data. The film and ancillary materials will be translated into Spanish. The project serves as a model for the dissemination of the methods and results of a specific major NSF hard-science research endeavor to the general public through ISE products and activities. The goal of the project is for the audience to increase their knowledge and understanding of the scientific process, learn what meteorologists do, what technologies are used in meteorology and weather science and the factors and forces in meteorological events. It is intended that young audience members will also develop and interest in weather science and potential careers in science and engineering. In the first five years of the film\'s release, the audience is anticipated at 7 million plus. In addition, the live outreach events are expected to engage approximately 40,000-60,000 individuals.
The National Science Festival Network project, also operating as the Science Festival Alliance, is designed to create a sustainable national network of science festivals that engages all facets of the general public in science learning. Science Festivals, clearly distinct from "science fairs", are community-wide activities engaging professional scientists and informal and K-12 educators targeting underrepresented segments of local communities historically underserved by formal or informal STEM educational activities. The initiative builds on previous work in other parts of the world (e.g. Europe, Australasia) and on recent efforts in the U.S. to create science festivals. The target audiences are families, children and youth ages 5-18, adults, professional scientists and educators in K-12 and informal science institutions, and underserved and underrepresented communities. Project partners include the MIT Museum in Cambridge, UC San Diego, UC San Francisco, and the Franklin Institute in Philadelphia. The deliverables include annual science festivals in these four cities supported by year-round related activities for K-12 and informal audiences, a partnership network, a web portal, and two national conferences. Ten science festivals will be convened in total over the 3 years of the project, each reaching 15,000 to 60,000 participants per year. STEM content includes earth and space science, oceanography, biological/biomedical science, bioinformatics, and computer, behavioral, aeronautical, nanotechnology, environmental, and nuclear science. An independent evaluator will systematically assess audience participation and perceptions, level/types of science interest stimulated in target groups, growth of partnering support at individual sites, and increasing interactions between ISE and formal K-12 education. A variety of qualitative and quantitative assessments will be designed and utilized. The project has the potential to transform public communication and understanding of science and increase the numbers of youth interested in pursuing science.
DATE:
-
TEAM MEMBERS:
Loren ThompsonJeremy BabendureBen Wiehe
The National Science Foundation (NSF) awarded funding to the Oregon Museum of Science and Industry (OMSI) and Portland State University (PSU) in Portland, Oregon to support a “Connecting Researchers and Public Audiences” (CRPA) project titled ResearchLink: Spotlight on Solar Technologies. The primary goals of CRPA projects are to communicate to the public about specific NSF research projects. This ResearchLink project promoted public awareness of two NSF-funded projects led by Dr. Carl Wamser at PSU, Integrating Green Roofs and Photovoltaic Arrays for Energy Management and Optimization of
President Obama announced in April 2013 that the Corporation for National and Community Service (CNCS) would launch a STEM AmeriCorps initiative to build student interest in STEM. A RFA is currently being prepared to be released in the late fall of 2013. This project will engage in quick response research to identify an evaluation and research agenda that can begin to inform the program launch. Thus, the timeframe for informing the initial stages of STEM AmeriCorps is relatively short, and the creation of an evaluation and research agenda is very timely. The products from the RAPID proposal are: (1) a review of the evaluation and research literature on the use of volunteers and/or mentors to build students' interest in STEM; (2) to convene a workshop to identify evaluation and research priorities to guide the initiative; and (3) a summary evaluation agenda that identifies promising directions along with the strength of evidence around key issues.
This research follows on a previous study that investigated how digitally augmented devices and knowledge building could enhance learning in a science museum. In this study, we were interested in understanding which combination of scaffolds could be used in conjunction with the unique characteristics of informal participation to increase conceptual and cognitive outcomes. Three hundred seven students from nine middle schools participated in the study. Six scaffolds were used in various combinations. The first was the digital augmentation. The next five were adaptations of knowledge-building
DATE:
TEAM MEMBERS:
Susan YoonKaren ElinichJoyce WangJaqueline SchooneveldEmma Anderson
For the purpose of clarity and consistency, the term e-learning is used throughout the paper to refer to technology-enhanced learning and information technology (IT) in teaching and learning. IT depicts computing and other IT resources. Research into e-learning has changed in focus and breadth over the last four decades as a consequence of changing technologies, and changes in educational policies and practices. Although increasing numbers of young people have access to a wide range of IT technologies during their leisure activities, little is known about this impact on their learning. Much of