EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
Discover NASA is the Discovery Museum’s endeavor to engage students in grades K through 12 as well as members of the general public in innovative space science and STEM-focused learning through the implementation of two modules: upgrades to the Challenger Learning Center, and the creation of K through 12 amateur rocketry and spacecraft design programming. The programming will be piloted at the Discovery Museum and Planetarium, and at the Inter-district Discovery Magnet School and the Fairchild-Wheeler Multi-Magnet High School, with an additional strategic partnership with the University of Bridgeport, which will provide faculty mentors to high school seniors participating in the rocketry program. Through these two modules, the Discovery Museum and Planetarium aims to foster an early interest in STEM, increase public awareness about NASA, promote workforce development, and stimulate an interest in the future of human space exploration. Both modules emphasize design methodologies and integration of more advanced space science into the STEM curriculum currently offered by Discovery Museum to visitors and public schools. The Challenger Learning Center upgrades will enable the Museum to deliver simulated human exploration experiences related to exploration of the space environment in Low Earth Orbit and simulated human exploration of Moon, Mars, and beyond, which will increase public and student awareness about NASA and the future of human space exploration. The development of an amateur rocketry and spacecraft development incubator for education, the general public, and commercial space will stimulate the development of key STEM concepts.
The University of Oklahoma will increase knowledge about how youths create information and how information professionals can help them become successful information creators by promoting their information and digital literacies and other 21st century skills. This Early Career research project builds on existing research and results of previously funded IMLS Learning Labs by investigating how twenty-four middle school students engaged in project-based, guided-inquiry STEM learning to create information in a school library Learning Lab/Makerspace. The project will result in a model of information-creating behavior that can help develop a groundbreaking approach to information literacy instructions and creative programs.
The Free Library of Philadelphia Foundation will create on-the-floor makerspaces in libraries in underserved neighborhoods in North Philadelphia. These spaces will help local residents of all ages to gain access to technology and participatory education, and encourage creative applications and collaborative projects. Mentors will guide multigenerational community members as they create cross-disciplinary, interest-driven electronic art projects; build interest and knowledge in STEAM (Science, Technology, Engineering, Art, and Mathematics), and use tools and skills to create and share artifacts that reflect their identities and communities. Through the act of making, participants of all ages will have the opportunity to design meaningful digital and physical objects that capture the richness and diversity of their neighborhoods. These place-based, interest-driven, and mentor-guided makerspaces will provide a replicable, scalable model for libraries and museums nationally.
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. The project will further develop, roll out, and conduct research on a set of materials that will introduce middle school age youth to innovative and engaging engineering challenges in the Boys and Girls Club (B&GCs) context. Building on substantial prior work and evaluation-based learning, WISE Guys and Gals - Boys & Girls as WISEngineering STEM Learners (WGG) will: (1) combine engineering design activities with the (open source, online) WISEngineering infrastructure; (2) scale-up the infrastructure; (3) engage youth in informal afterschool experiences; and (4) collect a wealth of rich data to further our understanding of how youth learn through these experiences. This work will be conducted by Hofstra University's Center for STEM Research in conjunction with Brookhaven National Laboratory (BNL), The CUNY Graduate Center's Center for Advanced Study in Education (CASE), the Boys & Girls Club of America, and 25 B&GCs in New York and New Jersey. The underlying theoretical framework builds on proof-of-concept work supported by NSF and the Bill and Melinda Gates Foundation. An open source, on-line interface (WISEngineering) provides numerous virtual tools (e.g., social networking, Design Journal, embedded assessments) that promote learning and collaboration through challenging, thoughtful, and creative work. WGG will explore how to incorporate creativity, social networking, connections to real-world STEM needs/careers, and teamwork into challenges that can be completed in a one-hour period, an activity time constraint in many B&GC settings. Staff from the clubs will participate in face-to-face and virtual professional development in an effort to build their capacity as facilitators of STEM learning. Research will focus on: (1) how activities developed for 60-minute implementation and guided by informed engineering design and interconnected learning frameworks support youth learning and engagement; and (2) characteristics of the professional development approach that support B&GC facilitators' capacity development. By the end of the project, over 6,000 middle school aged youth, the majority from groups underrepresented in STEM areas, will gain experience with engineering design as they develop engineering thinking, new STEM competencies, STEM career awareness, and an appreciation for the civic value of STEM knowledge.
DATE:
-
TEAM MEMBERS:
David BurghardtXiang FuKenneth WhiteMelissa Rhodes
During middle school, many young people disengage from and consequently do not achieve in school-based STEM subjects. This phenomenon is more pronounced among young people in low-income communities than elsewhere. Many summer, out-of-school STEM programs are designed to offer young people opportunities to engage in hands-on, inquiry-based learning that promote interest and engagement in STEM. Research on the effect of these types of programs is limited, however. This research project seeks to fill this gap by identifying and studying practices that promote interest and engagement in STEM-related topics. The central goal of the summer STEM Interest and Engagement Study is to identify instructional practices associated with cultivating and sustaining young people's interest and engagement in out-of-school STEM summer learning programs for middle school youth. The project is based on a model of change developed from existing theory and empirical research on the cultivation of youths' interest and engagement in STEM. The project is a descriptive study that will apply multiple data collection and analytic methods, including the Experience Sampling Method (ESM), to determine instructional practices and the resulting interest, engagement, and perceptions of youth as they participate in STEM activities. In addition, survey data provided by program participants will allow the researchers to account for individual differences in preexisting interest and background factors, such as gender and ethnicity, and to measure changes in dispositions toward STEM. By better understanding these connections, practitioners can better understand how the design of their programs may influence the outcome of the participants' experience, including their education and career decisions.
DATE:
-
TEAM MEMBERS:
Deborah MoroneyNeil NaftzgerLee ShumowJennifer Schmidt
This Partnerships for Innovation: Building Innovation Capacity (PFI:BIC) project from the University of New Hampshire focuses on a "living bridge", which exemplifies the future of smart, sustainable, user-centered transportation infrastructure. Bridges deliver such a fundamental service to society that they are often taken for granted. Typically, bridges only stir the public's interest when they must unexpectedly be replaced at great cost, or, worse, fail. The Living Bridge project will create a self-diagnosing, self-reporting "smart bridge" powered by a local renewable energy source, tidal energy, by transforming the landmark Memorial Bridge--a vertical lift bridge over the tidal Piscataqua River, with pedestrian access connecting Portsmouth, New Hampshire to Kittery, Maine--into a living laboratory for researchers, engineers, scientists, and the community at large. The Living Bridge will engage innovators in sensor and renewable energy technology by creating an incubator platform on a working bridge, from which researchers can field test and evaluate the impact and effectiveness of emerging technologies. The Living Bridge will also serve as a community platform to educate citizens about innovations occurring at the site and in the region, and about how incorporating renewable energy into bridge design can lead to a sustainable transportation infrastructure with impact far beyond the region. Sustainable, smart bridges are key elements in developing a successful infrastructure system. To advance the state of smart service systems and clean energy conversion, this project team will design and deploy a structural and environmental monitoring system that provides information for bridge condition assessment, traffic management, and environmental stewardship; advances renewable energy technology application; and excites the general public about bridge innovations. This PFI:BIC project is enabled through partnerships between academic researchers with expertise in structural, mechanical and ocean engineering, sensing technology and social science; small businesses with expertise in instrumentation, data acquisition, tidal energy conversion; and state agencies with bridge design expertise. The Living Bridge technical areas are structural health monitoring, tidal energy conversion with fluid-structure interaction measurements, estuarine environmental monitoring, and outreach communication. Sensors will be used to calibrate a three-dimensional analytical structural finite element model of the bridge. The predicted structural response from this model will assess the measured structural response of the bridge as acceptable or not. Instruments installed on the turbine deployment platform will measure the spatio-temporal structure of the turbulent inflow and modified wake flow downstream of the turbine. Resulting data will include turbine performance and loads for use in fluid-structure interaction models. Deployed environmental sensors will measure estuarine water quality; wildlife deterrent sensors will deter fish from the turbine. Hydrophones and video cameras will be used before and during turbine deployment to monitor environmental changes due to turbine presence. Outreach efforts will make bridge data, history, and information about new systems accessible and understandable to the public and K-12 educators, facilitated by an information kiosk installed at the bridge. Public awareness will be assessed with survey methods used in the N.H. Granite State Poll. The lead institution is the University of New Hampshire (UNH) with its departments of Civil Engineering, Mechanical Engineering, and Sociology, and the Center for Ocean Engineering. Primary industrial partners are a large business, MacArtney Underwater Technology Group, Inc. (Houston, TX) and two small businesses Lite Enterprises, Inc. (Nashua, NH) and Eccosolutions, LLC (New Paltz, NY.) Broader context partners are New Hampshire Department of Transportation, NH Fish & Game Department, NH Port Authority, NH Coastal Program, City of Portsmouth (NH), Sustainable Portsmouth (nonprofit), Maine Department of Transportation; U.S. Coast Guard, Archer/Western (Canton, MA, large business), Parsons-Brinkerhoff (Manchester, NH, large business), UNH Tech Camp, UNH Infrastructure and Climate Network, UNH Leitzel Center for Mathematics, Science and Engineering Education, and Massachusetts Institute of Technology's Changing Places (a joint Architecture and Media Laboratory Consortium, in Cambridge, MA).
DATE:
-
TEAM MEMBERS:
Erin BellTat FuMartin WosnikKenneth BaldwinLawrence Hamilton
The aim of this project is to create conversations in science museums among scientists, engineers, and public audiences about an emerging research field, synthetic biology. Synthetic biology applies science and engineering to create new biological systems, and re-design existing biological systems, for useful purposes. This is an important new area of research and development that raises societal questions about potential benefits, costs, and risks. Conversations between researchers and public audiences will focus not only on what synthetic biology is and how research in the field is carried out, but also on the potential products, outcomes, and implications for society of this work. Researchers and publics will explore personal and societal values and priorities as well as desired research outcomes so that both groups can learn from each other. Public participants will benefit from knowing about this field of research, and researchers will benefit from hearing public perspectives directly from the public participants. This project will be led by the Museum of Science with partners at the American Association for the Advancement of Science, the Synthetic Biology Engineering Research Center, the Science Museum of Minnesota, the Ithaca Sciencenter, and several other universities and science museums. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is aimed at pushing beyond traditional modes of communicating with public audiences rooted in "public understanding of science" modalities into the mechanisms and perspectives associated with "public engagement with science" (PES). The project will support informal educational institutions as facilitators of such PES activities through which mutual learning takes place among research experts and various publics. Formative evaluation will support the development of evaluation tools that practitioners can use themselves to measure impacts of public engagement activities on both scientist and public participants. Summative evaluation will measure the impacts of the project on informal science education practitioners and researchers participating in the development of the project. In the first year of the project, two kinds of engagement activities will be tested at eight pilot sites across the U.S. The first kind will be the focus of "showcase" events, in which researchers demonstrate and talk with museum visitors about the basics of synthetic biology and their research work. The second kind will be the focus of "forum" events in which the multi-directional conversations focus on societal implications and participants' priorities for maximizing the benefits of this new field while minimizing the risks. The work of the first year will inform development of a kit of public engagement materials that will support widespread public engagement with synthetic biology in the second year at up to 200 sites across the U.S. Successful practices and infrastructure developed by the Nanoscale Informal Science Education Network to support NanoDays events will be use for this broad dissemination of public engagement in synthetic biology in year 2. When the project is complete a set of tools and guides will be provided online for developing, implementing, and evaluating engagement events that bring scientists and publics together, specifically about synthetic biology, but adaptable to other emerging research topics. The informal science education field will have a better understanding of how to get scientists, engineers, and publics to engage together in discussions about the societal implications of emerging technologies, and how to evaluate the quality of that engagement for both the researchers and the publics involved. The project will also provide a sense of informed public views on societal issues related to synthetic biology that emerge through a variety of public engagement activities that take place in science museums.
Many communities across the country are developing "maker spaces," environments that combine physical fabrication equipment, social communities of people working together, and educational activities for learning how to design and create works. Increasingly, maker spaces and maker technologies provide extended learning opportunities for school-aged young people. In such environments participants engage in many forms of communication where individuals and groups of people are focused on different projects simultaneously. The research conducted in this project will address an important need of those engaged in the making movement: evidence leading to a better understanding of how participants in maker spaces engage with science, technology, engineering and mathematics (STEM) as they create and produce physical products of personal and social value. Specifically, this research will generate new knowledge regarding how participants: pose and solve problems; identify, organize and integrate information from different sources; integrate information of different kinds (visual, quantitative, and verbal); and share ideas, knowledge and work with others. To understand and support STEM literacies involved in making, the investigators will study a number of different informal learning sites that self-identify as maker spaces and serve different-aged participants. The project will use ethnographic and design research techniques in three cycles of qualitative research. In Cycle One, the researchers will investigate two adult-oriented maker spaces in order to generate case studies and develop theories about how more experienced adult makers use the spaces and to create case studies of adult maker spaces, and to develop methodological techniques for understanding literacy in maker spaces. In Cycle Two, the study will expand into two out-of-school time youth-oriented maker spaces, building two new case studies and initiating design-based research activities. In Cycle Three, the team will further apply their developing theories and findings, through rapid iterative design-based research, to interventions that support participants' science literacy and making practices in two maker spaces that exist in schools. Through peer-reviewed publications, briefs, conference presentations, presence on websites of local and national maker organizations, project findings will be widely shared with organizations and individuals that are engaged in broadening the base of U.S. science and mathematics professionals for an innovation economy.