EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
The University of Oklahoma will increase knowledge about how youths create information and how information professionals can help them become successful information creators by promoting their information and digital literacies and other 21st century skills. This Early Career research project builds on existing research and results of previously funded IMLS Learning Labs by investigating how twenty-four middle school students engaged in project-based, guided-inquiry STEM learning to create information in a school library Learning Lab/Makerspace. The project will result in a model of information-creating behavior that can help develop a groundbreaking approach to information literacy instructions and creative programs.
The number of Latinos and Native Americans represented in library and information science professions is extremely low. The University of Arizona School of Information Resources and Library Science will address this inequity in its Connected Learning in Digital Heritage Curation project, which focuses on archives and special collections, medical librarianship, and public librarianship. The project will educate 24 culturally competent master’s degree students to serve Latino and Native American communities in the digital world. Students will gain hands-on experience working as graduate assistants with project partners: the University of Arizona Libraries, Center for Creative Photography, Arizona Health Sciences Library, Pima County Public Library, Arizona Historical Society, Arizona State Museum, Labriola National American Indian Data Center, American Indian Film Gallery, Laboratory of Tree-Ring Research and the Arizona State Library, Archives and Public Records.
The Free Library of Philadelphia Foundation will create on-the-floor makerspaces in libraries in underserved neighborhoods in North Philadelphia. These spaces will help local residents of all ages to gain access to technology and participatory education, and encourage creative applications and collaborative projects. Mentors will guide multigenerational community members as they create cross-disciplinary, interest-driven electronic art projects; build interest and knowledge in STEAM (Science, Technology, Engineering, Art, and Mathematics), and use tools and skills to create and share artifacts that reflect their identities and communities. Through the act of making, participants of all ages will have the opportunity to design meaningful digital and physical objects that capture the richness and diversity of their neighborhoods. These place-based, interest-driven, and mentor-guided makerspaces will provide a replicable, scalable model for libraries and museums nationally.
Portal to the Public: Expanding the National Network (PoP: ENN) is implementing around the county the successful NSF-funded Portal to the Public model in which researchers are trained to communicate and interact with the general public at informal science education (ISE) institutions about the research that they are conducting. The project, which follows on a thorough evaluation of the model at eight sites and current implementation at an additional fifteen sites, will incorporate twenty new ISE sites into the growing network, provide training and mentorship to ISE professionals on the use and adaptation of the PoP implementation manual and toolkits, and develop an enhanced network website that will serve as a communication and innovation hub. The work is responsive to the needs and activities of ISE organizations which continue to expand their missions beyond presenting to the public established science, technology, engineering and math (STEM) and are working to become places where visitors can also experience the process and promise of current research via face-to-face interactions with researchers. The project is expanding both the kind and number of institutions involved around the country and is facilitating their capacity to develop a knowledge base, share experiences and best practices.
During middle school, many young people disengage from and consequently do not achieve in school-based STEM subjects. This phenomenon is more pronounced among young people in low-income communities than elsewhere. Many summer, out-of-school STEM programs are designed to offer young people opportunities to engage in hands-on, inquiry-based learning that promote interest and engagement in STEM. Research on the effect of these types of programs is limited, however. This research project seeks to fill this gap by identifying and studying practices that promote interest and engagement in STEM-related topics. The central goal of the summer STEM Interest and Engagement Study is to identify instructional practices associated with cultivating and sustaining young people's interest and engagement in out-of-school STEM summer learning programs for middle school youth. The project is based on a model of change developed from existing theory and empirical research on the cultivation of youths' interest and engagement in STEM. The project is a descriptive study that will apply multiple data collection and analytic methods, including the Experience Sampling Method (ESM), to determine instructional practices and the resulting interest, engagement, and perceptions of youth as they participate in STEM activities. In addition, survey data provided by program participants will allow the researchers to account for individual differences in preexisting interest and background factors, such as gender and ethnicity, and to measure changes in dispositions toward STEM. By better understanding these connections, practitioners can better understand how the design of their programs may influence the outcome of the participants' experience, including their education and career decisions.
DATE:
-
TEAM MEMBERS:
Deborah MoroneyNeil NaftzgerLee ShumowJennifer Schmidt
This Partnerships for Innovation: Building Innovation Capacity (PFI:BIC) project from the University of New Hampshire focuses on a "living bridge", which exemplifies the future of smart, sustainable, user-centered transportation infrastructure. Bridges deliver such a fundamental service to society that they are often taken for granted. Typically, bridges only stir the public's interest when they must unexpectedly be replaced at great cost, or, worse, fail. The Living Bridge project will create a self-diagnosing, self-reporting "smart bridge" powered by a local renewable energy source, tidal energy, by transforming the landmark Memorial Bridge--a vertical lift bridge over the tidal Piscataqua River, with pedestrian access connecting Portsmouth, New Hampshire to Kittery, Maine--into a living laboratory for researchers, engineers, scientists, and the community at large. The Living Bridge will engage innovators in sensor and renewable energy technology by creating an incubator platform on a working bridge, from which researchers can field test and evaluate the impact and effectiveness of emerging technologies. The Living Bridge will also serve as a community platform to educate citizens about innovations occurring at the site and in the region, and about how incorporating renewable energy into bridge design can lead to a sustainable transportation infrastructure with impact far beyond the region. Sustainable, smart bridges are key elements in developing a successful infrastructure system. To advance the state of smart service systems and clean energy conversion, this project team will design and deploy a structural and environmental monitoring system that provides information for bridge condition assessment, traffic management, and environmental stewardship; advances renewable energy technology application; and excites the general public about bridge innovations. This PFI:BIC project is enabled through partnerships between academic researchers with expertise in structural, mechanical and ocean engineering, sensing technology and social science; small businesses with expertise in instrumentation, data acquisition, tidal energy conversion; and state agencies with bridge design expertise. The Living Bridge technical areas are structural health monitoring, tidal energy conversion with fluid-structure interaction measurements, estuarine environmental monitoring, and outreach communication. Sensors will be used to calibrate a three-dimensional analytical structural finite element model of the bridge. The predicted structural response from this model will assess the measured structural response of the bridge as acceptable or not. Instruments installed on the turbine deployment platform will measure the spatio-temporal structure of the turbulent inflow and modified wake flow downstream of the turbine. Resulting data will include turbine performance and loads for use in fluid-structure interaction models. Deployed environmental sensors will measure estuarine water quality; wildlife deterrent sensors will deter fish from the turbine. Hydrophones and video cameras will be used before and during turbine deployment to monitor environmental changes due to turbine presence. Outreach efforts will make bridge data, history, and information about new systems accessible and understandable to the public and K-12 educators, facilitated by an information kiosk installed at the bridge. Public awareness will be assessed with survey methods used in the N.H. Granite State Poll. The lead institution is the University of New Hampshire (UNH) with its departments of Civil Engineering, Mechanical Engineering, and Sociology, and the Center for Ocean Engineering. Primary industrial partners are a large business, MacArtney Underwater Technology Group, Inc. (Houston, TX) and two small businesses Lite Enterprises, Inc. (Nashua, NH) and Eccosolutions, LLC (New Paltz, NY.) Broader context partners are New Hampshire Department of Transportation, NH Fish & Game Department, NH Port Authority, NH Coastal Program, City of Portsmouth (NH), Sustainable Portsmouth (nonprofit), Maine Department of Transportation; U.S. Coast Guard, Archer/Western (Canton, MA, large business), Parsons-Brinkerhoff (Manchester, NH, large business), UNH Tech Camp, UNH Infrastructure and Climate Network, UNH Leitzel Center for Mathematics, Science and Engineering Education, and Massachusetts Institute of Technology's Changing Places (a joint Architecture and Media Laboratory Consortium, in Cambridge, MA).
DATE:
-
TEAM MEMBERS:
Erin BellTat FuMartin WosnikKenneth BaldwinLawrence Hamilton
The aim of this project is to create conversations in science museums among scientists, engineers, and public audiences about an emerging research field, synthetic biology. Synthetic biology applies science and engineering to create new biological systems, and re-design existing biological systems, for useful purposes. This is an important new area of research and development that raises societal questions about potential benefits, costs, and risks. Conversations between researchers and public audiences will focus not only on what synthetic biology is and how research in the field is carried out, but also on the potential products, outcomes, and implications for society of this work. Researchers and publics will explore personal and societal values and priorities as well as desired research outcomes so that both groups can learn from each other. Public participants will benefit from knowing about this field of research, and researchers will benefit from hearing public perspectives directly from the public participants. This project will be led by the Museum of Science with partners at the American Association for the Advancement of Science, the Synthetic Biology Engineering Research Center, the Science Museum of Minnesota, the Ithaca Sciencenter, and several other universities and science museums. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project is aimed at pushing beyond traditional modes of communicating with public audiences rooted in "public understanding of science" modalities into the mechanisms and perspectives associated with "public engagement with science" (PES). The project will support informal educational institutions as facilitators of such PES activities through which mutual learning takes place among research experts and various publics. Formative evaluation will support the development of evaluation tools that practitioners can use themselves to measure impacts of public engagement activities on both scientist and public participants. Summative evaluation will measure the impacts of the project on informal science education practitioners and researchers participating in the development of the project. In the first year of the project, two kinds of engagement activities will be tested at eight pilot sites across the U.S. The first kind will be the focus of "showcase" events, in which researchers demonstrate and talk with museum visitors about the basics of synthetic biology and their research work. The second kind will be the focus of "forum" events in which the multi-directional conversations focus on societal implications and participants' priorities for maximizing the benefits of this new field while minimizing the risks. The work of the first year will inform development of a kit of public engagement materials that will support widespread public engagement with synthetic biology in the second year at up to 200 sites across the U.S. Successful practices and infrastructure developed by the Nanoscale Informal Science Education Network to support NanoDays events will be use for this broad dissemination of public engagement in synthetic biology in year 2. When the project is complete a set of tools and guides will be provided online for developing, implementing, and evaluating engagement events that bring scientists and publics together, specifically about synthetic biology, but adaptable to other emerging research topics. The informal science education field will have a better understanding of how to get scientists, engineers, and publics to engage together in discussions about the societal implications of emerging technologies, and how to evaluate the quality of that engagement for both the researchers and the publics involved. The project will also provide a sense of informed public views on societal issues related to synthetic biology that emerge through a variety of public engagement activities that take place in science museums.
Many communities across the country are developing "maker spaces," environments that combine physical fabrication equipment, social communities of people working together, and educational activities for learning how to design and create works. Increasingly, maker spaces and maker technologies provide extended learning opportunities for school-aged young people. In such environments participants engage in many forms of communication where individuals and groups of people are focused on different projects simultaneously. The research conducted in this project will address an important need of those engaged in the making movement: evidence leading to a better understanding of how participants in maker spaces engage with science, technology, engineering and mathematics (STEM) as they create and produce physical products of personal and social value. Specifically, this research will generate new knowledge regarding how participants: pose and solve problems; identify, organize and integrate information from different sources; integrate information of different kinds (visual, quantitative, and verbal); and share ideas, knowledge and work with others. To understand and support STEM literacies involved in making, the investigators will study a number of different informal learning sites that self-identify as maker spaces and serve different-aged participants. The project will use ethnographic and design research techniques in three cycles of qualitative research. In Cycle One, the researchers will investigate two adult-oriented maker spaces in order to generate case studies and develop theories about how more experienced adult makers use the spaces and to create case studies of adult maker spaces, and to develop methodological techniques for understanding literacy in maker spaces. In Cycle Two, the study will expand into two out-of-school time youth-oriented maker spaces, building two new case studies and initiating design-based research activities. In Cycle Three, the team will further apply their developing theories and findings, through rapid iterative design-based research, to interventions that support participants' science literacy and making practices in two maker spaces that exist in schools. Through peer-reviewed publications, briefs, conference presentations, presence on websites of local and national maker organizations, project findings will be widely shared with organizations and individuals that are engaged in broadening the base of U.S. science and mathematics professionals for an innovation economy.
This project is making novel use of familiar technology (smartphones and tablets) to address the immediate and pressing challenge of affordable, ongoing, large-scale museum evaluation, while encouraging museum visitors to engage deeply with museum content. Using a smartphone app, museum visitors pose questions to a 'virtual scientist' called Dr. Discovery (Dr. D). Dr. D provides answers and the chance to complete fun mini-challenges. The questions visitors ask are gathered in a large database. An analytics system analyzes these data and a password-protected website provides continuous, accessible evaluation data to museum staff, helping them make just-in-time tweaks (or longer term changes) to exhibit-related content (such as multimedia, lecture topics, docent training, experience carts, etc.) as current events and visitors' needs and interests change. The intellectual merit of this project is that it is building evaluation capacity among informal educators, advancing the fields of visitor studies, museum evaluation, informal science learning, and situated engagement, and is contributing to the development of novel evaluation techniques in museums. This project has many broader impacts: The Ask Dr. Discovery system is available to any venue that wishes to use or adapt it to their context. By enhancing the visitor experience and improving museum access to data for evaluation and data-driven decision making across the country, Ask Dr. Discovery has both a direct and indirect impact on museums and visitors of all types. This project is also training the next generation of STEM and education innovators by employing a diverse team of undergraduate students.
The Cyberlearning and Future Learning Technologies Program funds efforts that will help in envisioning the next generation of learning technologies and advancing what we know about how people learn in technology-rich environments. Development and Implementation (DIP) Projects build on proof-of-concept work that showed the possibilities of the proposed new type of learning technology, and project teams build and refine a minimally-viable example of their proposed innovation that allows them to understand how such technology should be designed and used in the future and answer questions about how people learn with technology. Although for years researchers have believed technology could afford anytime-anywhere learning, we still don't understand how learners behave differently across contexts, such as home, school, and in the community, and how to get youth to identify as learners across those contexts. This proposal aims to use mobile devices and strategically placed shared kiosks to 'scientize' youth in two low-income communities. Through strategic partnerships with community organizations, educators, and families, the innovation is to get primary and middle-school students engaging in scientific inquiry in the context of their neighborhoods. Research will help determine how the technology can best be deployed, but also answer important questions about how communities can provide support to help kids think like scientists and identify with science. This project will design and implement ubiquitous technology tools that include mobile social media and tangible, community displays (collectively called ScienceKit) that are deeply embedded into two urban neighborhoods, and demonstrate how such ubiquitous technologies and related cyberlearning strategies are vital to improve information flow and coordination across a neighborhood ecosystem, in order to create environments where children can connect their science learning across contexts and time (e.g. scientizing). A program called ScienceEverywhere comprised of partnerships between tightly connected neighborhood organizations with mentors, teachers, parents, and researchers will help learners develop scientifically literate practices both in and out of school, and will demonstrate students' learning to their communities. Research will consist of mixed methods studies of use of the tools, including iterative design-based research, ethnography, and the use of participant observers from the community; these will be triangulated with usage logs of the technologies and content analysis of microblogs by the learners on their identities and interests. Discourse analysis of interviews with focal learners will orient the qualitative work on identity development, and analysis using activity theory will inform the influences of the social practices and sociotechnical systems on learner trajectories. Formative evaluation will help shed light on if and how the sociotechnical system promotes STEM literacy and STEM identity development.