EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
resourceresearchMuseum and Science Center Programs
The National Autonomous University of Mexico (UNAM) is one of the world's single largest employers of science communicators, with over 350,000 students and 40,000 staff. Its science communication activities include five museums (Universum, Museo de la Luz, the Geology Museum, Museo de la Medicina Mexicana and Musem of Geophysics), botanical gardens, as well as a wide range of cultural and outreach activities. It has several programmes for training professional science communicators. The science communication staff are spread across the campuses in Mexico City and four other cities, including
DATE:
TEAM MEMBERS:
Ana Claudia NepoteElaine Reynoso-Haynes
Glaciers around the world are undergoing dramatic changes. Many people, however, have a limited understanding of the scope of these changes because they are geographically distant and difficult to visualize. Although both digital learning tools and online scientific data repositories have greatly expanded over the last decade, there is currently no interface that brings the two together in a way that allows the public to explore these rapidly changing glacial environments. Therefore, to both improve public understanding and provide greater access to already existing resources, the project team will develop the Virtual Ice Explorer to encourage informal learning about glacial environments. This web application will feature an immersive virtual environment and display a suite of environmental data for an array of Earth's glacial systems. An interactive globe will allow users to select from a collection of sites ranging from polar regions to tropical latitudes. Each featured site will offer users an opportunity to interact with (1) a 3D rendering of the landscape; (2) a local map of the site; (3) historical and contemporary photographs of the site; (4) background information text describing the location, past research, and climate impacts; and (5) available environmental data. One of the most original features of the application will be its realistic, immersive 3D rendering of glacial landscapes by combining very high-resolution digital elevation models and satellite imagery with the application's built-in capabilities for immersive virtual environments. Although immersive environments often require expensive equipment, we are maximizing accessibility by developing the Virtual Ice Explorer to run in a web browser and function across various devices. Thus, the application will be available to anyone with internet access, and they can explore at their own pace.
As part of the successful development of Virtual Ice Explorer, the project team will create a platform for digital elevation models to be visualized and explored in 3D by users within the web application; curate digital elevation models, maps, images, text, and environmental data for inclusion in the web application for up to 11 geographically diverse glaciers/glacial landscapes; iteratively user-test the web application with project partners; and design the architecture of the system to readily scale to a larger collection of glaciers/glacial landscapes. To extend dissemination of the final products, the team has partnered with the U.S. Geologic Survey to showcase four benchmark glaciers in their long-term Glaciers and Climate project. In addition to improving understanding of glacier systems in informal learning environments, the project team will explore applications for spatial learning, employment of 3D environments for educational interventions, and use of Virtual Ice Explorer in formal learning environments. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project also has support from the Office of Polar Programs.
DATE:
-
TEAM MEMBERS:
Jason CervenecJesse FoxJulien Nicolas
As the world is increasingly dependent upon computing and computational processes associated with data analysis, it is essential to gain a better understanding of the visualization technologies that are used to make meaning of massive scientific data. It is also essential that the infrastructure, the very means by which technologies are developed for improving the public's engagement in science itself, be better understood. Thus, this AISL Innovations in Development project will address the critical need for the public to learn how to interpret and understand highly complex and visualized scientific data. The project will design, develop and study a new technology platform, xMacroscope, as a learning tool that will allow visitors at the Science Museum of Minnesota and the Center of Science and Industry, to create, view, understand, and interact with different data sets using diverse visualization types. The xMacroscope will support rapid research prototyping of public experiences at selected exhibits, such as collecting data on a runner's speed and height and the visualized representation of such data. The xMacroscope will provide research opportunities for exhibit designers, education researchers, and learning scientists to study diverse audiences at science centers in order to understand how learning about data through the xMacroscope tool may inform definitions of data literacy. The research will advance the state of the art in visualization technology, which will have broad implications for teaching and learning of scientific data in both informal and formal learning environments. The project will lead to better understanding by science centers on how to present data to the public more effectively through visualizations that are based upon massive amounts of data. Technology results and research findings will be disseminated broadly through professional publications and presentations at science, education, and technology conferences. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project is driven by the assumption that in the digital information age, being able to create and interpret data visualizations is an important literacy for the public. The research will seek to define, measure, and advance data visualization literacy. The project will engage the public in using the xMacrocope at the Science Museum of Minnesota and at the Center of Science and Industry's (COSI) science museum and research center in Columbus, Ohio. In both museum settings the public will interact with different datasets and diverse types of visualizations. Using the xMacroscope platform, personal attributes and capabilities will be measured and personalized data visualizations will be constructed. Existing theories of learning (constructivist and constructionist) will be extended to capture the learning and use of data visualization literacy. In addition, the project team will conduct a meta-review related to different types of literacy and will produce a definition with performance measures to assess data visualization literacy - currently broadly defined in the project as the ability to read, understand, and create data visualizations. The research has potential for significant impact in the field of science and technology education and education research on visual learning. It will further our understanding of the nature of data visualization literacy learning and define opportunities for visualizing data in ways that are both personally and culturally meaningful. The project expects to advance the understanding of the role of personalization in the learning process using iterative design-based research methodologies to advance both theory and practice in informal learning settings. An iterative design process will be applied for addressing the research questions by correlating visualizations to individual actions and contributions, exploring meaning-making studies of visualization construction, and testing the xMacroscope under various conditions of crowdedness and busyness in a museum context. The evaluation plan is based upon a logic model and the evaluation will iteratively inform the direction, process, and productivity of the project.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
Cities and communities in the U.S. and around the world are entering a new era of transformational change, in which their inhabitants and the surrounding built and natural environments are increasingly connected by smart technologies, leading to new opportunities for innovation, improved services, and enhanced quality of life. The Smart and Connected Communities (SCC) program supports strongly interdisciplinary, integrative research and research capacity-building activities that will improve understanding of smart and connected communities and lead to discoveries that enable sustainable change to enhance community functioning. This project is a Research Coordination Network (RCN) that focuses on achieving SCC for medium/small size, remote, and rural communities through a polycentric (multiple centers) integrated policy, design, and technology approach. The communities served by the RCN have higher barriers to information, resources, and services than larger urban communities. To reduce this gap, the PIs propose to develop need-based R&D pipelines to select solutions with the highest potential impacts to the communities. Instead of trying to connect under-connected communities to nearby large cities, this proposal aims to develop economic opportunities within the communities themselves. This topic aligns well with the vision of the SCC program, and the proposed RCN consists of a diverse group of researchers, communities, industry, government, and non-profit partners.
This award will support the development of an RCN within the Commonwealth of Virginia which will coordinate multiple partners in developing innovations utilizing smart and connected technologies. The goal of the research coordination network is to enable researchers and citizens to collaborate on research supporting enhanced quality of life for medium, small, and rural communities which frequently lack the communication and other infrastructure available in cities. The research coordination network will be led by the University of Virginia. There are 14 partner organizations including six research center partners in transportation, environment, architecture and urban planning, and engineering and technology; two State and Industry partners (Virginia Municipal League and Virginia Center for Innovative Technology); four community partners representing health services (UVA Center for Telemedicine), small and remote communities (Weldon Cooper Center), neighborhood communities (Charlottesville Neighborhood Development), and urban communities (Thriving Cities); and two national partners which support high speed networking (US-Ignite) and city-university hubs (MetroLab). Examples of research coordination include telemedicine services, transportation services, and user-centric and community-centric utilization and deployment of sensor technologies.
DATE:
-
TEAM MEMBERS:
Ila BermanT. Donna ChenKaren RheubanQian Cai
To reach its full potential in science, technology, engineering, and mathematics (STEM), the United States must continue to recruit, prepare and maintain a diverse STEM workforce. Much work has been done in this regard. Yet, underrepresentation in STEM fields persists and is especially pronounced for Hispanic STEM professionals. The Hispanic community is the youngest and fastest growing racial/ethnic group in the United States but comprises only seven percent of the STEM workforce. More evidence-based solutions and innovative approaches are required. This project endeavors to address the challenges of underrepresentation in STEM, especially among individuals of Hispanic descent, through an innovative approach. The University of San Diego will design, develop, implement, and test a multilayered STEM learning approach specific to STEM learning and workforce development in STEM fields targeting Hispanic youth. The STEM World of Work project will explore youth STEM identity through three mechanisms: (1) an assessment of their individual interests, strengths, and values, (2) exposure to an array of viable STEM careers, and (3) engagement in rigorous hands-on STEM activities. The project centers on a youth summer STEM enrichment program and a series of follow-up booster sessions delivered during the academic year in informal contexts to promote family engagement. Paramount to this work is the core focus on San Diego's Five Priority Workforce Sectors: Advanced Manufacturing, Information and Communications Technology, Clean Energy, Healthcare, and Biotech. Few, if any, existing projects in the Advancing Informal STEM learning portfolio have explored the potential connections between these five priority workforce sectors, informal STEM learning, and identity among predominately Hispanic youth and families engaged in a year-long, culturally responsive STEM learning and workforce focused program. If successful, the model could provide a template for the facilitation of similar efforts in the future.
The STEM World of Work project will use a mixed-methods, exploratory research design to better understand the variables influencing STEM learning and academic and career choices within the proposed context. The research questions will explore: (1) the impacts of the project on students' engagement, STEM identity, STEM motivation, and academic outcomes, (2) factors that moderate these outcomes, and (3) the impact the model has on influencing youths' personal goals and career choices. Data will be garnered through cross-sectional and longitudinal surveys and reflective focus groups with the students and their parents/guardians. Multivariate analysis of variance, longitudinal modeling, and qualitative analysis will be conducted to analyze and report the data. The findings will be disseminated using a variety of methods and platforms. The broader impacts of the findings and work are expected to extend well beyond the project team, graduate student mentors, project partners, and the estimated 120 middle school students and their families from the predominately Hispanic Chula Vista Community of San Diego who will be directly impacted by the project.
This exploratory pathways project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Perla MyersVitaliy PopovOdesma DalrympleYaoran LiJoi Spencer
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. The project will bring together science museum visitor experience developers, visitor studies staff, indoor location technology developers, cyber-learning researchers, and STEM informal learning specialists for a two day conference, COMPASS (Conference on Mobile Position Awareness Systems and Solutions), to address the achievements and potential of indoor location aware mobile (ILAM) technology in science museums. The pre-conference work, the conference itself, and a subsequent e-publication will provide multiple, informed perspectives and knowledge around ILAM for science museums to develop apps for visitors' own smartphones to enhance and personalize the visitor experience and to experiment with new kinds of inquiry-based learning. The goals of the conference are to form an integrated vision by consolidating expertise from disparate disciplines connected to ILAM tech development, to transform visitor mobile tools to provide more innovative forms of interaction and personalization, and to open new avenues for visitor research with automated data collection and analysis.
The COMPASS conference will bring together 80 participants for two days in September 2018 at the Exploratorium in San Francisco, CA. The first dissemination will take place in a presentation at the ASTC conference the following month in October 2018. A webinar sharing insights from COMPASS and inviting others to engage will be held in March 2019 hosted by ASTC and accessible by ASTC members and non-members alike. A companion COMPASS e-publication will be released for free download, also in March 2019, with summaries of conference proceedings, key issues identified, case histories of ILAM in museums, white papers and other resources. Conference outcomes include establishing a community of practice or special interest group and establishing common goals for future collaborative work. By gathering a diverse range of perspectives and expertise to share research and evidence based findings, COMPASS include collective problem solving and an informed cross disciplinary approach to planning and implementing ILAM technology in the museum environment. The conference will explicitly address the benefits and quality of open source code and protocols and how techniques could be shared among institutions. As professional experience with deploying ILAM apps grows, this tool could be used to increase accessibility for diverse visitor populations, put in use at smaller and medium sized science centers, and applied to a variety of research studies, increasing the impact for funders and benefiting the science center community at large.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. This study will capitalize on the increased availability and affordability of immersive interactive technologies, such as Augmented Reality devices and virtual characters, to investigate their potential for benefitting STEM learning in informal museum contexts. This project will combine these technologies to create an Augmented Reality experience that will allow middle-school youth and their families to meet and assist a virtual crew on a historic ship at the Independence Seaport Museum in Philadelphia. The players in this game-like experience will encounter technologies from the turn of the 20th century, including steam power, electricity, and wireless communication. Crew members and technologies will be brought to life aboard the USS Olympia, the largest and fastest ship in the US Navy launched in 1892. The historic context will be positioned in relation to current day technologies in ways that will enable a change in interest towards technology and engineering in middle school-age youth. This will result in a testbed for the feasibility of facilitating short-term science, technology, engineering and mathematics (STEM) identity change with interactive immersive technologies. A successful feasibility demonstration, as well as the insights into design, could open up novel ways of fostering STEM interest and identity in informal learning contexts and of demonstrating the impact of this approach. The potential benefit to society will rest in the expected results on the basic science regarding immersive interactive technologies in informal learning contexts as well as in demonstrating the feasibility of the integrated approach to assessment.
This project will use a living lab methodology to evaluate interactive immersive technologies in terms of their support for STEM identity change in middle-school age youth. The two-year design-based research will iteratively develop and improve the measurement instrument for the argument that identity change is a fundamental to learning. A combination of Augmented Reality and intelligent virtual agents will be used to create an interactive experience--a virtual living lab--in an informal museum learning exhibit that enables change interests towards technology and engineering and provides short-term assessment tools. In collaboration with the Independence Seaport Museum in Philadelphia, the testbed for the approach will be an experience that brings to life the technologies of the early 20th century aboard a historic ship. Through the application of Participatory Action Research techniques, intelligent virtual agents interacting with youth and families will customize STEM information relating to the ship's mission and performance. Topics explored will make connections with current day technologies and scientific understanding. Mixed-methods will be used to analyze interactions, interview and survey data, will form the basis for assessing the impact on youth's STEM interests. The elicitation method specifically includes assessment metrics that are relevant to the concept of learning as identity change. This assessment, through immersive interactive technologies, will target the priority areas of engagement in STEM as well as the measurement of outcomes.
DATE:
-
TEAM MEMBERS:
Stefan RankAyana AllenGlen MuschioAroutis FosterKapil Dandekar
How do afterschool programs view their local public libraries? Are they working with them, and in what ways? These are the questions that the Afterschool Alliance, along with its partners at the Space Science Institute’s National Center for Interactive Learning (NCIL) and the American Library Association, wanted to answer. Overall, our goal is to build bridges between the afterschool and library fields, so that both can share knowledge and resources to better serve our youth. While our work together has primarily focused on science, technology, engineering, and math (STEM) education through
Multitouch tables and displays provide important benefits for users in museums and other public spaces. This report discusses the evolution of tangible-object interfaces on such displays and outlines ideas for further development of more compelling, intuitive, and effective user experiences.
The FIRST Longitudinal Study is a multi-year longitudinal study assessing the impacts of FIRST’s afterschool robotics programs on the STEM related interests and educational and career trajectories of program participants. FIRST is one of the nation’s largest after-school robotics programs, serving more than 460,000 youth aged 6-18 annually through the FIRST LEGO League (Ages 7-14), the FIRST Tech Challenge (grades 7-12) and the FIRST Robotics Competition (grades 9-12). The study is tracking over 1200 program participants and comparison students, using a quasi-experimental design, over a
DATE:
TEAM MEMBERS:
Alan MelchiorCathy BurackMatthew HooverJill Marcus