Artificial Intelligence (AI), the research and development of machines to mimic human thought and behavior, encompasses one of the most complex scientific and engineering challenges in history. AI now permeates essentially all sectors of the economy and society. Young people growing up in the era of big data, algorithms, and AI need to develop new awareness, content knowledge, and skills to understand humans’ relationships with these new technologies and become producers of AI artifacts themselves.
YR Media and MIT’s Understanding AI project researched and developed innovative approaches to
Data science is ever-present in modern life. The need to learn with and about data science is becoming increasingly important in a world where the quantity of data is constantly growing, where one’s own data are often being harvested and marketed, where data science career opportunities are rapidly increasing, and where understanding statistics, data sources, and data representation is integral to understanding STEM and the world around us. Museums have the opportunity to play a critical role in introducing the public to data science concepts in ways that center personal relevance, social connections and collaborative learning. However, data science and statistics are difficult concepts to distill and provide meaningful engagement with during the brief learning experiences typical to science museums. This Pilot and Feasibility study brings together data scientists, data science educators, and museum exhibit designers to consider these questions:
What are the important data science concepts for the public to explore and understand in museum exhibits?
How can museum exhibits be designed to support visitors with diverse backgrounds and experiences to engage with these data science concepts?
What principles can shape these designs to promote broadening participation in data science specifically and STEM more broadly?
This Pilot and Feasibility project combines multidisciplinary expert convening, feasibility testing, and early exploratory prototyping around the focal topic of data science exhibits. Project partners, TERC, the Museum of Science, Boston, and The Tech Interactive in San Jose will engage in an iterative process to develop a theoretical grounding and practical guidance for museum practitioners. The project will include two convenings, bringing together teams of experts from the fields of data science, data science education and museum exhibit design. Prior to the first convening, an initial literature summary and a survey of convening participants will be conducted, culminating in a preliminary list of big ideas about data science. Periodically, participants will have the opportunity to rank, annotate and expand this list, as a form of ongoing data collection. During the convenings, participants will explore the preliminary list, share related work from the three disciplines, engage with related data science activities in small groups, and work together to build consensus around promising data science topics and approaches for exhibits. Participant evaluation will allow for iterative improvement of the convenings and the capture of missed points or overlooked topics. After each convening, museum partners will create prototypes that respond to the convening conversations. Prototypes will be pilot tested (evaluated) with an intentionally recruited group of families that includes both frequent visitors and those who are less likely to visit the museum; diversity in terms of race, languages and dis/ability will be reflected in selection. Pilot data collection will consist of structured observations and interviews. Results from the first round of prototyping will be shared with convening participants as a way to modify the list of big ideas and to further interrogate the feasibility of communicating these ideas in an exhibit format. Results from the convenings and from both rounds of prototyping will be combined in a guiding document that will be shared on all three partner websites, and more broadly with the informal STEM learning field. The team will also host a workshop for practitioners interested in designing data science exhibits, and present at a conference focused on museum exhibits and their design.
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Since 2006, the National High Magnetic Field Laboratory (MagLab) through the Center for Integrating Research and Learning (CIRL) has offered a SciGirls Summer Camp to introduce middle school girls to various fields of science. Code: SciGirls was created in 2017 to increase the engagement in computer science studies and career paths for girls. This consistent commitment to girls in STEM led the SciGirls creators at Twin Cities Public Television (TPT) to invite CIRL to be a partner with them. In the summer of 2021, CIRL & TPT
This poster was presented at the 2021 NSF AISL Awardee Meeting.
Collaborative robots – cobots – are designed to work with humans, not replace them. What learning affordances are created in educational games when learners program robots to assist them in a game instead of being the game? What game designs work best?
This poster was presented at the 2021 NSF AISL Awardee Meeting. Youth Radio (YR) Media is a national network of journalists, designers, developers and artists ages 14-24 who create media and technology that address key social issues — including, since 2019, A.I. through an ethics and equity lens. Participants are primarily youth of color and those contending with economic and other barriers to full participation in STEM.
The Ice Worlds media project will inspire millions of children and adults to gain new knowledge about polar environments, the planet’s climate, and humanity’s place within Earth’s complex systems—supporting an informed, STEM literate citizenry. Featuring the NSF-funded THOR expedition to Thwaites glacier, along with contributions of many NSF-supported researchers worldwide, Ice Worlds will share the importance of investments in STEM with audiences in giant screen theaters, on television, online, and in other informal settings. Primary project deliverables include a giant screen film, a filmmaking workshop for Native American middle school students that will result in a documentary, a climate storytelling professional development program for informal educators, and a knowledge-building summative evaluation. The project’s largest target audience is middle school learners (ages 11-14); specific activities are designed for Native American youth and informal science practitioners. Innovative outreach will engage youth underserved in science inspiring a new generation of scientists and investigative thinkers. The project’s professional development programs will build the capacity of informal educators to engage communities and communicate science. The Ice Worlds project is a collaboration among media producers Giant Screen Films, Natural History New Zealand, PBS, and Academy Award nominated film directors (Yes/No Productions). Additional collaborators include Northwestern University, The American Indian Science and Engineering Society, the Native American Journalism Association, a group of museum and science center partners, and a team of advisors including scientific and Indigenous experts associated with the NSF-funded Study of Environmental Arctic Change initiative.
The goals of the project are: 1) to increase public understanding of the processes and consequences of environmental change in polar ecosystems, 2) to explore the effectiveness of the giant screen format to impart knowledge, inspire motivation and caring for nature, 3) to improve middle schoolers’ interest, confidence and engagement in STEM topics and pursuits—broadly and through a specific program for Native American youth, and 4) to build informal educators’ capacity to share stories of climate change in their communities. The main evaluation questions are 1) to what extent does the Ice World film affect learning, engagement, and motivation around STEM pursuits and environmental problem solving 2) what is the added value of companion media for youth’s giant screen learning over short and longer term, and 3) what are the impacts of the culturally based Native American youth workshops.
The evaluation work will involve a Native American youth advisory panel and a panel of science center practitioners in the giant screen film’s development and evaluation process. Formative evaluation of the film will involve recruiting youth from diverse backgrounds, including representation of Native youth, to see the film in the giant screen theater of a partner site. Post viewing surveys and group discussions will explore their experience of the film with respect to engagement, learning, evoking spatial presence, and motivational impact. A summative evaluation of the completed film will assess its immediate and longer term impacts. Statistical analyses will be conducted on all quantitative data generated from the evaluation, including a comparison of pre and post knowledge scores. An evaluation of the Tribal Youth Media program will include a significant period of formative evaluation and community engagement to align activities to the needs and interests of participating students. Culturally appropriate measures, qualitative methods and frameworks will be used to assess the learning impacts. Data will be analyzed to determine learning impacts of the workshop on youth participants as well as mentors and other stakeholder participants. Evaluation of the community climate storytelling professional development component will include lessons learned and recommendations for implementation.
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).
Research shows that Black girls and women, regardless of their academic achievements and STEM interests, often encounter academic under-preparation, social isolation, exclusion, and race-gender discrimination that negatively impacts their ongoing engagement and retention in STEM. This project will provide innovative, culturally relevant learning environments to middle and high school Black girls to counter these negative trends. Using hands-on coding and robotics activities, project participants will develop positive attitudes toward science, technology, engineering, and mathematics (STEM). The project emphasizes peer-mentoring by providing opportunities for Black female high school (assistant coaches) and Black college students (coaches) to serve as counselors and mentors to participants. Additionally, engineers, scientists, and executives from STEM industries will serve as mentors and share their experiences to broaden participants’ STEM career aspirations. The project is a three-year collaborative effort between the University of California Davis C-STEM Center, the Umoja Community Education Foundation, and the 66 affiliated California community colleges, industry partners, and school districts in California. Over three years, nearly 2,000 females will participate in the project.
Learning environments for Black girls and women led by other Black girls and women are referred to as “counterspaces” where they are free to engage in STEM in ways that value their identities while promoting STEM engagement, interests, and career aspirations. The project’s curriculum will follow a research-based, culturally relevant multi-tiered mentoring approach. The curriculum is designed to develop participants’ STEM content knowledge, critical thinking, and logical reasoning capabilities through meaningful connections to real-life applications using hands-on coding and robotics. A mixed-method longitudinal study will examine the impact on participants’ STEM outcomes, emphasizing contributing new knowledge on the viability of multi-tiered, culturally relevant mentoring for increasing equity in informal STEM learning (ISL). The program's effectiveness will be evaluated using longitudinal assessments of mathematics standards, computer science and robotics conceptual knowledge, logical and critical thinking skills, STEM school achievements, interests and attitudes toward STEM subjects, advanced STEM course-taking, involvement in other ISL opportunities, and leadership in STEM in one’s school/university and community. The project will test a locally based informal learning model with projects hosted by other K-12 and college partners.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Wireless radio communications, such as Wi-Fi, transmit public and private data from one device to another, including cell phones, computers, medical equipment, satellites, space rockets, and air traffic control. Despite their critical role and prevalence, many people are unfamiliar with radio waves, how they are generated and interact with their surroundings, and why they are the basis of modern communication and navigation. This topic is not only increasingly relevant to the technological lives of today’s youth and public, it is critical to the National Science Foundation’s Industries of the Future activities, particularly in advancing wireless education and workforce development. In this project, STEM professionals from academia, industry and informal education will join forces to design, evaluate, and launch digital apps, a craft-based toolkit, activity guides, and mobile online professional learning, all of which will be easily accessed and flexibly adapted by informal educators to engage youth and the public about radio frequency communications. Experiences will include embodied activities, such as physically linking arms to create and explore longitudinal and transverse waves; mobile experiences, such as augmented reality explorations of Wi-Fi signals or collaborative signal jamming simulations; and technological exploration, such as sending and receiving encrypted messages.
BSCS Science Learning, Georgia Tech, and the Children’s Creativity Museum (CCM) with National Informal STEM Education Network (NISE Net) museum partners will create pedagogical activity designs, digital apps, and a mobile online professional learning platform. The project features a rigorous and multipronged research and development approach that builds on prior learning sciences studies to advance a learning design framework for nimble, mobile informal education, while incorporating the best aspects of hands-on learning. This project is testing two related hypotheses: 1) a mobile strategy can be effective for supporting just-in-time informal education of a highly technical, scientific topic, and 2) a mobile suite of resources, including professional learning, can be used to teach informal educators, youth, and the general public about radio frequency communications. Data sources include pre- and post- surveys, interviews, and focus groups with a wide array of educators and learners.
A front-end study will identify gaps in public understanding and perceptions specific to radio frequency communications, and serve as a baseline for components of the summative research. Iterative formative evaluation will incorporate participatory co-design processes with youth and informal educators. These processes will support materials that are age-appropriate and culturally responsive to not only youth, with an emphasis on Latinx youth, but also informal educators and the broader public. Summative evaluation will examine the impact of the mobile suite of resources on informal educators’ learning, facilitation confidence and intentions to continue to incorporate the project resources into their practice. The preparation of educators in supporting public understanding of highly technological STEM topics can be an effective way for supporting just-in-time public engagement and interests in related careers. Data from youth and museum visitors will examine changes to interest, science self-efficacy, content knowledge, and STEM-related career interest. If successful, this design approach may influence how mobile resources are designed and organized effectively to impact future informal education on similarly important technology-rich topics. All materials will be released under Creative Commons licenses allowing for widespread sharing and remixing; research and design findings will be published in academic, industry, and practitioner journals.
This project is co-funded by two NSF programs: The Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.