Through Project BUILD, a STAR Library Network (STAR Net) program funded by the National Science Foundation, the American Society of Civil Engineers (ASCE) and the Space Science Institute’s National Center for Interactive Learning (NCIL) offered the virtual Dream, Build, Create program which consisted of (1) the award-winning documentary Dream Big: Engineering Our World and (2) five live-streamed panels of diverse engineers (Dream Teams) who shared their stories of what it means to be an engineer.
The external evaluation, conducted by Education Development Center (EDC), aimed to examine how
While there is increased interest in youth-centered maker programs in informal educational contexts, scarce research-informed professional development exist that focus on how informal educators do or should plan and handle ongoing, just-in-time support during moments of failure. Prior research supports the important role of failure in maker programming to increase learning, resilience and other noncognitive skills such as self-efficacy and independence. The objective of this project is to address this gap through adapting, implementing, and refining a professional development program for informal educators to productively attend, interpret, and respond to youths’ experiences with failure while engaged in maker programs in informal learning contexts. In the first two years of the project, the research team will work closely with six partners to implement and refine the professional development model: The Tech Museum of Innovation, The Bakken Museum, Montshire Museum of Science, The Minneapolis Institute of Art, Thinkery, and Amazeum Children’s Museum. In the last year of the project, the team will scale-up the professional development model through partnering with an additional nine institutions implementing maker programming for youth. The professional development consists of two models. In the first model, we support one to two lead facilitators at each partnering institution through an initial three-day workshop and ongoing support meetings. In the second model, the lead facilitators support other informal educators at their institution implementing making programs for youth. This project will enhance the infrastructure for research and education as collaborations and professional learning communities will be established among a variety of informal learning institutions. The project will also demonstrate a link between research and institutional and societal benefits through shifting the connotation and perceptions of failure to be valued for its educational potential and to empower informal educators to support discomfort and struggle throughout maker programs with youth.
The three goals of this collaborative project are to (a) advance the field of informal education through a research-based professional development program specific to youths’ failures during maker programs; (b) support shifts in informal educators’ facilitation practices and perspectives around youth’s failure experiences, and (c) investigate the effects of the professional development on youths’ resilience and failure mindset. The iterative nature of this project will be informed by the collection and analysis of video data of professional development sessions and informal educators facilitating maker programs, reflective journaling, surveys regarding the professional development, and pre-post surveys from youth engaged in the maker programs. Dissemination will address multiple stakeholders, including informal educators, program developers, evaluators, researchers, and public audiences.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Makerspaces are learning environments that engage participants in authentic science and engineering practices, using hands-on and collaborative approaches to support activities and projects that foster creativity, interest, and skill development. Recently there has been a rapid growth of makerspaces in schools and in informal places like museums, libraries, and community centers. However, many of these spaces are not accessible to all members of society. This project will produce a model for a STEM makerspace that focuses on increasing access. The model has four critical components that operate together: affordable housing, informal STEM learning, maker education, and multi-generational learning. This project will develop and study the community-based, multigenerational makerspace model for Bayview Towers, a 200-unit affordable housing complex in Connecticut. The Multi-Gen STEM Makerspaces project brings together CAST, a non-profit education research organization, the NHP Foundation/Operation Pathways, a national affordable housing provider, and the Boston University Social Learning Lab, which researches the social context for STEM learning. The project will produce a Multi-Gen Maker Playbook comprised of an educational guide for a series of four-week workshops around different themes and modes of making. The Playbook will also serve as a program model that guides similar communities on how to create and run sustainable and thriving maker programs of their own. Families in the Bayview Towers community will build an understanding of science, technology, engineering, and mathematics (STEM) concepts through participation in an onsite makerspace. Families will relate what they are doing through making to longer-term goals connected to STEM learning, education, and careers. The project will also enable the engagement of individuals in the co-design (individuals provide creative contributions) of making that can be translated into community structures and values that support a sustainable makerspace. The affordable housing context will provide understanding of individual and other social factors that impact learners' sense of STEM identity. The project will support mobility from poverty by including STEM learning as part of the resident services.
The research will examine how low income communities access, engage, and learn in makerspaces, and relate their learning to relevant goals. The team will use design-based research (DBR) whereby participants and researchers work together to design interventions intended to explore theory through cycles of enactment, analysis, and revision. The DBR research will answer the following questions:
In what ways, if any, does the model support residents experiencing STEM learning as consequential?
What kind of making goals do residents set and how do they embed STEM in these goals?
If residents experience STEM learning as consequential through the workshops, do they also see the relationship between their making goals and longer term goals?
Do those residents that use the makerspace more frequently experience more positive outcomes in terms of consequential STEM learning?
How do the various makerspace structures - training of facilitators, dedicated space and equipment, Playbook - support the model?
Are groups of residents participating regularly in the makerspace and if so, who is in these groups? Do these groups start to identify as a maker community? Is the community finding the makerspace of value?
In what ways does the organization and operations of the makerspace support building a sustainable model for multigenerational and consequential learning?
Participants will include 90 youth and 90 adults from the resident community at Bayview Towers. Research data to be collected includes open-ended response measures for scoring residents' interpretation, analysis and understanding of each workshop elements. Also, interview protocols will be used to guide the refinement of the Multi-Gen Maker Playbook features and analyze usability, feasibility, engagement and user experience of the Multi-Gen Maker Playbook within the platform. The program will use semi-structured interview protocols on participants' goals and STEM identity and focus group protocols on community maker values and makerspace structures. Additionally, a Likert-style survey on STEM identity will also be adapted from the Science Identity Scale. Project evaluation will examine the overall achievement of program goals and objectives. Project results will be communicated by traditional means of dissemination to scholars and practitioners. The team will also create targeted digital media, including online articles, podcast interviews, and blog posts, to reach a broader audience.
This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Sam Catherine JohnstonKathleen CorriveauJess GropenKim DucharmeKenneth White
Research shows that algebra is a major barrier to student success, enthusiasm and participation in STEM for under-represented students, particularly African-American students in under-resourced high schools. Programs that develop ways to help students master algebra concepts and a belief that they can perform algebra may lead to more students entering engineering careers. This project will provide an online engineering program to support 9th and 10th grade Baltimore City Public Schools students, a predominantly low-income African-American cohort, to develop concrete goals of becoming engineers. The goals of the program are to help students with a growing interest in engineering to maintain that interest throughout high school. The project will also support students aspire to an engineering career. The project will develop in students an appreciation of requisite courses and skills, and increase self-efficacy in mathematics. The project will also develop a replicable model of informal education capable of reinforcing the mathematical foundations that students learn during the school day. Additionally, the project will broaden participation in engineering by being available to students during out-of-school time and by having relaxed entrance criteria compared to existing opportunities in supplemental engineering curricula. The project is a collaboration between the Baltimore City Public Schools, Johns Hopkins University Applied Physics Laboratory, Northrop Grumman Corporation, and Expanded School-Based Mental Health programs to support students both during and after participation. The project will benefit society by providing skills that will allow high school students to become members of tomorrow's highly trained STEM workforce.
The research will test whether an informal, scaffolded online algebra-for-engineering program increases students' mastery and self-efficacy in mathematics. The research will advance knowledge regarding informal education by applying Social Cognitive Career Theory as a framework for measuring program impact. The theoretical framework will aid in identifying mechanisms through which students with interest in engineering might persist in maintaining this interest through high school via algebra skill mastery and increased self-efficacy. The project will recruit 200 youth from the Baltimore City Public Schools to participate in the project over three years. Qualitative data will be collected to assess how student and school socioeconomic factors impact implementation, student engagement, and outcomes. The research will answer the following questions: 1) What effect does program participation have on math mastery? 2) What direct and indirect effects do program completion and supports have on students' mathematics self-efficacy? 3) What direct and indirect effects do program components have on engineering career goals by the end of the program? 4) What direct and indirect effects does math self-efficacy have on career goals? 5) To what extent are the effects of program participation on engineering career goals mediated by math self-efficacy and engineering interest? 6) How do school factors relate to the implementation of the program? 7) What socioeconomic-related factors relate to the regularity and continuation of student participation in the program? The quantitative methods of data analysis will employ descriptive and multivariate statistical methods. Qualitative data from interviews will be analyzed using an emergent approach and a coding scheme guided by theoretical constructs. Project results will be communicated to scholars and practitioners. The team will also share information through school newsletters and parent communication through Baltimore City Public Schools.
This project is funded by the Innovative Technology Experiences for Students and Teachers (ITEST) program, which supports projects that build understandings of practices, program elements, contexts and processes contributing to increasing students' knowledge and interest in science, technology, engineering, and mathematics (STEM) and information and communication technology (ICT) careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
Making, which supports interest-driven skill-development and learning, has been recognized as having the potential to engage underserved youth in STEM. Makerspaces are community spaces that allow participants to create items using tools, such as 3-D printers, computer-aided design, and digital fabrication technologies. Makerspaces and making-related programs are often inaccessible, unaffordable, or simply not available to underserved youth. Digital Harbor will partner with recreation centers, two in Pittsburgh and two in Baltimore, to research, refine and implement an equity-based approach to making that will engage underserved youth aged 12-16 in making. The project will prepare out-of-school time (OST) educators to collaboratively develop culturally sensitive curricula with underserved youth to engage them in maker-based technology and computer science experiences. The project will (1) design a professional development program that will prepare and support local educators to collaboratively design and deliver localized, maker-based, STEM curricula; (2) research the impact of these programs on both educators' and youth's self-efficacy, creativity, and attitudes towards STEM; and (3) develop and evaluate an online Localization Toolkit that will prepare educators in makerspaces across the nation in using an equity-based approach to create localized content. The project will result in four new maker sites (two in Baltimore and two in Pittsburgh directly impact 4 sites (10 educators and 240 youth). The project will result several resources that will support the development and educational programs of other community sites. The resources will include the Localization Toolkit, Case Studies, Best Practices, and Research Study. The Localization Toolkit has the potential to strengthen infrastructure and capacity building in OST maker-based programs, as well as other informal and formal education programs using similar pedagogies and design principles.
The project will use a mixed-methods approach in researching the challenges and processes involved in establishing the four maker sites in Baltimore and Pittsburgh, the approaches and effectiveness of the professional development program on OST educators, and the impacts of the project of participation on the self-efficacy, creativity, and attitudes on participating youth and educators. The research study will apply several instruments and data collection sources to develop quantitative data, including youth attendance logs, the Upper Elementary and Middle/High School Student Attitudes toward STEM survey, a retrospective technology self-efficacy survey and pre-post surveys. In addition to project document review, the researchers will collect qualitative data through educator interviews, educator focus groups, and youth focus groups. Project research and resources will reach key audiences of learning scientists and OST educators through articles in peer-reviewed and practitioner journals, public events and professional conferences. These audiences will also be reached through the project website, which will share project resources. The project will reach OST sites across the country directly through dissemination partners, including the National Recreation and Parks Association, Association of Science and Technology Centers, and statewide out-of-school networks.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Virtual Reality (VR) shows promise to broaden participation in STEM by engaging learners in authentic but otherwise inaccessible learning experiences. The immersion in authentic learner environments, along with social presence and learner agency, that is enabled by VR helps form memorable learning experiences. VR is emerging as a promising tool for children with autism. While there is wide variation in the way people with autism present, one common set of needs associated with autism that can be addressed with VR is sensory processing. This project will research and model how VR can be used to minimize barriers for learners with autism, while also incorporating complementary universal designs for learning (UDL) principles to promote broad participation in STEM learning. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings. This project will build on a prototype VR simulation, Mission to Europa Prime, that transports learners to a space station for exploration on Jupiter's moon Europa, a strong candidate for future discovery of extraterrestrial life and a location no human can currently experience in person. The prototype simulation will be expanded to create a full, immersive STEM-based experience that will enable learners who often encounter cognitive, social, and emotional barriers to STEM learning in public spaces, particularly learners with autism, to fully engage and benefit from this STEM-learning experience. The simulation will include a variety of STEM-learning puzzles, addressing science, mathematics, engineering, and computational thinking through authentic and interesting problem-solving tasks. The project team's learning designers and researchers will co-design puzzles and user interfaces with students at a post-secondary institute for learners with autism and other learning differences. The full VR STEM-learning simulation will be broadly disseminated to museums and other informal education programs, and distributed to other communities.
Project research is designed to advance knowledge about VR-based informal STEM learning and the affordances of VR to support learners with autism. To broaden STEM participation for all, the project brings together research at the intersection of STEM learning, cognitive and educational neuroscience, and the human-technology frontier. The simulation will be designed to provide agency for learners to adjust a STEM-learning VR experience for their unique sensory processing, attention, and social anxiety needs. The project will use a participatory design process will ensure the VR experience is designed to reduce barriers that currently exclude learners with autism and related conditions from many informal learning opportunities, broadening participation in informal STEM learning. Design research, usability, and efficacy studies will be conducted with teens and adults at the Pacific Science Center and Boston Museum of Science, which serve audiences with autism, along with the general public. Project research is grounded in prior NSF-funded research and leverages the team's expertise in STEM learning simulations, VR development, cognitive psychology, universal design, and informal science education, as well as the vital expertise of the end-user target audience, learners with autism. In addition to being shared at conferences, the research findings will be submitted for publication to peer-reviewed journals for researchers and to appropriate publications for VR developers and disseminators, museum programs, neurodiverse communities and other potentially interested parties.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Teon EdwardsJodi Asbell-ClarkeJamie LarsenIbrahim Dahlstrom-Hakki
Engaging with Tinkering is a highly stimulating and complex experience and invites rich reflections from museum practitioners and teachers. "Tinkering as an inclusive approach for building STEM identity and supporting students facing disadvantage or with low science capital” presents the reflective practice process and tools designed by the "Tinkering EU: Building Science Capital for All" project aiming to understand in more depth the potential impact of using a Tinkering approach with students facing disadvantage. Using tools specifically designed to help teachers observe their students
This front-end evaluation study is part of Designing Our Tomorrow: Mobilizing the Next Generation of Engineers, a five-year project (2018–2023) led by the Oregon Museum of Science and Industry (OMSI) with the support of the National Science Foundation (NSF, DRL-1811617) and project partners: Adelante Mujeres, the Biomimicry Institute, and the Fleet Science Center. The Designing Our Tomorrow (DOT) project seeks to promote and strengthen family engagement and engineering learning via compelling exhibit-based design challenges, presented through the lens of sustainable design exemplified by
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden their participation in STEM fields. The goals of the project include:
Contribute to the knowledge base of effective practices regarding informal STEM education for the blind, particularly relating to the development of spatial reasoning abilities.
Educate families, blind
Today’s digital and online media demand an approach to learning keyed to a networked and interconnected world. The growth of online communities, social and online media, open educational resources, ubiquitous computing, big data, and digital production tools means young people are coming of age with a growing abundance of access to knowledge, information, and social connection. These shifts are tied to a host of new opportunities for interest-driven learning, creative expression, and diverse forms of contribution to civic, political, and economic life. Even learning of traditional academic
One way to motivate young people from diverse backgrounds to pursue engineering careers is to enlist them as educators who can help the general public understand how engineers help respond to the challenges of everyday life. The New York Hall of Science, which serves a large and diverse audience, is an ideal setting for testing the promise of this strategy. Youth educators and curators of public programs at the Hall of Science will mentor two groups of high school- and early college-aged youth, who will contribute to the design and facilitation of engineering-focused events and activities for museum visitors. They will work together to develop engineering programming for the public that emphasizes the cultural and interpersonal dimensions of engineering practices. This group of young people will be recruited from the Hall of Science's more than 100 Explainers, a very diverse group of young people who work part-time at the Hall of Science and engage with visitors as they explore the museum. Researchers will track participants' experiences and document their impact on museum visitors' perceptions of engineering. The expectation is that creating and delivering these experiences for visitors will have a positive impact on the youth participants' understanding of the engineering disciplines, and on visitors' perceptions of engineering and its relationship to everyday life.
The project will use observations, interviews, journaling, and the Engineering Professional Skills Assessment to explore youth experience, and visitor exit surveys and interviews to probe visitor perceptions. Both the skills assessment and visitor surveys are NSF-funded instruments. Data coding will be grounded in the engineering habits of mind defined by the National Research Council's Committee on Understanding and Improving K-12 Engineering Education in the United States (2009). The project will capture evidence regarding which habits of mind the Fellows are most frequently engaged with. The effort will also explore how interactions with peers (as colleagues), with experts (as learners, such as with Designers in Residence) and with visitors (as teachers and leaders) may be associated with different combinations of the habits of mind over the course of the project. Visitor data and assessment data will allow the project to begin to make analytic connections between participating young people's increased understanding of culturally-situated engineering challenges, and their impact on the experiences of museum visitors who engage with engineering programming at the Hall of Science.
Research that seeks to understand classroom interactions often relies on video recordings of classrooms so that researchers can document and analyze what teachers and students are doing in the learning environment. When studies are large scale, this analysis is challenging in part because it is time-consuming to review and code large quantities of video. For example, hundreds of hours of videotaped interaction between students working in an after-school program for advancing computational thinking and engineering learning for Latino/a students. This project is exploring the use of computer-assisted methods for video analysis to support manual coding by researchers. The project is adapting procedures used for computer-aided diagnosis systems for medical systems. The computer-assisted process creates summaries that can then be used by researchers to identify critical events and to describe patterns of activities in the classroom such as students talking to each other or writing during a small group project. Creating the summaries requires analyzing video for facial recognition, motion, color and object identification. The project will investigate what parts of student participation and teaching can be analyzed using computer-assisted video analysis. This project is supported by NSF's EHR Core Research (ECR) program, the STEM+C program and the AISL program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. The project is funded by the STEM+Computing program, which seeks to address emerging challenges in computational STEM areas through the applied integration of computational thinking and computing activities within disciplinary STEM teaching and learning in early childhood education through high school (preK-12). As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The video analysis systems will provide video summarizations for specific activities which will allow researchers to use these results to quantify student participation and document teaching practices that support student learning. This will support the analysis of large volumes of video data that are often time-consuming to analyze. The video analysis system will identify objects in the scene and then use measures of distances between objects and other tracking methods to code different activities (e.g., typing, talking, interaction between the student and a facilitator). The two groups of research questions are as follows. (1) How can human review of digital videos benefit from computer-assisted video analysis methods? Which aspects of video summarization (e.g., detected activities) can help reduce the time it takes to review the videos? Beyond audio analytics, what types of future research in video summarization can help reduce the time that it takes to review videos? (2) How can we quantify student participation using computer-assisted video analysis methods? What aspects of student participation can be accurately measures by computer-assisted video analysis methods? The video to be used for this study is drawn from a project focused on engineering and computational thinking learning for Latino/a students in an after-school setting. Hundreds of hours of video are available to be reviewed and analyzed to design and refine the system. The resulting coding will also help document patterns of engagement in the learning environment.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Marios PattichisSylvia Celedon-PattichisCarlos LopezLeiva