This partnership project seeks to address the assessment needs of maker (sometimes called tinkering) spaces and relating programs that have opened in recent years in many science and children's museums across the country.
DATE:
-
TEAM MEMBERS:
Adam MalteseMindy PorterPrinda WanakuleKelli Paul
The University of Montana spectrUM Discovery Area will implement “Making Across Montana” —a project to engage K–12 students and teachers in rural and tribal communities with making and tinkering. In collaboration with K–12 education partners in the rural Bitterroot Valley and on the Flathead Indian Reservation, the museum will develop a mobile making and tinkering exhibition and education program. The exhibition will be able to travel to K–12 schools statewide. The project team will develop a K–12 teacher professional development workshop, along with accompanying curriculum resources and supplies. The traveling program and related materials will build schools’ capacity to incorporate making and tinkering—and informal STEM experiences more broadly—into their teaching.
Imagination Station, Toledo’s Science Center, will implement Toledo Tinkers: Through a Child’s Eyes — a new initiative to address barriers to STEM education and promote a lifelong love of those subjects. An outreach curriculum and a mobile tinkering lab will help children ages 11–13 and their families establish personal connections with making and tinkering. Pilot programs will include the Maker Club — a 12-session out-of-school program for students from Boys and Girls Clubs of Toledo and other community-based organizations — as well as Tinkering Takeovers, which is a drop-in tinkering program for families at branch libraries. A community exhibition will showcase the diversity of the Toledo community and its rich history of making and tinkering, using the work of participating children.
The Science Museum of Minnesota (SMM) will collaborate with four community organizations serving Black, Indigenous, and People of Color (BIPOC) audiences to research and develop a novel outdoor makerspace that engages families in STEM learning. A makerspace is a place where people work together on creative, interest driven projects. In working with BIPOC families, the project addresses three forms of historical (and present day) exclusion of community participants, including participation in the design of informal learning experiences, participation in such activities, and overall engagement in STEM. The project aims to develop activities that foster STEM learning using natural materials in an outdoor makerspace, informed through robust collaboration with local communities. This project will result in an outdoor makerspace at SMM that will include 3-4 settings (approximately 2500 square feet total) that house and support multiple making activities in an outdoor context. The proposed work will contribute to advancing knowledge through exploring how BIPOC families define learning in makerspaces and how younger children can be fully engaged in family learning. The project will share the inclusive design and community collaboration practices developed through this work with other museums, maker educators, and other community organizations that can develop or expand their own outdoor makerspaces in ways that will respect and reflect BIPOC families’ perspectives.
BIPOC families will join museum staff as contributors in the development and iteration of an outdoor makerspace and collaborators in the development of generalized design principles and dissemination of the research. Visitor-captured video of engagement in the outdoor makerspace, surveys, and memos from design meetings with community partners serve as the foundation for the process of aligning design and development of outdoor informal science education spaces with community needs and values. All research activities will be guided by a culturally responsive research framework and use strategies to ensure the multicultural validity such as video meaning-making with family research participants and member-checking instruments, data analyses, and findings with Design Partners. Project research will address three questions: (1) What are the characteristics of family learning in an outdoor nature-situated makerspace, including how BIPOC families identify and describe STEM learning and how outdoor spaces can be built to support BIPOC families’ perspectives? (2) How can the space be built to support multi-age families to engaged in making, including a focus on what design elements support preschool learner’s engagement and sustained participation by other family members? and (3) How do the design principles for making with widely available materials translate from indoor to outdoor spaces and materials? Research findings, design principles and community engagement guides will be widely disseminated to researchers, designers, program developers, informal science institutions and community organizations.
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
For many youth, gaining access to quality STEM (science, technology, engineering mathematics) experiences is a challenge. Inequity and underrepresentation of youth of color in STEM persist. The makerspace movement holds great promise in broadening participation in STEM among youth from underrepresented communities. Makerspaces are defined as collaborative workspaces inside a library, school, or other community location designed for creating, learning, exploring, and sharing with high- to low-tech tools. Despite the availability of making programs focused on STEM activities targeted towards youth of color, the field has few models for designing these programs in ways that build upon youths’ cultural assets and desires for making. Working collaboratively with youth, families, and maker educators in Lansing, Michigan, and Greensboro, North Carolina, this project aims to deepen the field’s understanding about the rich and deep ingenuity in STEM-based making that youth from underrepresented communities can engage. These insights will be leveraged towards advancing community-based maker programming across four community-based makerspaces. The project will also build capacity among STEM-oriented maker educators, researchers, and youth. This model is important because the voices and perspectives of families and communities have been largely absent from the formative knowledge and theory-building processes of the field of makerspace education.
This project will build new knowledge about how and why youth and families make at home, in communities, and in STEM-based maker programs. Collaborators for the project include the University of Michigan, the University of North Carolina at Greensboro, and four STEM- and youth-oriented making spaces in Lansing, Michigan, and Greensboro, North Carolina. This project will take place in two phases, exploring two main research questions: 1) What are the learning results of making at home and in the community? And 2) How do youth organize community resources for sustained STEM making, and what facilitates or hinders such organization? Phase one investigates the community resources (people, tools, materials, knowledge, data, and spaces) youth leverage towards making and how they do so across time. The project will study how youth connect these resources to STEM-rich making and what youth and families learn in the process. In phase two, design-based research will be used to apply phase one insights to the design of community-based STEM-rich maker programs in four maker clubs in Michigan and North Carolina. This work will develop an understanding of youths’ family and community-based STEM-based making practices, including the community resources (people, tools, materials, knowledge, data, and spaces) that youth leverage.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Black Girls Create (BGC) is a program that uses maker pedagogy, social history (i.e., Black women’s contributions in STEM), culturally responsive pedagogy, and mentoring to engage Black girls in STEM. For the project, culturally responsive making is operationally defined as the use of cultural knowledge and maker technologies to create, design, and produce artifacts that are related to a particular concept, theme, or person. The project will conduct a feasibility research study that investigates how engagement in BGC affects participants' STEM interest, STEM confidence, and racial and gender identities. In the project, participants will discover how Black women have made an impact in STEM fields and will learn how to digitally create cultural artifacts/wearable art related to their discoveries. Approximately 120 middle school girls in grades 6-8 (8 groups of 15 participants each) from underserved neighborhoods will be recruited for participation in this two-year study. Each group will meet for 3 hours per week over an 8-week period. Instructional materials from this research will be made freely available online so that they can be adapted and used at other formal and informal educational institutions that seek to garner interest and access to STEM learning for Black girls and women.
A pre- and post-test, quasi-experimental design will be used to research the program’s influence on participants’ self-efficacy, racial identity, and gender identity. Lagged regression models that control for students’ age, race/ethnicity, and pre-survey scores will be used to examine growth in each of the four outcomes. Once all of the participants in the groups have completed BGC, data from all groups will be combined to increase power and thereby detect statistically meaningful differences in pre- and post-survey scores. In addition, variables representing attendance and program engagement will be entered into the model to examine whether students who are highly engaged in BGC programming exhibit more growth in the four outcomes. Qualitative data will be derived from students' journal entries as well as focus group interviews. Weekly journals will be used to gather data about the context and experiences of participants as they unfold throughout the program. Semi-structured focus groups will center around the usefulness of skills and knowledge gained from the program activities, significant experiences with peers and program staff, the opportunity to learn about Black women STEM progenitors, and learning how to make digitally fabricated artifacts. NVIVO, a computer software program, will be used as a tool to support the analysis of the rich, text-based information resulting from the journals and focus group narratives.
This feasibilty research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
While there is increased interest in youth-centered maker programs in informal educational contexts, scarce research-informed professional development exist that focus on how informal educators do or should plan and handle ongoing, just-in-time support during moments of failure. Prior research supports the important role of failure in maker programming to increase learning, resilience and other noncognitive skills such as self-efficacy and independence. The objective of this project is to address this gap through adapting, implementing, and refining a professional development program for informal educators to productively attend, interpret, and respond to youths’ experiences with failure while engaged in maker programs in informal learning contexts. In the first two years of the project, the research team will work closely with six partners to implement and refine the professional development model: The Tech Museum of Innovation, The Bakken Museum, Montshire Museum of Science, The Minneapolis Institute of Art, Thinkery, and Amazeum Children’s Museum. In the last year of the project, the team will scale-up the professional development model through partnering with an additional nine institutions implementing maker programming for youth. The professional development consists of two models. In the first model, we support one to two lead facilitators at each partnering institution through an initial three-day workshop and ongoing support meetings. In the second model, the lead facilitators support other informal educators at their institution implementing making programs for youth. This project will enhance the infrastructure for research and education as collaborations and professional learning communities will be established among a variety of informal learning institutions. The project will also demonstrate a link between research and institutional and societal benefits through shifting the connotation and perceptions of failure to be valued for its educational potential and to empower informal educators to support discomfort and struggle throughout maker programs with youth.
The three goals of this collaborative project are to (a) advance the field of informal education through a research-based professional development program specific to youths’ failures during maker programs; (b) support shifts in informal educators’ facilitation practices and perspectives around youth’s failure experiences, and (c) investigate the effects of the professional development on youths’ resilience and failure mindset. The iterative nature of this project will be informed by the collection and analysis of video data of professional development sessions and informal educators facilitating maker programs, reflective journaling, surveys regarding the professional development, and pre-post surveys from youth engaged in the maker programs. Dissemination will address multiple stakeholders, including informal educators, program developers, evaluators, researchers, and public audiences.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Makerspaces are learning environments that engage participants in authentic science and engineering practices, using hands-on and collaborative approaches to support activities and projects that foster creativity, interest, and skill development. Recently there has been a rapid growth of makerspaces in schools and in informal places like museums, libraries, and community centers. However, many of these spaces are not accessible to all members of society. This project will produce a model for a STEM makerspace that focuses on increasing access. The model has four critical components that operate together: affordable housing, informal STEM learning, maker education, and multi-generational learning. This project will develop and study the community-based, multigenerational makerspace model for Bayview Towers, a 200-unit affordable housing complex in Connecticut. The Multi-Gen STEM Makerspaces project brings together CAST, a non-profit education research organization, the NHP Foundation/Operation Pathways, a national affordable housing provider, and the Boston University Social Learning Lab, which researches the social context for STEM learning. The project will produce a Multi-Gen Maker Playbook comprised of an educational guide for a series of four-week workshops around different themes and modes of making. The Playbook will also serve as a program model that guides similar communities on how to create and run sustainable and thriving maker programs of their own. Families in the Bayview Towers community will build an understanding of science, technology, engineering, and mathematics (STEM) concepts through participation in an onsite makerspace. Families will relate what they are doing through making to longer-term goals connected to STEM learning, education, and careers. The project will also enable the engagement of individuals in the co-design (individuals provide creative contributions) of making that can be translated into community structures and values that support a sustainable makerspace. The affordable housing context will provide understanding of individual and other social factors that impact learners' sense of STEM identity. The project will support mobility from poverty by including STEM learning as part of the resident services.
The research will examine how low income communities access, engage, and learn in makerspaces, and relate their learning to relevant goals. The team will use design-based research (DBR) whereby participants and researchers work together to design interventions intended to explore theory through cycles of enactment, analysis, and revision. The DBR research will answer the following questions:
In what ways, if any, does the model support residents experiencing STEM learning as consequential?
What kind of making goals do residents set and how do they embed STEM in these goals?
If residents experience STEM learning as consequential through the workshops, do they also see the relationship between their making goals and longer term goals?
Do those residents that use the makerspace more frequently experience more positive outcomes in terms of consequential STEM learning?
How do the various makerspace structures - training of facilitators, dedicated space and equipment, Playbook - support the model?
Are groups of residents participating regularly in the makerspace and if so, who is in these groups? Do these groups start to identify as a maker community? Is the community finding the makerspace of value?
In what ways does the organization and operations of the makerspace support building a sustainable model for multigenerational and consequential learning?
Participants will include 90 youth and 90 adults from the resident community at Bayview Towers. Research data to be collected includes open-ended response measures for scoring residents' interpretation, analysis and understanding of each workshop elements. Also, interview protocols will be used to guide the refinement of the Multi-Gen Maker Playbook features and analyze usability, feasibility, engagement and user experience of the Multi-Gen Maker Playbook within the platform. The program will use semi-structured interview protocols on participants' goals and STEM identity and focus group protocols on community maker values and makerspace structures. Additionally, a Likert-style survey on STEM identity will also be adapted from the Science Identity Scale. Project evaluation will examine the overall achievement of program goals and objectives. Project results will be communicated by traditional means of dissemination to scholars and practitioners. The team will also create targeted digital media, including online articles, podcast interviews, and blog posts, to reach a broader audience.
This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Sam Catherine JohnstonKathleen CorriveauJess GropenKim DucharmeKenneth White
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
Making, which supports interest-driven skill-development and learning, has been recognized as having the potential to engage underserved youth in STEM. Makerspaces are community spaces that allow participants to create items using tools, such as 3-D printers, computer-aided design, and digital fabrication technologies. Makerspaces and making-related programs are often inaccessible, unaffordable, or simply not available to underserved youth. Digital Harbor will partner with recreation centers, two in Pittsburgh and two in Baltimore, to research, refine and implement an equity-based approach to making that will engage underserved youth aged 12-16 in making. The project will prepare out-of-school time (OST) educators to collaboratively develop culturally sensitive curricula with underserved youth to engage them in maker-based technology and computer science experiences. The project will (1) design a professional development program that will prepare and support local educators to collaboratively design and deliver localized, maker-based, STEM curricula; (2) research the impact of these programs on both educators' and youth's self-efficacy, creativity, and attitudes towards STEM; and (3) develop and evaluate an online Localization Toolkit that will prepare educators in makerspaces across the nation in using an equity-based approach to create localized content. The project will result in four new maker sites (two in Baltimore and two in Pittsburgh directly impact 4 sites (10 educators and 240 youth). The project will result several resources that will support the development and educational programs of other community sites. The resources will include the Localization Toolkit, Case Studies, Best Practices, and Research Study. The Localization Toolkit has the potential to strengthen infrastructure and capacity building in OST maker-based programs, as well as other informal and formal education programs using similar pedagogies and design principles.
The project will use a mixed-methods approach in researching the challenges and processes involved in establishing the four maker sites in Baltimore and Pittsburgh, the approaches and effectiveness of the professional development program on OST educators, and the impacts of the project of participation on the self-efficacy, creativity, and attitudes on participating youth and educators. The research study will apply several instruments and data collection sources to develop quantitative data, including youth attendance logs, the Upper Elementary and Middle/High School Student Attitudes toward STEM survey, a retrospective technology self-efficacy survey and pre-post surveys. In addition to project document review, the researchers will collect qualitative data through educator interviews, educator focus groups, and youth focus groups. Project research and resources will reach key audiences of learning scientists and OST educators through articles in peer-reviewed and practitioner journals, public events and professional conferences. These audiences will also be reached through the project website, which will share project resources. The project will reach OST sites across the country directly through dissemination partners, including the National Recreation and Parks Association, Association of Science and Technology Centers, and statewide out-of-school networks.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The goal of the National Science Foundation?s Research Coordination Network (RCN) program is to advance a field or create new directions in research or education by supporting groups of investigators to communicate and coordinate their research, training and educational activities across disciplinary, organizational, geographic and international boundaries. This RCN will bring together scholars and practitioners working at the intersection of equity and interdisciplinary making in STEM education. Making is a culture that emphasizes interest-driven learning by doing within an informal, peer-led and creative social environment. Hundreds of maker spaces and maker-oriented classroom pedagogies have developed across the country. Maker spaces often include digital technologies such as computer design, 3-D printers, and laser cutters, but may also include traditional crafts or a variety of artist-driven creations. The driving purpose of the project is to collectively broaden STEM-focused maker participation in the United States through pursuing common research questions, sharing resources, and incubating emergent inquiry and knowledge across multiple working sites of practice. The network aims to build capacity for research and knowledge, building in consequential and far-reaching mechanisms to leverage combined efforts of a core group of scholars, practitioners, and an extended network of formal and informal education partners in urban and rural sites serving people from groups underrepresented in STEM. Maker learning spaces can be particularly fruitful spaces for STEM learning toward equity because they foster interest-driven, collective, and community-oriented learning in making for social and community change. The network will be led by a team of multi-institutional and multi-disciplinary researchers from different geographic regions of the United States and guided by a steering committee of prominent researchers and practitioners in making and equity will convene to facilitate network activities.
Equitable processes are rooted in a commitment to understand and build on the skills, practices, values, and knowledge of communities marginalized in STEM. The research network aims to fill in gaps in current understandings about making and equity, including the many ways different projects define equity and STEM in making. The project will survey the existing research terrain to develop a dynamic and cohesive understanding of making that connects to learners' STEM ideas, communities, and historical ways of making. Additionally, the network will collaboratively develop central research questions for network partners. The network will create a repository for ethical and promising practices in community-based research and aggregate data across sites, among other activities. The network will support collaboration across a multiplicity of making spaces, research institutions, and community organizations throughout the country to share data, methodologies, ways of connecting to local communities and approaches to robust integration of STEM skills and practices. Project impacts will include new research partnerships, a dissemination hub for research related to making and equity, professional development for researchers and practitioners, and leveraging collective research findings about making values and practices to improve approaches to STEM-rich making integration in informal learning environments. The project is funded by NSF's Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of settings. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.