This partnership project seeks to address the assessment needs of maker (sometimes called tinkering) spaces and relating programs that have opened in recent years in many science and children's museums across the country.
DATE:
-
TEAM MEMBERS:
Adam MalteseMindy PorterPrinda WanakuleKelli Paul
In this project, the Children's Museum of Pittsburgh in partnership with EdTogether, Spelman College, and the Warner School of Education at the University of Rochester will bring together these distinct domains of learning by working with youth and practitioners to conduct a systematic review of equity and belonging work in informal science learning.
The Science Museum of Minnesota (SMM) will collaborate with four community organizations serving Black, Indigenous, and People of Color (BIPOC) audiences to research and develop a novel outdoor makerspace that engages families in STEM learning. A makerspace is a place where people work together on creative, interest driven projects. In working with BIPOC families, the project addresses three forms of historical (and present day) exclusion of community participants, including participation in the design of informal learning experiences, participation in such activities, and overall engagement in STEM. The project aims to develop activities that foster STEM learning using natural materials in an outdoor makerspace, informed through robust collaboration with local communities. This project will result in an outdoor makerspace at SMM that will include 3-4 settings (approximately 2500 square feet total) that house and support multiple making activities in an outdoor context. The proposed work will contribute to advancing knowledge through exploring how BIPOC families define learning in makerspaces and how younger children can be fully engaged in family learning. The project will share the inclusive design and community collaboration practices developed through this work with other museums, maker educators, and other community organizations that can develop or expand their own outdoor makerspaces in ways that will respect and reflect BIPOC families’ perspectives.
BIPOC families will join museum staff as contributors in the development and iteration of an outdoor makerspace and collaborators in the development of generalized design principles and dissemination of the research. Visitor-captured video of engagement in the outdoor makerspace, surveys, and memos from design meetings with community partners serve as the foundation for the process of aligning design and development of outdoor informal science education spaces with community needs and values. All research activities will be guided by a culturally responsive research framework and use strategies to ensure the multicultural validity such as video meaning-making with family research participants and member-checking instruments, data analyses, and findings with Design Partners. Project research will address three questions: (1) What are the characteristics of family learning in an outdoor nature-situated makerspace, including how BIPOC families identify and describe STEM learning and how outdoor spaces can be built to support BIPOC families’ perspectives? (2) How can the space be built to support multi-age families to engaged in making, including a focus on what design elements support preschool learner’s engagement and sustained participation by other family members? and (3) How do the design principles for making with widely available materials translate from indoor to outdoor spaces and materials? Research findings, design principles and community engagement guides will be widely disseminated to researchers, designers, program developers, informal science institutions and community organizations.
The project will develop and research an after-school program designed to engage rural, Latinx youth in design thinking and math through making. Making is a learner-centered environment where participants design, create, and develop projects. Latinx individuals are underrepresented in the STEM workforce. The project will engage Latinx youth during the critical middle school years when young people make choices that affect their futures. The project will work with community members, after school staff, and youth as co-designers to develop and pilot the complete after school program. The program will involve Latinx youth who live in the agricultural regions of the Southwest United States with the goal of developing agency and positive identity, as makers, mathematical doers and users, and active community members. They will engage in developmentally appropriate mathematics, such as the volume and surface area of geometric shapes, within the context of informal learning projects. The program will comprise four semester-long after school projects, involving participants for 2-4 hours each week, during which time youth will design and create objects to address typical community challenges. Each project will incorporate smaller modules to enable youth with different attendance needs to participate. Real community problems (e.g., drought) and solution paths (e.g., water catchment system) will motivate the making and the mathematics. The program, co-designed in partnership with the Cesar Chavez Foundation, promises to reach 100,000 youth over the next decade. Because the program can serve as a model for others with similar goals, this reach has the potential to be expanded in many other communities.
Project research will address a gap in the current literature on mathematics, making, and community membership. The project connects community mathematics—the rich mathematical knowledge and practices drawn from communities—to educational making to both enrich understanding of school mathematics and aid in developing students’ positive mathematical and cultural identities. The project will also result in a model of professional development that can be used and studied by after school programs and researchers, contributing to the limited body of knowledge of professional development on STEM making for after school facilitators. The research design for this project will follow a mixed methods approach where quantitative and qualitative data collection and analysis will occur simultaneously. Results of both strands will be brought together at the interpretation and reporting level to compare and bring out the convergence, divergence, or complementarity of findings. The research will take place in two stages (co-design and pilot) over 3 years, with an additional half year for developing communications of the findings. Research will address the following questions: (1) What are the key features of projects for integrating community mathematics, school mathematics understanding, and design/making? (2) How do facilitators support the youth in engaging in program activities? (3) What math content and practices do youth learn through participation in program activities? and (4) How do youth’s agency and identity as makers, mathematics doers and users, and community members change with participation in the program? Program research and resources will be disseminated nationally through the Cesar Chavez Foundation and by sharing project research and resources through publications and conference presentations reaching researchers, educators, and program developers.
This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
This project continues the work of "Tinkering EU: Contemporary Education for Innovators of Tomorrow" that introduced Tinkering methodology in Europe. It also builds upon the work of "Tinkering EU: Building Science Capital for ALL" that explored Tinkering and Science Capital with a specific focus on teachers and students from disadvantaged communities. "Tinkering EU: Addressing the Adults" focusses on fostering the socio-educational and personal development of adults.
Tinkering, inspired by the USA-based experience of the Exploratorium of San Francisco, is proven to be a powerful tool that contributes to the improvement of key competences and skills, and connects science knowledge and skills with the requirements of the contemporary labour market.
The project aims to foster the socio-educational and personal development of adults, as well as their participation in civic and social life, focusing on the following priorities:
Stronger science engagement
Need for 21st Century skills
Low science capital
Coordinator: NEMO Science Museum - The Netherlands
Partners:
National Museum of Science and Technology Leonardo da Vinci – Italy
University of Cambridge – UK
Science Center Network – Austria
Traces – France
Centrum Nauki Kopernik – Poland
Maker education has increased tremendously in community settings and classrooms across the country. Maker education is learner-driven and hands-on, often collaborative, and may focus on solving a problem or designing an object or device. There is a growing need for assessment and evaluation tools and approaches to understand and improve the nature of maker learning and provide evidence for the value of maker pedagogy. This workshop will bring together approximately 25 researchers from formal and informal settings as well as practitioners to review current maker assessment and evaluation tools and examine the role those tools can play for informing research and practice. The workshop will identify areas where future work is needed, including designing assessment and evaluation that effectively addresses the interests and needs of diverse learners. The workshop will disseminate an online collection of these assessment and evaluation tools, a research brief, and several webinars sharing the results and recommendations of the conference.
The two-day, in-person conference will include pre-workshop surveys to determine and refine issues for consideration at the conference, identify a core set of readings and resources for conference participants, and to identify key topics for research briefings presented at the conference. The conference will include background briefings, hands-on try-outs of assessment tools, synthesis discussions, and identification of future directions for research and next steps. Resources developed from the workshop will be widely disseminated through workshop partner Maker Education’s website, an annual maker conference held at the University of Wisconsin, and through other publications reaching researchers and practitioners in informal and formal educational settings,
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
For many youth, gaining access to quality STEM (science, technology, engineering mathematics) experiences is a challenge. Inequity and underrepresentation of youth of color in STEM persist. The makerspace movement holds great promise in broadening participation in STEM among youth from underrepresented communities. Makerspaces are defined as collaborative workspaces inside a library, school, or other community location designed for creating, learning, exploring, and sharing with high- to low-tech tools. Despite the availability of making programs focused on STEM activities targeted towards youth of color, the field has few models for designing these programs in ways that build upon youths’ cultural assets and desires for making. Working collaboratively with youth, families, and maker educators in Lansing, Michigan, and Greensboro, North Carolina, this project aims to deepen the field’s understanding about the rich and deep ingenuity in STEM-based making that youth from underrepresented communities can engage. These insights will be leveraged towards advancing community-based maker programming across four community-based makerspaces. The project will also build capacity among STEM-oriented maker educators, researchers, and youth. This model is important because the voices and perspectives of families and communities have been largely absent from the formative knowledge and theory-building processes of the field of makerspace education.
This project will build new knowledge about how and why youth and families make at home, in communities, and in STEM-based maker programs. Collaborators for the project include the University of Michigan, the University of North Carolina at Greensboro, and four STEM- and youth-oriented making spaces in Lansing, Michigan, and Greensboro, North Carolina. This project will take place in two phases, exploring two main research questions: 1) What are the learning results of making at home and in the community? And 2) How do youth organize community resources for sustained STEM making, and what facilitates or hinders such organization? Phase one investigates the community resources (people, tools, materials, knowledge, data, and spaces) youth leverage towards making and how they do so across time. The project will study how youth connect these resources to STEM-rich making and what youth and families learn in the process. In phase two, design-based research will be used to apply phase one insights to the design of community-based STEM-rich maker programs in four maker clubs in Michigan and North Carolina. This work will develop an understanding of youths’ family and community-based STEM-based making practices, including the community resources (people, tools, materials, knowledge, data, and spaces) that youth leverage.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Black Girls Create (BGC) is a program that uses maker pedagogy, social history (i.e., Black women’s contributions in STEM), culturally responsive pedagogy, and mentoring to engage Black girls in STEM. For the project, culturally responsive making is operationally defined as the use of cultural knowledge and maker technologies to create, design, and produce artifacts that are related to a particular concept, theme, or person. The project will conduct a feasibility research study that investigates how engagement in BGC affects participants' STEM interest, STEM confidence, and racial and gender identities. In the project, participants will discover how Black women have made an impact in STEM fields and will learn how to digitally create cultural artifacts/wearable art related to their discoveries. Approximately 120 middle school girls in grades 6-8 (8 groups of 15 participants each) from underserved neighborhoods will be recruited for participation in this two-year study. Each group will meet for 3 hours per week over an 8-week period. Instructional materials from this research will be made freely available online so that they can be adapted and used at other formal and informal educational institutions that seek to garner interest and access to STEM learning for Black girls and women.
A pre- and post-test, quasi-experimental design will be used to research the program’s influence on participants’ self-efficacy, racial identity, and gender identity. Lagged regression models that control for students’ age, race/ethnicity, and pre-survey scores will be used to examine growth in each of the four outcomes. Once all of the participants in the groups have completed BGC, data from all groups will be combined to increase power and thereby detect statistically meaningful differences in pre- and post-survey scores. In addition, variables representing attendance and program engagement will be entered into the model to examine whether students who are highly engaged in BGC programming exhibit more growth in the four outcomes. Qualitative data will be derived from students' journal entries as well as focus group interviews. Weekly journals will be used to gather data about the context and experiences of participants as they unfold throughout the program. Semi-structured focus groups will center around the usefulness of skills and knowledge gained from the program activities, significant experiences with peers and program staff, the opportunity to learn about Black women STEM progenitors, and learning how to make digitally fabricated artifacts. NVIVO, a computer software program, will be used as a tool to support the analysis of the rich, text-based information resulting from the journals and focus group narratives.
This feasibilty research project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
Many people with autism are unemployed and isolated because they do not have access to educational opportunities that support them in finding jobs that match their potential. This research seeks to empower adolescents with autism to seek out careers that are well-matched with their strengths and interests. Many people with autism are interested in computing, a marketable skill. This project builds from this interest by developing strategies to effectively engage teenagers with autism. Although people with autism share a diagnosis, each person is unique and has the capacity to become a visionary and transformer in society in their own way. Teenagers with autism will be invited to participate in a game design workshop hosted by an award-winning, not-for-profit Tech Kids Unlimited. Teenagers often enjoy learning how to design games and can learn many useful skills through design. During each workshop, teenagers will rate different teaching strategies using a picture-based survey developed in collaboration with people with autism. It is expected that teenagers with autism who have difficulty focusing to be most engaged by strategies that include multiple types of information (for example, pictures, text, and speech). The team also expects those who are more focused to be most engaged by strategies with fewer sources of information. By developing clear guidelines to help educators match their teaching styles to how different students learn, the project will help them engage youth more effectively. Through an iterative process, the team will revise the game design workshop to make it more engaging for people with different types of autism. New groups of teenagers with autism will participate in improved game design workshops that include an internship in a technology company. An important outcome is to understand which strategies are engaging for young people with autism that help them develop the belief in their skills needed to seek out fulfilling careers. This award is funded by the Advanced Informal STEM Learning program which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
This Research in Service to Practice project has the following aims: 1) Identify evidence-based strategies to engage youth with autism spectrum disorder (ASD) in informal STEM learning opportunities that are well matched to their attentional profiles, 2) Determine if engaging youth with ASD in informal STEM learning opportunities increases their STEM self-efficacy, and 3) Determine if engagement with STEM internship activities is associated with increased interest in STEM careers and career decision-making self-efficacy. Principles of Universal Design (UD) and Mayer's principles of effective multimedia instruction are frameworks employed to identify instructional strategies that are emotionally engaging for youth with diverse attentional profiles. The degree to which attentional differences contribute to different patterns of emotional engagement with informal STEM learning will be investigated. Guided by assessments of youth's engagement with different learning opportunities, 'diversity blueprints' or specific instructional strategies that help youth with diverse attentional profiles engage will be developed. After identifying strategies to engage neurodivergent (neurologically diverse) youth in informal STEM learning opportunities, the extent to which these strategies generalize to STEM internship sites will be explored. The team will study potential specificity of the types of contexts that promote different types of self-efficacy, with engagement with extracurricular STEM learning opportunities expected to preferentially target STEM self-efficacy while engagement with internships targets career decision-making self-efficacy. Although UD is often endorsed to promote STEM learning among students with disabilities, the proposed research would be the first iterative adaptation of instructional strategies designed to engage neurodivergent teens in informal STEM learning guided by a systematic analysis of how they engage with and feel about instructional strategies. Project deliverables include workshops for local after-school program providers, publications, a project website, and a multimodal guide of the process of developing 'diversity blueprints' and how to apply them for informal STEM educators and researchers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
There is a national need to expand opportunities to learn coding and computational thinking in informal science, technology, engineering, and mathematics (STEM) education. These skills are increasingly needed in STEM disciplines. As young people learn to code, they engage in computational thinking concepts and practices which are problem solving strategies that include repeated process (iterative) design skills. This project promotes innovation by designing and developing activities for tinkering spaces (a space filled with materials for hands-on exploration of STEM) combined with coding in informal learning organizations such as museums, and community centers. The project supports both tinkering and making as methods to meaningfully incorporate computational thinking in STEM learning experiences. The tinkering approach to learning is characterized by hands-on, trial and error engagement. Making is similar to tinkering with additional attention to learning with peer groups. The long-term goal of the project is to enable informal educators to engage in STEM programming with youth and families from underrepresented groups. The project brings together interdisciplinary teams from the Department of Information Science at the University of Colorado Boulder (CU Boulder), the Tinkering Studio at the Exploratorium, and the Lifelong Kindergarten research group at the Massachusetts Institution of Technology. In collaboration with local partner sites, the project team will design and disseminate a collection of six computational tinkering activity areas that engage learners in creative explorations using a combination of physical objects and computational code. The team will develop visual coding "microworlds" for each of the activity areas, specialized sets of coding blocks designed to provide scaffolding. Additionally, the project team will design and develop facilitation guides to document these activities and facilitation strategies, as well as workshops to better support facilitators in making and tinkering spaces.
The project enhances knowledge building through investigations of what instructional supports informal educators need to develop effective facilitation practices that engage underrepresented youth and families in STEM computational learning experiences. Study participants will include informal educators in museum, library, and community-based settings with varying backgrounds and experiences facilitating computing activities. The project team will also engage youth and families from underrepresented groups through collaborative efforts with community-based partners. Research questions include: 1) What challenges and barriers do informal learning educator, face to engage their learners in design-based activities with computing? 2) What supports informal learning educators to take on key facilitation practices that support children and families in computational tinkering activities? 3) In jointly engaging in these computational tinkering activities, how do the activities and informal learning educators? facilitation of these activities impact children's and families' development of computational tinkering and identities as creators and learners with computing? To answer these research questions the project will use qualitative ethnographic methods to study the developing interactions between learners and facilitators at three local sites. Comparative case studies of facilitators across the local partner sites will also be used to examine what supports facilitators to take on key facilitation practices. Data sources will include participant observation of facilitators and families, documentation in the form of photos, videos, and audio recordings, project artifacts, bi-monthly short surveys with reflective prompts, and interviews with facilitators and families.
This award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.