The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. There are few empirical studies of sustained youth engagement in STEM-oriented making over time, how youth are supported in working towards more robust STEM related projects, on the outcomes of such making experiences among youth from historically marginalized communities, or on the design features of making experiences which support these goals. The project plans to conduct a set of research studies to develop: a theory-based and data-driven framework for equitably consequential making; a set of related individual-level and program-level cases with exemplars (and the associated challenges) that can be used by researchers and practitioners for guiding the field; and an initial set of guiding principles (with indicators) for identifying equitably consequential making in practice. The project will result in a framework for equitably consequential making with guiding principles for implementation that will contribute to the infrastructure for fostering increased opportunities to learn among all youth, especially those historically underrepresented in STEM.
Through research, the project seeks to build capacity among STEM-oriented maker practitioners, researchers and youth in the maker movement around equitably consequential making to expand the prevailing norms of making towards more transformative outcomes for youth. Project research will be guided by several questions. What do youth learn and do (in-the-moment and over time) in making spaces that work to support equity in making? What maker space design features support (or work against) youth in making in equitably consequential ways? What are the individual and community outcomes youth experience in STEM-making across settings and time scales? What are the most salient indicators of equitably consequential making, how do they take shape, how can these indicators be identified in practice? The project will research these questions using interview studies and critical longitudinal ethnography with embedded youth participatory case study methodologies. The research will be conducted in research-practice partnerships involving Michigan State University, the University of North Carolina at Greensboro and 4 local, STEM- and youth-oriented making spaces in Lansing and Greensboro that serve historically underrepresented groups in STEM, with a specific focus on youth from lower-income and African American backgrounds.
This Smart and Connected Community (SCC) project will partner with two rural communities to develop STEMports, an innovative Science, Technology, Engineering and Mathematics (STEM) learning game for workforce development. The game's activities will take players on localized Augmented Reality (AR) missions to both engage in STEM learning challenges and discover emerging STEM careers in their community, specifically highlighting innovations in the fields of sustainable agriculture and aquaculture, forest products, and renewable energy. Community Advisory Teams (CATs) and co-design teams, including youth, representatives from the targeted emerging STEM economies, and decision-makers will partner with project staff to co-design STEMports that reflect the interests, cultural contexts, and envisioned STEM industries of the future for each community.
The project will: (a) design and pilot an AR game for community STEM workforce development; (b) develop and adapt a community engagement process that optimizes community networking for co-designing the gaming application and online community; and (c) advance a scalable process for wider applications of STEMports. This project is a collaboration between the Maine Mathematics and Science Alliance and the Field Day Lab at the University of Wisconsin-Madison to both build and research the co-designing of a SCC based within an AR environment. The project will contribute knowledge to the informal STEM learning, community development, and education technology fields in four major ways:
Deepening the understanding of how innovative technological tools support rural community STEM knowledge building as well as STEM identity and workforce interest.
Identifying design principles for co-designing the STEMports community related to the technological design process.
Developing social network approaches and analytics to better understand the social dimensions and community connections fostered by the STEMport community.
Understanding how participants' online and offline interactions with individuals and experiences builds networks and knowledge within a SCC.
With the scaling of use by an ever-growing community of players, STEMports will provide a new AR-based genre of public participation in STEM and collective decision making. The research findings will add to the emerging literature on community-wide education, innovative education technologies, informal STEM learning (especially place-based learning and STEM ecosystems), and participatory design research.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The goal of our research is to identify strengths and weaknesses of high school level science fair and improvements that might enhance learning outcomes based on empirical assessment of student experiences. We use the web-based data collection program REDCap to implement anonymous and voluntary surveys about science fair experiences with two independent groups -- high school students who recently competed in the Dallas Regional Science and Engineering Fair and post high school students (undergraduates, 1st year medical students, and 1st year biomedical graduate students) on STEM education
Research that seeks to understand classroom interactions often relies on video recordings of classrooms so that researchers can document and analyze what teachers and students are doing in the learning environment. When studies are large scale, this analysis is challenging in part because it is time-consuming to review and code large quantities of video. For example, hundreds of hours of videotaped interaction between students working in an after-school program for advancing computational thinking and engineering learning for Latino/a students. This project is exploring the use of computer-assisted methods for video analysis to support manual coding by researchers. The project is adapting procedures used for computer-aided diagnosis systems for medical systems. The computer-assisted process creates summaries that can then be used by researchers to identify critical events and to describe patterns of activities in the classroom such as students talking to each other or writing during a small group project. Creating the summaries requires analyzing video for facial recognition, motion, color and object identification. The project will investigate what parts of student participation and teaching can be analyzed using computer-assisted video analysis. This project is supported by NSF's EHR Core Research (ECR) program, the STEM+C program and the AISL program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. The project is funded by the STEM+Computing program, which seeks to address emerging challenges in computational STEM areas through the applied integration of computational thinking and computing activities within disciplinary STEM teaching and learning in early childhood education through high school (preK-12). As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The video analysis systems will provide video summarizations for specific activities which will allow researchers to use these results to quantify student participation and document teaching practices that support student learning. This will support the analysis of large volumes of video data that are often time-consuming to analyze. The video analysis system will identify objects in the scene and then use measures of distances between objects and other tracking methods to code different activities (e.g., typing, talking, interaction between the student and a facilitator). The two groups of research questions are as follows. (1) How can human review of digital videos benefit from computer-assisted video analysis methods? Which aspects of video summarization (e.g., detected activities) can help reduce the time it takes to review the videos? Beyond audio analytics, what types of future research in video summarization can help reduce the time that it takes to review videos? (2) How can we quantify student participation using computer-assisted video analysis methods? What aspects of student participation can be accurately measures by computer-assisted video analysis methods? The video to be used for this study is drawn from a project focused on engineering and computational thinking learning for Latino/a students in an after-school setting. Hundreds of hours of video are available to be reviewed and analyzed to design and refine the system. The resulting coding will also help document patterns of engagement in the learning environment.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Marios PattichisSylvia Celedon-PattichisCarlos LopezLeiva
This Conference Paper was presented at the International Soceity for the Learning Sciences Confernece in June 2018. We summarize interviews with youth ages 9-15 about their failure mindsets, and if those midsets cross boundaries between learning environments.
Previous research on youth’s perceptions and reactions to failure established a view of failure as a negative, debilitating experience for youth, yet STEM and in particular making programs increasingly promote a pedagogy of failures as productive learning experiences. Looking to unpack perceptions of failure across contexts and
Making is a recent educational phenomenon that is increasingly occurring in schools and informal learning spaces around the world. In this paper we explore data from maker educators about their experiences with failure. We surveyed maker educators about how they view failure happening with youth in their formal and informal programs and how they respond. The results reveal some concrete strategies that seem to show promise for helping educators increase the likelihood that failure experiences for youth can lead to gains in learning and persistence.
This article summarizes a survey of formal
The National Federation of the Blind (NFB), in partnership with scholars from Utah State University and educators from the Science Museum of Minnesota (SMM), has developed the Spatial Ability and Blind Engineering Research (SABER) project to assess and improve the spatial ability of blind teens in order to broaden the participation of blind students in STEM fields.
Activities began this summer (2018) with a week-long, residential engineering design program for thirty blind high school students at NFB headquarters in Baltimore. The evaluation focused on perceptions of process and measures of
This exploratory learning research and design project will study how to use emerging technologies to help document practices in maker-based learning experiences. Despite its established potential for consolidating learning and sense-making, project documentation is often overlooked, not prioritized or seen as burdensome and therefore not integrated into the learning experiences. The project team seeks to understand and address with practice partners the barriers to documentation by systematically exploring how to physically embed and incorporate smart tools and documentation practices into learning environments, specifically creative hands-on learning spaces, like makerspaces. The goal is to understand how to scaffold learners to become more aware, reflective and attentive to their progress towards learning outcomes by embedding supportive tools physically in space as the actions unfold. Making and maker-based learning experiences offer tremendous opportunities to more fully engage diverse learners in STEM education and build a workforce prepared for innovation. Documentation of these learning experiences, both as an authentic practice that professionals engage in as well as an assessment practice for instruction, is often not supported. The project will create open source documentation for solutions and develop supporting case studies, web resources and guides to facilitate easy uptake and adoption of promising approaches.
This proposal will make significant research contributions in three ways: (1) develop and iteratively test a suite of embedded "smart" tools designed to scaffold, manage and trace process documentation practices; (2) study the integration of these tools in formal and informal activities and programs settings and characterize their influence on instruction and the assessment of learning outcomes; (3) establish a set of rubrics based on learner data streams to aid instruction and mark learner progress. Improving documentation practices and the assessment of learning outcomes will advance making as a core STEM educational activity. Through a better understanding of why and how to place networked documentation tools sensitive to space, time and context cues, the threshold for enactment and scaffolded usage can be lowered in a broader range of settings. Ultimately, this exploratory project will not only develop an integrated set of situated documentation tools, but also help us develop hypotheses for how documentation as a mediating process productively supports learning.
The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. The Multimedia Immersion (MI) project is will develop, pilot, and evaluate a nine-week STEM-rich multimedia production course for high school students. MI will make important contributions to the field through its efforts to design and evaluate the promises and challenges of a nine-week multimedia curriculum in multiple urban high schools. The MI course will engage teams of students to develop a personally and socially relevant storyline that guides their use of accessible audio and video technologies to create a five-minute animated video. To develop student STEM experience and provide technical support, the project will provide guidance and learning experiences in engineering (e.g., criteria, constraints, optimization, tradeoffs), science (e.g. sound, light, energy, mechanics) and multimedia technologies (e.g., computer based audio production, video editing and visualizations through animatics (i.e., shooting a succession of storyboards with a soundtrack). animatics).
Because the curriculum situates engineering and science learning in the context of multimedia production, there are natural synergies with several existing high school courses including engineering design, audio/video media production, and multimedia technology. Although these courses are typically electives in high school, developing a 5-minute animated short on a topic of interest may encourage girls and students from underrepresented groups to select this course over other electives. MI will impact 10 teachers and approximately 250 high school students per year. The project will result in the following resources: nine-week curricular unit (multimedia, science, engineering); assessments to monitor student learning of science, engineering and technology (design logs); and research on changes in student knowledge, interest, and a nine-week curricular unit (multimedia, science, engineering). Project resources will be disseminated to teachers, researchers, and curriculum and professional development providers via conference presentations, publications, and online webinars.
The MI project builds on student familiarity and interest in music, video and technology to promote an: (1) understanding of engineering design and physics and an (2) an appreciation of the fundamental role of STEM in popular culture. Project evaluation will be conducted using student surveys and an examination of work products in conjunction with implementation challenges and successes to generate evidence for the feasibility and utility of a high school multimedia course that explicitly addresses science and engineering learning. Project evaluation will use student design logs as a window into student design processes and conceptual understanding. Student design logs are an essential feature of MI curriculum design. With an appropriate structure, these design logs can inform teaching, afford an opportunity for students to reflect on their own work, and provide evidence of student thinking and learning for assessment purposes. Using student design logs as a window into students? design process and conceptual understanding is an important contribution to the engineering education community which has few options for measuring student knowledge in ways that are consistent with the hands-on, iterative nature of the design process.
Reconceptualizing STEM + Computing Literacy is funded by the STEM+Computing Partnership (STEM+C) program, which seeks to advance multidisciplinary integration of computing and computational thinking in K-12 science, technology, engineering, and mathematics (STEM) teaching and learning through applied research and development across one or more domains, and broadening participation in computing and computing-related fields. The project will study the integration of computational thinking as part of a new and more contemporary perspective of STEM literacy, and will design, develop, and beta-test a prototype literacy assessment tool that will measure computational thinking literacy along with measures of literacy in other STEM content areas. The tool will be available to the general public as a self-measurement application (App) that can be used by individuals to test their own literacy, and by teachers, schools, and informal educators and organizations to assess literacy development in their students and in their STEM education programs. This transdisciplinary research project will begin the process of creating an innovative approach and tool for measuring literacy that will expand the definition of literacy to include computational skills along with science reasoning. Literacy is an important concept and measurement that has traditionally been used to assess an individual's knowledge of science. This project will explore a broader literacy perspective that incorporates learning derived from out of school and one that incorporates computational skills and thinking as part of a more contemporary perspective of STEM literacy. A prototype web-based App allowing individuals and education organizations to assess literacy levels, and ways to enhance literacy, will be developed and studied. The methodology will be developed using discussions and knowledge from over 60 experts across computing, education, science, social science, and other STEM fields using a Delphi method to engage in reconceptualization of literacy. The hypothesis is that this new STEM+C literacy framework should be structured along four interacting but semi-independent domains: 1) general STEM+C knowledge; 2) self-defined areas of STEM+C knowledge and expertise; 3) attitudes and beliefs related to STEM+C; and 4) the skills and competencies necessary to participate in STEM+C related pursuits and discussions, including measures of modes of STEM+C thinking. Each of these four domains is likely to include numerous sub-domains and associated descriptors, which collectively describe the different aspects of being a STEM+C literate citizen. The application will be designed to provide feedback to individuals on their knowledge, attitudes and skills compared with those of others and suggest ways to enhance and improve their skills and understanding through an embedded feedback mechanism. This project creates public benefit by providing individuals and organizations with a responsive real-time understanding measuring STEM+C literacy, deepening the dialogue about the value of public engagement in science, engineering, technology, math and computing and revealing the dynamic factors that inform STEM+C literacy.