The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The Brains On! exploratory research study was guided by three overarching research questions:
Who is the audience for Brains On! and what are their motivations for listening to children’s science podcasts?
How are Brains On! listeners using the podcast and engaging with its content?
What kinds of impacts does Brains On! have on its audiences?
These questions were answered through a three-phase mixed-methods research design. Each phase informed the next, providing additional insights into answering the research questions. Phase 1 was a review of a sample of secondary data in the
This meta-article aims to explore the role of uncertainty in knowing in informal science learning contexts. Subjects (N=2591) were sixth-graders from four countries. In addition to the correct and incorrect questionnaire alternatives, there was a "don't know" option to choose if uncertain of the answer. The unique path-analysis finding showed that the role of motivation was uniformly positive on correct and negative on uncertainty of answers. In all contexts the number of correct answers increased, incorrect and uncertain answers decreased. Interestingly, although there was no more difference
Research that seeks to understand classroom interactions often relies on video recordings of classrooms so that researchers can document and analyze what teachers and students are doing in the learning environment. When studies are large scale, this analysis is challenging in part because it is time-consuming to review and code large quantities of video. For example, hundreds of hours of videotaped interaction between students working in an after-school program for advancing computational thinking and engineering learning for Latino/a students. This project is exploring the use of computer-assisted methods for video analysis to support manual coding by researchers. The project is adapting procedures used for computer-aided diagnosis systems for medical systems. The computer-assisted process creates summaries that can then be used by researchers to identify critical events and to describe patterns of activities in the classroom such as students talking to each other or writing during a small group project. Creating the summaries requires analyzing video for facial recognition, motion, color and object identification. The project will investigate what parts of student participation and teaching can be analyzed using computer-assisted video analysis. This project is supported by NSF's EHR Core Research (ECR) program, the STEM+C program and the AISL program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. The project is funded by the STEM+Computing program, which seeks to address emerging challenges in computational STEM areas through the applied integration of computational thinking and computing activities within disciplinary STEM teaching and learning in early childhood education through high school (preK-12). As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The video analysis systems will provide video summarizations for specific activities which will allow researchers to use these results to quantify student participation and document teaching practices that support student learning. This will support the analysis of large volumes of video data that are often time-consuming to analyze. The video analysis system will identify objects in the scene and then use measures of distances between objects and other tracking methods to code different activities (e.g., typing, talking, interaction between the student and a facilitator). The two groups of research questions are as follows. (1) How can human review of digital videos benefit from computer-assisted video analysis methods? Which aspects of video summarization (e.g., detected activities) can help reduce the time it takes to review the videos? Beyond audio analytics, what types of future research in video summarization can help reduce the time that it takes to review videos? (2) How can we quantify student participation using computer-assisted video analysis methods? What aspects of student participation can be accurately measures by computer-assisted video analysis methods? The video to be used for this study is drawn from a project focused on engineering and computational thinking learning for Latino/a students in an after-school setting. Hundreds of hours of video are available to be reviewed and analyzed to design and refine the system. The resulting coding will also help document patterns of engagement in the learning environment.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Marios PattichisSylvia Celedon-PattichisCarlos LopezLeiva
This Conference Paper was presented at the International Soceity for the Learning Sciences Confernece in June 2018. We summarize interviews with youth ages 9-15 about their failure mindsets, and if those midsets cross boundaries between learning environments.
Previous research on youth’s perceptions and reactions to failure established a view of failure as a negative, debilitating experience for youth, yet STEM and in particular making programs increasingly promote a pedagogy of failures as productive learning experiences. Looking to unpack perceptions of failure across contexts and
Making is a recent educational phenomenon that is increasingly occurring in schools and informal learning spaces around the world. In this paper we explore data from maker educators about their experiences with failure. We surveyed maker educators about how they view failure happening with youth in their formal and informal programs and how they respond. The results reveal some concrete strategies that seem to show promise for helping educators increase the likelihood that failure experiences for youth can lead to gains in learning and persistence.
This article summarizes a survey of formal
The Computational Thinking in Ecosystems (CT-E) project is funded by the STEM+Computing Partnership (STEM+C) program, which seeks to advance new approaches to, and evidence-based understanding of, the integration of computing in STEM teaching and learning. The project is a collaboration between the New York Hall of Science (NYSCI), Columbia University's Center for International Earth Science Information Network, and Design I/O. It will address the need for improved data, modeling and computational literacy in young people through development and testing of a portable, computer-based simulation of interactions that occur within ecosystems and between coupled natural and human systems; computational thinking skills are required to advance farther in the simulation. On a tablet computer at NYSCI, each participant will receive a set of virtual "cards" that require them to enter a computer command, routine or algorithm to control the behavior of animals within a simulated ecosystem. As participants explore the animals' simulated habitat, they will learn increasingly more complex strategies needed for the animal's survival, will use similar computational ideas and skills that ecologists use to model complex, dynamic ecological systems, and will respond to the effects of the ecosystem changes that they and other participants elicit through interaction with the simulated environment. Research on this approach to understanding interactions among species within biological systems through integration of computing has potential to advance knowledge. Researchers will study how simulations that are similar to popular collectable card game formats can improve computational thinking and better prepare STEM learners to take an interest in, and advance knowledge in, the field of environmental science as their academic and career aspirations evolve. The project will also design and develop a practical approach to programing complex models, and develop skills in communities of young people to exercise agency in learning about modeling and acting within complex systems; deepening learning in young people about how to work toward sustainable solutions, solve complex engineering problems and be better prepared to address the challenges of a complex, global society.
Computational Thinking in the Ecosystems (CT-E) will use a design-based study to prototype and test this novel, tablet-based collectable card game-like intervention to develop innovative practices in middle school science. Through this approach, some of the most significant challenges to teaching practice in the Next Generation Science Standards will be addressed, through infusing computational thinking into life science learning. CT-E will develop a tablet-based simulation representing six dynamic, interconnected ecosystems in which students control the behaviors of creatures to intervene in habitats to accomplish goals and respond to changes in the health of their habitat and the ecosystems of which they are a part. Behaviors of creatures in the simulation are controlled through the virtual collectable "cards", with each representing a computational process (such as sequences, loops, variables, conditionals and events). Gameplay involves individual players choosing a creature and habitat, formulating strategies and programming that creature with tactics in that habitat (such as finding food, digging in the ground, diverting water, or removing or planting vegetation) to navigate that habitat and survive. Habitats chosen by the participant are part of particular kinds of biomes (such as desert, rain forest, marshlands and plains) that have their own characteristic flora, fauna, and climate. Because the environments represent complex dynamic interconnected environmental models, participants are challenged to explore how these models work, and test hypotheses about how the environment will respond to their creature's interventions; but also to the creatures of other players, since multiple participants can collaborate or compete similar to commercially available collectable card games (e.g., Magic and Yu-Go-Oh!). NYSCI will conduct participatory design based research to determine impacts on structured and unstructured learning settings and whether it overcomes barriers to learning complex environmental science.
Conducting qualitative research in any discipline warrants two actions: accessing participants and eliciting their ideas. In chemistry education research, survey techniques have been used to increase access to participants and diversify samples. Interview tasks (such as card sorting, using demonstrations, and using simulations) have been used to elicit participant ideas. While surveys can increase participation and remove geographic barriers from studies, they typically lack the ability to obtain detailed, thick description of participant ideas, which are possible from in-person interviews
Reconceptualizing STEM + Computing Literacy is funded by the STEM+Computing Partnership (STEM+C) program, which seeks to advance multidisciplinary integration of computing and computational thinking in K-12 science, technology, engineering, and mathematics (STEM) teaching and learning through applied research and development across one or more domains, and broadening participation in computing and computing-related fields. The project will study the integration of computational thinking as part of a new and more contemporary perspective of STEM literacy, and will design, develop, and beta-test a prototype literacy assessment tool that will measure computational thinking literacy along with measures of literacy in other STEM content areas. The tool will be available to the general public as a self-measurement application (App) that can be used by individuals to test their own literacy, and by teachers, schools, and informal educators and organizations to assess literacy development in their students and in their STEM education programs. This transdisciplinary research project will begin the process of creating an innovative approach and tool for measuring literacy that will expand the definition of literacy to include computational skills along with science reasoning. Literacy is an important concept and measurement that has traditionally been used to assess an individual's knowledge of science. This project will explore a broader literacy perspective that incorporates learning derived from out of school and one that incorporates computational skills and thinking as part of a more contemporary perspective of STEM literacy. A prototype web-based App allowing individuals and education organizations to assess literacy levels, and ways to enhance literacy, will be developed and studied. The methodology will be developed using discussions and knowledge from over 60 experts across computing, education, science, social science, and other STEM fields using a Delphi method to engage in reconceptualization of literacy. The hypothesis is that this new STEM+C literacy framework should be structured along four interacting but semi-independent domains: 1) general STEM+C knowledge; 2) self-defined areas of STEM+C knowledge and expertise; 3) attitudes and beliefs related to STEM+C; and 4) the skills and competencies necessary to participate in STEM+C related pursuits and discussions, including measures of modes of STEM+C thinking. Each of these four domains is likely to include numerous sub-domains and associated descriptors, which collectively describe the different aspects of being a STEM+C literate citizen. The application will be designed to provide feedback to individuals on their knowledge, attitudes and skills compared with those of others and suggest ways to enhance and improve their skills and understanding through an embedded feedback mechanism. This project creates public benefit by providing individuals and organizations with a responsive real-time understanding measuring STEM+C literacy, deepening the dialogue about the value of public engagement in science, engineering, technology, math and computing and revealing the dynamic factors that inform STEM+C literacy.
This paper describes an NSF-funded study which explored the relationship between female-responsive exhibit designs and girls’ engagement. Across three participating science centers, 906 museum visitors ages 8 to 13 were observed at 334 interactive physics, math, engineering, and perception exhibits. We measured girls’ engagement based on whether they chose to use or return to the exhibits, opted to spend more time at them, or demonstrated deeper engagement behavior. Findings suggest that the design strategies identified in our previously developed Female-Responsive Design Framework can inform