This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
Science Hunters is an outreach project which employs the computer game Minecraft to engage children with scientific learning and research through school visits, events, and extracurricular clubs. We principally target children who may experience barriers to accessing Higher Education, including low socioeconomic status, being the first in their family to attend university, and disability (including Special Educational Needs). The Minecraft platform encourages teamwork and makes science learning accessible and entertaining for children, irrespective of background. We employ a flexible approach
DATE:
TEAM MEMBERS:
Laura HobbsCarly StevensJackie HartleyCalum Hartley
We explored the potential of science to facilitate social inclusion with teenagers who had interrupted their studies before the terms set for compulsory education. The project was carried out from 2014 to 2018 within SISSA (International School for Advanced Studies), a scientific and higher education institution in physics, mathematics and neurosciences, and was focused on the production of video games using Scratch. The outcomes are encouraging: through active engagement, the participants have succeeded in completing complex projects, taking responsibilities and interacting with people
DATE:
TEAM MEMBERS:
Simona CerratoFrancesca RizzatoLucia TealdiElena Canel
The Cyberlearning and Future Learning Technologies Program funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively. This project brings together two approaches to help K-12 students learn programming and computer science: open-ended learning environments, and computer-based learning analytics, to help create a setting where youth can get help and scaffolding tailored to what they know about programming without having to take tests or participate in rigid textbook exercises for the system to know what they know.
The project proposes to use techniques from educational data mining and learning analytics to process student data in the Alice programming environment. Building on the assessment design model of Evidence-Centered Design, student log data will be used to construct a model of individual students' computational thinking practices, aligned with emerging standards including NGSS and research on assessment of computational thinking. Initially, the system will be developed based on an existing corpus of pair-programming log data from approximately 600 students, triangulating with manually-coded performance assessments of programming through game design exercises. In the second phase of the work, curricula and professional development will be created to allow the system to be tested with underrepresented girls at Stanford's CS summer workshops and with students from diverse high schools implementing the Exploring Computer Science curriculum. Direct observation and interviews will be used to improve the model. Research will address how learners enact computational thinking practices in building computational artifacts, what patters of behavior serve as evidence of learning CT practices, and how to better design constructionist programming environments so that personalized learner scaffolding can be provided. By aligning with a popular programming environment (Alice) and a widely-used computer science curriculum (Exploring Computer Science), the project can have broad impact on computer science education; software developed will be released under a BSD-style license so others can build on it.
DATE:
-
TEAM MEMBERS:
Shuchi GroverMarie BienkowskiJohn Stamper
The project team is developing a prototype of Eco, a multi-player game to prepare high school students to be environmentally literate citizens with 21st century skills. To play the game, students will enter a shared online world featuring a simulated ecosystem of plants and animals. Students will co-create the civilization by measuring, modeling, and analyzing the underlying ecosystem. Students advocate proposed plans to classmates and make decisions as a group. Cooperation and science-based decision making activities are necessary for success in preventing the destruction of their environment. The prototype will include teacher resources to support the alignment of game play to learning goals, and implementation. In the Phase I pilot research, the project team will examine whether the game prototypes function as planned, if teachers are able to integrate it within the classroom environment, and whether students are engaged with the prototype.
Purpose: This project will develop and test Happy Atoms, a physical modeling set and an interactive iPad app for use in high school chemistry classrooms. Happy Atoms is designed to facilitate student learning of atomic modeling, a difficult topic for chemistry high school students to master. Standard instructional practice in this area typically includes teachers using slides, static ball and stick models, or computer-simulation software to present diagrams on a whiteboard. However, these methods do not adequately depict atomic interactions effectively, thus obscuring complex knowledge and understanding of their formulas and characteristics.
Project Activities: During Phase I (completed in 2014), the team developed a prototype of a physical modeling set including a computerized ball and stick molecular models representing the first 17 elements on the periodic table and an iPad app that identifies and generates information about atoms. A pilot study at the end of Phase I tested the prototype with 187 high school students in 12 chemistry classes. Researchers found that the prototype functioned as intended. Results showed that 88% of students enjoyed using the prototype, and that 79% indicated that it helped learning. In Phase II, the team will develop additional models and will strengthen functionality for effective integration into instructional practice. After development is complete, a larger pilot study will assess the usability and feasibility, fidelity of implementation, and promise of Happy Atoms to improve learning. The study will include 30 grade 11 chemistry classrooms, with half randomly assigned to use Happy Atoms and half who will continue with business as usual procedures. Analyses will compare pre-and-post scores of student's chemistry learning, including atomic modeling.
Product: Happy Atoms will include a set of physical models paired with an iPad app to cover high school chemistry topics in atomic modeling. The modeling set will include individual plastic balls representing the elements of the periodic table. Students will use an iPad app to take a picture of models they create. Using computer-generated algorithms, the app will then identify the model and generate information about its physical and chemical properties and uses. The app will also inform students if a model that is created does not exist. Happy Atoms will replace or supplement lesson plans to enhance chemistry teaching. The app will include teacher resources suggesting how to incorporate games and activities to reinforce lesson plans and learning.
This project team will develop and test a prototype of LifeSim, intended to be a financial literacy game app for high school students to strengthen mathematical skills and practical life knowledge. In the game, high school students will manage hypothetical investment funds and be challenged to understand compounded interest and debt. The app will include materials for math teachers to integrate the game within instructional practice. At the end of Phase I in a pilot study with 50 students, the researchers will examine whether the prototype functions as planned and if students are engaged during gameplay.
This project team will develop and test a prototype of SuperChem VR, a game to support high school students' basic chemistry learning. The prototype will include a set of web-based laboratory modules which will be integrated within a virtual reality headset to allow for a 360-degree visual exploration of the environment. The prototype will also include teacher resources for classroom implementation. In the Phase I pilot research with 3 teachers and 54 students, the project team will examine whether the hardware and software prototype functions as planned, whether teachers are able to integrate it within the classroom environment, and whether students are engaged while using the prototype.
Purpose: This project team will fully develop and test SuperChemVR, a virtual environment integrated within a Virtual Reality (VR) headset for an immersive exploration of a chemistry lab. While chemistry labs offer the benefits of hands-on experimentation to help students learn abstract concepts, they are costly to maintain, supervise, and pose safety risks. Virtual chemistry labs for computers and tablets allow students to explore chemistry safely with unlimited resources, and provide immediate feedback and automated assessments, but these "point-and click" experiences are not immersive or hands-on. Immersive VR allows users to fully experience an interactive, 3-Dimensional 360-degree environment.
Project Activities: During Phase I, (completed in 2016), the team developed a prototype of SuperChemVR, including a virtual chemistry lab environment within which students immerse themselves while wearing a VR headset. At the end of Phase I, researchers completed a pilot study with 54 students and three teachers. Results demonstrated that the hardware and software prototype operated as intended, teachers were able to integrate it within the classroom environment, and students were engaged while using the prototype. In Phase II, the team will add content modules and a gameplay narrative to the platform, build the automated feedback mechanism, strengthen the back-end management system, and build out the teacher reporting dashboard. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the SuperChemVR for improving student learning in chemistry. The study will include 10 high school chemistry classrooms, half randomly assigned to use SuperChemVR and half to follow business-as-usual procedures. Researchers will compare pre-and-post scores of student's chemistry learning.
Product: SuperChemVR is a room-scale VR lab and learning game for high school chemistry students. While wearing a VR headset, students will be immersed in a simulated chemistry 3D-environment where they will be challenged to acquire basic lab and safety skills. Through actual, accurate measurement and experimentation, students will improve their understanding of chemistry practices as they learn using science to solve problems. VR will enhance students' chemistry experience by providing instant cleanup, access to infinite resources, and observations at exponentially larger and smaller scales while simulating accurate physical actions in a safe environment. In the game component of the intervention, students will participate in an outer-space adventure that takes place on a derelict spaceship requiring players to use chemistry to survive until they can be rescued. SuperChem VR will be used in the classroom by teachers as a demonstration tool, will provide implementation supports, and will provide teachers with reports on student performance.
WCS launched its electronic field trip program, Distance Learning Expeditions, in 2001 when there
was tremendous interest in the educational community in the potential of videoconferencing
technology for program delivery, as well as money available for the purchase of related broadcast
equipment. The program grew rapidly and was successful through 2009 -- serving 9,600 students
in 2006-07, its largest year. From 2010 to 2014, with school budget cuts, high equipment
maintenance costs, and shifts in staffing, participation in the program declined. In 2010, WCS
secured a grant from IMLS for
Great Lakes Science Center (GLSC), home of the NASA Glenn Visitor Center, is dedicated to sharing NASA content to inform, engage, and inspire students, educators, and the public. To further this goal, GLSC will develop a digital experience focused on collaboration and teamwork, emphasizing the benefits of a systems approach to STEM challenges. At the recently, fully renovated NASA Glenn Visitor Center, GLSC visitors will embark on an exciting mission of discovery, working in teams to collect real data from NASA objects and experiences. Mobile devices will become scientific tools as students, teachers, and families take measurements, access interviews with NASA scientists, analyze results from Glenn Research Center (GRC) test facilities, and link to NASA resources to assemble mission-critical information. This initiative will provide experiences that demonstrate how knowledge and practice can be intertwined, a concept at the core of the Next Generation Science Standards. GLSC’s digital missions will engage students and families in STEM topics through the excitement of space exploration. In addition, this project has the potential to inform the design of future networked visitor experiences in science centers, museums and other visitor attractions.
In support of a summative evaluation of SciGirls Season Three, Multimedia Research developed a scale to assess preteen girls’ interest in nature and science. The work was sponsored by Twin Cities PBS under NSF Grant No. 1323713. Multimedia Research developed, piloted, validated and implemented the GINSS: A nine statement Likert scale constructed to reveal girls’ strength of interest in nature and science activities. Researchers and evaluators are encouraged to use this scale to extend its application. Please email if you eventually use the scale in your research or evaluation: Flagg