In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
Science Hunters is an outreach project which employs the computer game Minecraft to engage children with scientific learning and research through school visits, events, and extracurricular clubs. We principally target children who may experience barriers to accessing Higher Education, including low socioeconomic status, being the first in their family to attend university, and disability (including Special Educational Needs). The Minecraft platform encourages teamwork and makes science learning accessible and entertaining for children, irrespective of background. We employ a flexible approach
DATE:
TEAM MEMBERS:
Laura HobbsCarly StevensJackie HartleyCalum Hartley
In this literature review, we seek to understand in what ways aspects of computer science education and making and makerspaces may support the ambitious vision for science education put forth in A Framework for K-12 Science as carried forward in the Next Generation Science Standards. Specifically, we examine how computer science and making and makerspace approaches may inform a project-based learning approach for supporting three-dimensional science learning at the elementary level. We reviewed the methods and findings of both recently published articles by influential scholars in computer
DATE:
TEAM MEMBERS:
Samuel SeveranceSusan CodereEmily MillerDeborah Peek-BrownJoseph Krajcik
resourceprojectGames, Simulations, and Interactives
EMERGE in STEM (Education for Minorities to Effectively Raise Graduation and Employment in STEM) is a NSF INCLUDES Design and Development Launch Pilot. This project addresses the broadening participation challenge of increasing participation of women, the at-risk minority population, and the deaf in the STEM workforce. The project incorporates in and out-of-school career awareness activities for grades 4-12 in a high poverty community in Guilford County, North Carolina. EMERGE in STEM brings together a constellation of existing community partners from all three sectors (public, private, government) to leverage and expand mutually reinforcing STEM career awareness and workforce development activities in new ways by using a collective impact approach.
This project builds on a local network to infuse career exposure elements into the existing mutually reinforcing STEM activities and interventions in the community. A STEM education and career exposure software, Learning Blade, will be used to reach approximately 15,000 students. A shared measurement system and assessment process will contribute to the evaluation of the effectiveness of the collective impact strategies, the implementation of mutually reinforcing activities across the partnership and the extent to which project efforts attract students to consider STEM careers.
DATE:
-
TEAM MEMBERS:
Gregory MontyMargaret KanipesMalcolm SchugSteven Jiang
The Cyberlearning and Future Learning Technologies Program funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively. This project brings together two approaches to help K-12 students learn programming and computer science: open-ended learning environments, and computer-based learning analytics, to help create a setting where youth can get help and scaffolding tailored to what they know about programming without having to take tests or participate in rigid textbook exercises for the system to know what they know.
The project proposes to use techniques from educational data mining and learning analytics to process student data in the Alice programming environment. Building on the assessment design model of Evidence-Centered Design, student log data will be used to construct a model of individual students' computational thinking practices, aligned with emerging standards including NGSS and research on assessment of computational thinking. Initially, the system will be developed based on an existing corpus of pair-programming log data from approximately 600 students, triangulating with manually-coded performance assessments of programming through game design exercises. In the second phase of the work, curricula and professional development will be created to allow the system to be tested with underrepresented girls at Stanford's CS summer workshops and with students from diverse high schools implementing the Exploring Computer Science curriculum. Direct observation and interviews will be used to improve the model. Research will address how learners enact computational thinking practices in building computational artifacts, what patters of behavior serve as evidence of learning CT practices, and how to better design constructionist programming environments so that personalized learner scaffolding can be provided. By aligning with a popular programming environment (Alice) and a widely-used computer science curriculum (Exploring Computer Science), the project can have broad impact on computer science education; software developed will be released under a BSD-style license so others can build on it.
DATE:
-
TEAM MEMBERS:
Shuchi GroverMarie BienkowskiJohn Stamper
The project team is developing a prototype of a web-based game utilizing the illustrations of chemical elements and science terms created by Simon Basher in his three books, The Periodic Table: Elements with Style!, Chemistry: Getting a Big Reaction!, and Physics: Why Matter Matters! The game will incorporate augmented reality (person-to-person gameplay with the support of the software) to teach grade 4 to 6 students science concepts, including an introduction to chemistry. The game will include curriculum support materials. Pilot research in Phase I will seek to demonstrate that the software prototype functions as planned, teachers are able to integrate it within the classroom environment, and students are engaged with the prototype.
Purpose: An estimated 5 to 8% of elementary school students have some form of memory or cognitive deficit that inhibits learning basic math. Researchers have identified several areas where children with math learning difficulties struggle. These include a strong sense of number facts to quickly and accurately perform operations on single digit numbers, the use of strategies to solve problems which have not yet been memorized, a sense to figure out whether or not an answer is reasonable, and self-monitoring to assess one's own efficacy and understanding. To support students with math learning difficulties in grades 1 to 4, this project team will develop a series of apps for touch-screen tablets that encourage single digit operational fluency, conceptual understanding, strategy awareness, and self-understanding.
Project Activities: During Phase I project in 2012, the research team developed a prototype of the single digit addition game, following an iterative process incorporating feedback from teachers and students having difficulty with math. Nineteen students participated in a pilot study, and the researchers found that the prototype functioned well and that users were engaged by the game. In Phase II, the team will build and refine the back end system, design and develop the teacher website, and create content for games in subtraction, multiplication, and division. Researchers will carry out a pilot test of the usability and feasibility, fidelity of implementation, and promise of the game to improve learning. Students in first to fourth grade identified by teachers as having the greatest difficulty with math will participate in the pilot study. Half of the 120 students participating in the pilot study will be randomly selected to play the game as a supplement to classroom learning whereas the other half will not have access. Students in the control group will be provided the games at the end of the study. Analyses will compare pre- and post-test math scores.
Product: The web-based game, MathFacts, will include a series of apps for touch-screen tablet computers to support math learning for 1st to 4th grade students with major or sometimes intractable learning difficulties. In the game, students will learn content through mini-lessons, engage with problems in practice and speed rounds, and then receive formative feedback on their performance. Students will use and manipulate blocks, linker tubes, number lines, and interact with engaging pedagogical agents such as parrots and sloths. Students will set goals, advance to more challenging levels, and engage in competition. The game will be self-paced and will provide individualized formative assessment scaffolding when students do not know the answer to a question. A teacher management system will support professional development and will produce reports to guide instruction. The intended outcomes from gameplay will include increased fluency, conceptual understanding, strategy awareness, self-assessment, and motivation of basic math.
Purpose: This project will develop and test Kiko's Thinking Time, a series of game apps designed to strengthen children's cognitive skills related to executive functioning and reasoning. A principle objective of preschool is to prepare children for later success in school. Most programs focus on activities to support children's social and emotional development, and to strengthen pre-reading and mathematics competencies. Fewer programs explicitly focus on fostering children's executive function and reasoning skills—even though research in the cognitive sciences demonstrates these skills also provide a foundation for school-readiness.
Project Activities: During Phase I (completed in 2014), the team developed six prototype games and a teacher portal to track student progress. At the end of Phase I, results from a pilot study with 55 kindergarten students and 5 teachers demonstrated that the games operated as intended. Results indicated that students were engaged based on duration of game play, and that teachers were able to review game data for each child. In Phase II, the team will develop 15 more games and will further refine and enhance the functionality of the teacher portal. After development is complete, a pilot study will assess the feasibility and usability, fidelity of implementation, and the promise of the games for promoting students' executive functioning and reasoning. The researchers will collect data from 200 students in 10 preschool classrooms over 2 months. Half of the students in each class will be randomly assigned to use Kiko's Thinking Time while the other half will play an art-focused gaming app. Analyses will compare pre-and-post scores on measures of student's executive functioning and reasoning.
Product: Kiko's Thinking Time will be an app with 25 games, each based on tasks shown to have cognitive benefits in lab research. Each game will be designed to isolate and train skills related to executive functioning, such as: working memory, reasoning, inhibition, selective attention, cognitive flexibility, and spatial skills. Game play will be self-guided and adaptive, as the software will adjust in difficulty based on student responses. The app will work on tablets, smartphones, as well desktops. In addition, a companion website will allow teachers to track student performance and to obtain educational material around executive function and cognitive development.
The project team is developing and testing a prototype of Thinkzone, a blended learning portal intended for Kindergarten through Grade 8 teachers to host existing education learning games across core subject areas. The prototype will host games, and include a learning system to train educators to integrate games to replace or supplement instructional practice. In the Phase I pilot study will include 10 teachers and 200 students. The researchers will examine if the prototype functions as planned, if teachers are able to implement it with small groups of students, and whether students are engaged across the various games.
This project team is developing and testing a prototype of the Teachley Analytics Library, a platform intended to host third party-developed mathematics game apps for students in kindergarten through Grade 8. The prototype will include a dashboard to host games and generate formative assessment data to inform teacher instruction. In the Phase I pilot study, the team will examine whether the prototype functions as planned with 40 Grade 1 and 2 math teachers. The study will test if teachers are able to implement games within the classroom and utilize data to inform practice, and whether students are engaged by gameplay.
The project team is developing and testing a prototype of a computer science game-based intervention intended for Grade 1 students. The prototype will include physical robots that will be designed and controlled on a game board by students through a blue-tooth enabled smartphone app. The product will include teacher resources and suggestions to facilitate classroom integration. In the Phase I pilot research with 5 classrooms and 150 students, the researchers will examine whether the prototype functions as planned, if teachers are able to implement it with small groups of students, and whether
Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.