Purpose: The United States (U.S.) has traditionally produced the world’s top research scientists and engineers, leading to breakthrough advances in science and technology. Despite the importance of STEM careers, many U.S. students are not graduating with strong STEM knowledge, skills or interests, and the percentage of students prepared for or pursuing STEM degrees or careers is declining. Research shows that the decreased interest in STEM typically begins in the middle school years, pose significant academic and social challenges for students. This project will develop a web-based game teach 6th to 8th students key scientific inquiry skills, along with the academic mindsets and learning strategies to facilitate engagement and effective science learning.
Project Activities: The researchers will create a prototype by mapping key Next Generation Science Standards and learning goals with concepts and content, and producing a game design document. Following completion of the prototype, the researchers will finalize the server architecture, create the core code systems, concept art, and develop a prototype in order to simulate the final user experience. Iterative refinements will be conducted as needed at major production milestones until the game is fully functional. Once development is complete, the research team will assess the usability and feasibility, fidelity of implementation, and the promise of the game to improve outcomes in a pilot study. In this study, 200 students in 10 classes will participate, with 5 of the classrooms randomly assigned to use the game and 5 who will proceed as normal. All students will complete pre- and post- program surveys assessing their academic mindsets, learning strategies, and science skills.
Product: This project will develop SciSkillQuest, a web-based multiplayer game intended to teach middle school students scientific inquiry skills and to foster academic growth mindsets in science. Students will pursue quests, employing inquiry skills to navigate and succeed in the game, including Questioning, Modeling, Investigating, Analyzing, Computing, Explaining, Arguing, and Informing. The game will include different paths to a solution, role playing elements, immersive narratives, challenge-based progressions, and peer collaboration to engage players. The growth mindset message — that ability and skill are developed through effort and learning — will be introduced and reinforced through feedback by embedded in-game characters. The games will be supplemental to the curriculum but will also be designed to be integrated within instructional practice. The game will be available for mobile devices as well as web browsers.
In late 2012, Providence Children’s Museum began a major three-year research project in collaboration with The Causality and Mind Lab at Brown University, funded by a grant from the National Science Foundation (1223777). Researchers at Brown examined how children develop scientific thinking skills and understand their own learning processes. The Museum examined what caregivers and informal educators understand about learning through play in its exhibits and how to support children’s metacognition – the ability to notice and reflect on their own thinking – and adults’ awareness and appreciation of kids’ thinking and learning through play. Drawing from fields like developmental psychology, informal education and museum visitor studies, the Museum’s exhibits team looked for indicators of children’s learning through play and interviewed parents and caregivers about what they noticed children doing in the exhibits, asking them to reflect on their children’s thinking. Based on the findings, the research team developed and tested new tools and activities to encourage caregivers to notice and appreciate the learning that takes place through play.
This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?
The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.
The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
This full-scale project addresses the need for more youth, especially girls, to pursue an interest in engineering and eventually fill a critical workforce need. The project leverages museum-based exhibits, girls' activity groups, and social media to enhance participants' engineering-related interests and identities. The project includes the following bilingual deliverables: (1) Creative Solutions programming will engage girls in group oriented engineering activities at partner community-based organizations, where the activities highlight altruistic, personally relevant, and social aspects of engineering. Existing community groups will use the activities in their regular meeting structure. Visits to the museum exhibits, titled Design Your World will reinforce messages; (2) Design Your World Exhibits will serve as a community hub at two ISE institutions (Oregon Museum of Science and Industry and the Hatfield Marine Science Center). They will leverage existing NSF-funded Engineer It! (DRL-9803989) exhibits redesigned to attract, engage, and mobilize a more diverse population by showcasing altruistic, personally relevant, and social aspects of engineering; (3) Digital engagement through targeted use of social media will complement program and exhibit content and be an online portal for groups engaged in the project; (4) A community action group (CAG) will provide professional development opportunities to stakeholders interested in girls' STEM identity (e.g. parents, STEM-based business professionals) to promote effective engineering messaging throughout the community and engage them in supporting project participants; and (5) Longitudinal research will explore how girls construct and negotiate engineering-related identities through discourse across the project activities and over time.
Boston's Museum of Science (MOS), with Harvard as its university research partner, is extending, disseminating, and further evaluating their NSF-funded (DRL-0714706) Living Laboratory model of informal cognitive science education. In this model, early-childhood researchers have both conducted research in the MOS Discovery Center for young children and interacted with visitors during the museum's operating hours about what their research is finding about child development and cognition. Several methods of interacting with adult visitors were designed and evaluated, including the use of "research toys" as exhibits and interpretation materials. Summative evaluation of the original work indicated positive outcomes on all targeted audiences - adults with young children, museum educators, and researchers. The project is now broadening the implementation of the model by establishing three additional museum Hub Sites, each with university partners - Maryland Science Center (with Johns Hopkins), Madison Children's Museum (with University of Wisconsin, Madison), and Oregon Museum of Science and Industry (with Lewis & Clark College). The audiences continue to include researchers (including graduate and undergraduate students); museum educators; and adults with children visiting the museums. Deliverables consist of: (1) establishment of the Living Lab model at the Hub sites and continued improvement of the MOS site, (2) a virtual Hub portal for the four sites and others around the country, (3) tool-kit resources for both museums and scientists, and (4) professional symposia at all sites. Intended outcomes are: (1) improve museum educators' and museum visiting adults' understanding of cognitive/developmental psychology and research and its application to raising their children, (2) improve researchers' ability to communicate with the public and to conduct their research at the museums, and (3) increase interest in, knowledge about, and application of this model throughout the museum community and grow a network of such collaborations.