In late 2012, Providence Children’s Museum began a major three-year research project in collaboration with The Causality and Mind Lab at Brown University, funded by a grant from the National Science Foundation (1223777). Researchers at Brown examined how children develop scientific thinking skills and understand their own learning processes. The Museum examined what caregivers and informal educators understand about learning through play in its exhibits and how to support children’s metacognition – the ability to notice and reflect on their own thinking – and adults’ awareness and appreciation of kids’ thinking and learning through play. Drawing from fields like developmental psychology, informal education and museum visitor studies, the Museum’s exhibits team looked for indicators of children’s learning through play and interviewed parents and caregivers about what they noticed children doing in the exhibits, asking them to reflect on their children’s thinking. Based on the findings, the research team developed and tested new tools and activities to encourage caregivers to notice and appreciate the learning that takes place through play.
The Smithsonian’s National Museum of Natural History (NMNH) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a multi-method summative evaluation of Q?rius, an interactive and experimental learning space that brings the unique assets of NMNH—the science, researchers, and collections—out from behind the scenes. Q?rius is designed as a flexible space for walk-in visitors visiting exhibitions at the Museum as well as a program space. Given the breadth of experiences available in the space, the scope of the evaluation specifically targeted walk-in youth and adult visitors to Q?rius.
These resources are designed to identify opportunities to improve training for educators and researchers during implementation of the Living Laboratory model. The Data Collection Guidelines provide general instructions and tips for conducting evaluation through observations of (and/or interviews with) visitors. Two versions of each instrument (Researcher-Caregiver Conversations Instrument and Research Toy Interactions Instrument) are included: one can be modified and printed for data collection; the second is an annotated version, which includes more detailed instructions for each item in the
This pathways project will study how audiences in public spaces, in this case those in a museum setting, relate to and make sense of large data displays. The project is preliminary to development of a traveling, hands-on exhibition enabling users to create and utilize representations of big data displays such as maps and charts. As the test case, the project will use science maps that provide an overview of science generally and specific areas of STEM, charting and exploring the history and future of science and technology. The data collection portion of the project will take place at the New York Hall of Science, the Marian Koshland Science Museum, COSI in Columbus, Ohio, and WonderLab Museum in Bloomington, Indiana. The project will create a foundation for the design of museum exhibits and educational programs that teach museum visitors how to explore, engage and make better sense of big data. The project is potentially transformative because big data is becoming ubiquitous and making sense out of large data displays is necessary in order to understand big data sets.
This pathways project would refine and test a game based on the Kinect technology gaming tool to teach seismology concepts in an informal education setting and how they apply to phenomenon in other STEM fields. The game will be developed as a companion tool to the "Quake Catcher Network" a low-cost network of seismic sensors in schools, homes and offices world-wide and tie-ins with seismology programs such as the great California ShakeOut with a participant base of 8.6 million. The project design would select three new learning modules, chosen by a group of scientists and educators, to incorporate into the game and evaluate player experience and knowledge gain. The activities will be conducted at a partner test site, an aquarium, frequented by area youth 8 - 12 years old. The focus of the effort is to add to the knowledge of how gaming can be used effectively in informal learning environments The game places the player as a scientist, allowing the player to make decisions about seismic station deployment strategies following an earthquake, installing the sensors and monitoring incoming data. The game has levels of difficulty and players accrue points by acting swiftly and correctly. Learning goals for the project include making abstract math concepts understandable; involve participants in data collection and the process of scientific investigation, plus demonstrate how scientists and mathematicians use tools of their fields to address real-world issues.
The University of Chicago's Yerkes Observatory, the National Radio Astronomy Observatory, the University of North Carolina, the Astronomical Society of the Pacific, and 4-H are collaborating to provide professional development to 180 4-H leaders and other informal science educators, and engage 1,400 middle school youth in using research-grade robotic telescopes and data analysis tools to explore the Universe. Youth participating in 4H-based out-of-school programs in Wisconsin, West Virginia and North Carolina are learning about the universe and preparing for STEM careers by conducting authentic astronomy research, completing astronomy-related hands-on modeling activities, interacting with astronomers and other professionals who are part of the Skynet Robotic Telescope Network, and interacting with other youth who part of the Skynet Junior Scholars virtual community. The project is innovative because it is providing a diverse community of 4-H youth (including sight- and hearing-challenged youth and those from underrepresented groups) with opportunities to use high-quality, remotely located, Internet-controlled telescopes to explore the heavens by surveying galaxies, tracking asteroids, monitoring variable stars, and learn about the nature and methods of science. Deliverables include (1) online access to optical and radio telescopes, data analysis tools, and professional astronomers, (2) an age-appropriate web-based interface for controlling remote telescopes, (3) inquiry-based standards-aligned instructional modules, (4) face-to-face and online professional development for 4-H leaders and informal science educators, (5) programming for youth in out-of-school clubs and clubs, (6) evaluation findings on the impacts of program activities on participants, and (7) research findings on how web-based interactions between youth and scientists can promote student interest in and preparedness for STEM careers. The evaluation plan is measuring the effectiveness of program activities in (1) increasing youths' knowledge, skills, interest, self-efficacy, and identity in science, including youth who are sight- and hearing-impaired, (2) increasing educators' competency in implementing inquiry-based instruction and their ability to interact with scientists, and (3) increasing the number of Skynet scientists who are involved in education and public outreach.
The University of Southern California (USC) will build on prior work to test a robust model for assessing player content engagement and social interactions within an augmented reality game (ARG). In partnership with No Mimes Media, USC will use machine learning algorithms to make automated player inferences to customize game play. The content focus of the game will span a range of STEM disciplines, with a special emphasis on earth science content and scientific investigation & experimentation reasoning. High school youth from underserved communities in Los Angeles will be recruited to participate in the endeavor. This pathways project will use various "rabbit hole" techniques to attract freshmen and sophomore students from partner charter schools to the online game. The rabbit hole strategies may include cryptic posters, inquisitive signs, & SQR codes strategically placed in plain and open view of the target group. The game will be fully accessible to the target group online. During the ARG experience, youth players will encounter STEM concepts and scientific problems. Antagonistic characters will promulgate scientific misconceptions and nonscientific reasoning and challenge players to employ their scientific knowledge and skills to level-up, gain badges, and move through the game. As game play persists, machine learning algorithms will gather data on the players learning competencies and social interactions within the game. These data will be aggregated and analyzed to assess learning and interactions within the ARG environment. Additional analyses will be conducted by the mixed methods approach the external evaluation group, CRESST, will employ for the project formative and summative evaluations. Approximately 300 youth, within the target grade levels, are expected to participate in the gaming experience. However, given that access to the game and assessment tools will expand beyond the target group, the potential reach of the project could be much greater. Further, the stated aim of the project is not only to produce a scalable model for broad implementation but it also endeavors to provide puppetmasters with research and assessment tools to create more individualized experiences and improved learning outcomes for players within ARG environments.
DATE:
-
TEAM MEMBERS:
Yu-Han ChangJihie KimRajiv Maheswaran
Iridescent is a not-for-profit company that develops and implements informal science and engineering experiences for students by facilitating the translation of the work that scientists and engineers do in a way that makes that work accessible to families. The proposal expands the Iridescent outreach activities funded by the Office of Naval Research, to provide a blended combination of in-person and online support to the families of underrepresented populations. The project is producing twenty videos of scientists and engineers presenting their research that are closely aligned with one hundred scientific inquiry and engineering design-based experiments and lesson plans. These digital resources, collectively called the Curiosity Machine, provide opportunities for parents and children to engage in scientific inquiry and engineering design in multiple face-to-face and online environments, including mobile technologies. The evaluation findings from this project provide a model of how to engage STEM education practitioners, teachers and online communities, to substantively connect underserved communities, in both informal and more formal learning environments to develop experiences with engineering design and to improve students' perspectives about and motivations to prepare for STEM careers. The Curiosity Machine portal is designed to present scientists and engineers explaining the work that they do in a way that makes it accessible to parents and students. Iridescent is working at three sites across the country in South Los Angeles, the South Bronx in New York City, and San Francisco. Students and their families have multiple access points to the science and engineering videos and materials through after school activities, Family Science Nights and summer camps. The project is piloting the use of electronic badges, similar to those offered in the Boy and Girl Scouts as a mechanism to enhance the engagement and persistence of students in the online activities. The project is developing ways to evaluate student engagement and performance through the analysis of the products that students submit online in response to particular science and engineering challenges. Students can also gain extra credit at school for their participation in the Curiosity Machine activities. The materials that the Curiosity Machine activities and challenges use are those that are commonly available to families, and the project provides access to mobile technology to facilitate participation by families. Student access to out of school science and engineering experiences is limited by the resources in terms of time and availability science centers have available. This project develops the resources and tools to bridge the in-school and out of school activities for students through the use of videos and online participation in ways that expand the opportunity of students from underserved populations to continue to engage in substantive science and engineering experiences beyond what they might get during an intermittent visit to a science center. The research and evaluation that is part of this study provides information about how new forms of extrinsic motivation might be used to support student engagement and persistence in learning about science and engineering.
Rockman et al (REA), a San Francisco-based research and evaluation firm, conducted the external evaluation for Youth Radio's DO IT! program, which was funded by the National Science Foundation. Building upon Youth Radio's previous Science and Technology Program, the DO IT! initiative consisted of three primary components that promoted STEM (science, technology, engineering, and mathematics) learning by training underserved youth in cutting-edge digital technologies: (1) Brains and Beakers: Young people hosted a line-up of investigators and inventors for demo-dialogues at Youth Radio's studios
DATE:
TEAM MEMBERS:
Rockman et al | Youth RadioKristin BassJulia Hazer
In 2010 EarthSky Communications Inc. was awarded a broad implementation grant from the National Science Foundation (NSF) entitled Proyecto de Implementacion Amplia EarthSky en Español (EarthSky in Spanish Broad Implementation Project). In partnership with the Spanish media company Univision Communications Inc. and a national Advisory Committee of Hispanic scientists, educators, and media experts, EarthSky proposed to present science information and scientist interviews to Spanish-preferring U.S. Hispanics via short video programs distributed on television and the Internet. Under the Broad
DATE:
TEAM MEMBERS:
Knight Williams Inc.Valerie Knight-WilliamsDeborah ByrdRachel TeelDivan WilliamsRoxana HernandezEric AndersonGabriel SimmonsSauleh Rahbari
The adoption of the Next Generation Science Standards means that many educators who adhere to model-based reasoning styles of science will have to adapt their programs and curricula. In addition, all practitioners will have to teach modeling, and model-based reasoning is a useful way to do so. This brief offers perspectives drawn from Lehrer and Schauble, two early theorists in model-based reasoning.
This poster was presented at the 2014 AISL PI Meeting held in Washington, DC. It describes a project that uses museum-based exhibits, girls' activity groups, and social media to enhance participants' engineering-related interests and identities.