Skip to main content

Community Repository Search Results

resource evaluation Public Programs
In August 2012, the National Museum of Natural History (NMNH) contracted with Audience Focus (AF), a Maryland-­‐based research and evaluation organization, to evaluate visitors’ experiences with the Scientist Is In program. Specifically, AF was asked to design a comprehensive study that would provide insight into the nature of visitors’ engagement with the program, and how participation in the program influenced visitors’ understanding of and curiosity about science topics, awareness of science careers, perceptions of NMNH as a research institution, and recognition of the connections between
DATE:
TEAM MEMBERS: Jeanine Ancelet Kara Hershorin
resource project Public Programs
In late 2012, Providence Children’s Museum began a major three-year research project in collaboration with The Causality and Mind Lab at Brown University, funded by a grant from the National Science Foundation (1223777). Researchers at Brown examined how children develop scientific thinking skills and understand their own learning processes. The Museum examined what caregivers and informal educators understand about learning through play in its exhibits and how to support children’s metacognition – the ability to notice and reflect on their own thinking – and adults’ awareness and appreciation of kids’ thinking and learning through play. Drawing from fields like developmental psychology, informal education and museum visitor studies, the Museum’s exhibits team looked for indicators of children’s learning through play and interviewed parents and caregivers about what they noticed children doing in the exhibits, asking them to reflect on their children’s thinking. Based on the findings, the research team developed and tested new tools and activities to encourage caregivers to notice and appreciate the learning that takes place through play.
DATE: -
TEAM MEMBERS: Robin Meisner David Sobel Susan Letourneau Jessica Neuwirth Valerie Haggerty-Silva Chris Sancomb Camellia Sanford-Dolly Claire Quimby
resource project Exhibitions
This pathways project will study how audiences in public spaces, in this case those in a museum setting, relate to and make sense of large data displays. The project is preliminary to development of a traveling, hands-on exhibition enabling users to create and utilize representations of big data displays such as maps and charts. As the test case, the project will use science maps that provide an overview of science generally and specific areas of STEM, charting and exploring the history and future of science and technology. The data collection portion of the project will take place at the New York Hall of Science, the Marian Koshland Science Museum, COSI in Columbus, Ohio, and WonderLab Museum in Bloomington, Indiana. The project will create a foundation for the design of museum exhibits and educational programs that teach museum visitors how to explore, engage and make better sense of big data. The project is potentially transformative because big data is becoming ubiquitous and making sense out of large data displays is necessary in order to understand big data sets.
DATE: -
TEAM MEMBERS: Katy Borner Joe E Heimlich Adam Maltese
resource project Media and Technology
This pathways project would refine and test a game based on the Kinect technology gaming tool to teach seismology concepts in an informal education setting and how they apply to phenomenon in other STEM fields. The game will be developed as a companion tool to the "Quake Catcher Network" a low-cost network of seismic sensors in schools, homes and offices world-wide and tie-ins with seismology programs such as the great California ShakeOut with a participant base of 8.6 million. The project design would select three new learning modules, chosen by a group of scientists and educators, to incorporate into the game and evaluate player experience and knowledge gain. The activities will be conducted at a partner test site, an aquarium, frequented by area youth 8 - 12 years old. The focus of the effort is to add to the knowledge of how gaming can be used effectively in informal learning environments The game places the player as a scientist, allowing the player to make decisions about seismic station deployment strategies following an earthquake, installing the sensors and monitoring incoming data. The game has levels of difficulty and players accrue points by acting swiftly and correctly. Learning goals for the project include making abstract math concepts understandable; involve participants in data collection and the process of scientific investigation, plus demonstrate how scientists and mathematicians use tools of their fields to address real-world issues.
DATE: -
TEAM MEMBERS: Deborah Kilb
resource project Media and Technology
The University of Chicago's Yerkes Observatory, the National Radio Astronomy Observatory, the University of North Carolina, the Astronomical Society of the Pacific, and 4-H are collaborating to provide professional development to 180 4-H leaders and other informal science educators, and engage 1,400 middle school youth in using research-grade robotic telescopes and data analysis tools to explore the Universe. Youth participating in 4H-based out-of-school programs in Wisconsin, West Virginia and North Carolina are learning about the universe and preparing for STEM careers by conducting authentic astronomy research, completing astronomy-related hands-on modeling activities, interacting with astronomers and other professionals who are part of the Skynet Robotic Telescope Network, and interacting with other youth who part of the Skynet Junior Scholars virtual community. The project is innovative because it is providing a diverse community of 4-H youth (including sight- and hearing-challenged youth and those from underrepresented groups) with opportunities to use high-quality, remotely located, Internet-controlled telescopes to explore the heavens by surveying galaxies, tracking asteroids, monitoring variable stars, and learn about the nature and methods of science. Deliverables include (1) online access to optical and radio telescopes, data analysis tools, and professional astronomers, (2) an age-appropriate web-based interface for controlling remote telescopes, (3) inquiry-based standards-aligned instructional modules, (4) face-to-face and online professional development for 4-H leaders and informal science educators, (5) programming for youth in out-of-school clubs and clubs, (6) evaluation findings on the impacts of program activities on participants, and (7) research findings on how web-based interactions between youth and scientists can promote student interest in and preparedness for STEM careers. The evaluation plan is measuring the effectiveness of program activities in (1) increasing youths' knowledge, skills, interest, self-efficacy, and identity in science, including youth who are sight- and hearing-impaired, (2) increasing educators' competency in implementing inquiry-based instruction and their ability to interact with scientists, and (3) increasing the number of Skynet scientists who are involved in education and public outreach.
DATE: -
TEAM MEMBERS: Richard Kron Suzanne Gurton Daniel Reichart Sue Ann Heatherly
resource project Media and Technology
The Virginia Institute of Marine Science (VIMS) and The Watermen's Museum, Yorktown, VA, will produce an underwater robotics research and discovery education program in conjunction with time-sensitive, underwater archeological research exploring recently discovered shipwrecks of General Cornwallis's lost fleet in the York River. The urgency of the scientific research is based upon the dynamic environment of the York River with its strong tidal currents, low visibility, and seasonal hypoxia that can rapidly deteriorate the ships, which have been underwater since 1781. Geophysical experts believe that further erosion is likely once the wrecks are exposed. Given the unknown deterioration rate of the shipwrecks coupled with the constraints of implementing the project during the 2011-2012 school-year, any delays would put the scientific research back at least 18 months - a potentially devastating delay for documenting the ships. The monitoring and studying of the historic ships will be conducted by elementary through high school-aged participants and their teachers who will collect the data underwater through robotic missions using VideoRay Remotely Operated Vehicles (ROVs) and a Fetch Automated Underwater Vehicle (AUV) from a command station at The Watermen's Museum. Students and teachers will be introduced to the science, mathematics, and integrated technologies associated with robotic underwater research and will experience events that occur on a real expedition, including mission planning, execution, monitoring, and data analysis. Robotic missions will be conducted within the unique, underwater setting of the historical shipwrecks. Such research experiences and professional development are intended to serve as a key to stimulating student interest in underwater archeological research, the marine environment and ocean science, advanced research using new technologies, and the array of opportunities presented for scientific and creative problem solving associated with underwater research. A comprehensive, outcomes-based formative and summative, external evaluation of the project will be conducted by Dr. L. Art Safer, Loyola University. The evaluation will inform the project's implementation efforts and investigate the project's impact. The newly formed partnership between the Waterman's Museum and VIMS will expand the ISE Program's objectives to forge new partnerships among informal venues, and to expand the use of advanced technologies for informal STEM learning. Extensive public dissemination during and after the project duration, includes but is not limited to, hosting an "Expedition to the Wrecks" web portal on the VIMS BRIDGE site for K-12 educators providing real-time results of the project and live webcasts. The website will be linked to the education portal at the Association for Unmanned Vehicle Systems International, the world's largest organization devoted to promoting unmanned systems and to the FIRST Robotics community through the Virginia portal. The website will be promoted through scientific societies, the National Marine Educators Association, National Science Teachers Association, and ASTC. Links will be provided to the Center for Archeological Research at the College of William and Mary and the Immersion Presents web portal--consultants to Dr. Bob Ballard's K-12 projects and JASON explorations. The NPS Colonial National Historic Park and the Riverwalk Landing will create public exhibits about the shipwreck's archeological and scientific significance, and will provide live observation of the research and the exploration technologies employed in this effort.
DATE: -
TEAM MEMBERS: Mark Patterson
resource project Media and Technology
The University of Southern California (USC) will build on prior work to test a robust model for assessing player content engagement and social interactions within an augmented reality game (ARG). In partnership with No Mimes Media, USC will use machine learning algorithms to make automated player inferences to customize game play. The content focus of the game will span a range of STEM disciplines, with a special emphasis on earth science content and scientific investigation & experimentation reasoning. High school youth from underserved communities in Los Angeles will be recruited to participate in the endeavor. This pathways project will use various "rabbit hole" techniques to attract freshmen and sophomore students from partner charter schools to the online game. The rabbit hole strategies may include cryptic posters, inquisitive signs, & SQR codes strategically placed in plain and open view of the target group. The game will be fully accessible to the target group online. During the ARG experience, youth players will encounter STEM concepts and scientific problems. Antagonistic characters will promulgate scientific misconceptions and nonscientific reasoning and challenge players to employ their scientific knowledge and skills to level-up, gain badges, and move through the game. As game play persists, machine learning algorithms will gather data on the players learning competencies and social interactions within the game. These data will be aggregated and analyzed to assess learning and interactions within the ARG environment. Additional analyses will be conducted by the mixed methods approach the external evaluation group, CRESST, will employ for the project formative and summative evaluations. Approximately 300 youth, within the target grade levels, are expected to participate in the gaming experience. However, given that access to the game and assessment tools will expand beyond the target group, the potential reach of the project could be much greater. Further, the stated aim of the project is not only to produce a scalable model for broad implementation but it also endeavors to provide puppetmasters with research and assessment tools to create more individualized experiences and improved learning outcomes for players within ARG environments.
DATE: -
TEAM MEMBERS: Yu-Han Chang Jihie Kim Rajiv Maheswaran
resource project Media and Technology
Iridescent is a not-for-profit company that develops and implements informal science and engineering experiences for students by facilitating the translation of the work that scientists and engineers do in a way that makes that work accessible to families. The proposal expands the Iridescent outreach activities funded by the Office of Naval Research, to provide a blended combination of in-person and online support to the families of underrepresented populations. The project is producing twenty videos of scientists and engineers presenting their research that are closely aligned with one hundred scientific inquiry and engineering design-based experiments and lesson plans. These digital resources, collectively called the Curiosity Machine, provide opportunities for parents and children to engage in scientific inquiry and engineering design in multiple face-to-face and online environments, including mobile technologies. The evaluation findings from this project provide a model of how to engage STEM education practitioners, teachers and online communities, to substantively connect underserved communities, in both informal and more formal learning environments to develop experiences with engineering design and to improve students' perspectives about and motivations to prepare for STEM careers. The Curiosity Machine portal is designed to present scientists and engineers explaining the work that they do in a way that makes it accessible to parents and students. Iridescent is working at three sites across the country in South Los Angeles, the South Bronx in New York City, and San Francisco. Students and their families have multiple access points to the science and engineering videos and materials through after school activities, Family Science Nights and summer camps. The project is piloting the use of electronic badges, similar to those offered in the Boy and Girl Scouts as a mechanism to enhance the engagement and persistence of students in the online activities. The project is developing ways to evaluate student engagement and performance through the analysis of the products that students submit online in response to particular science and engineering challenges. Students can also gain extra credit at school for their participation in the Curiosity Machine activities. The materials that the Curiosity Machine activities and challenges use are those that are commonly available to families, and the project provides access to mobile technology to facilitate participation by families. Student access to out of school science and engineering experiences is limited by the resources in terms of time and availability science centers have available. This project develops the resources and tools to bridge the in-school and out of school activities for students through the use of videos and online participation in ways that expand the opportunity of students from underserved populations to continue to engage in substantive science and engineering experiences beyond what they might get during an intermittent visit to a science center. The research and evaluation that is part of this study provides information about how new forms of extrinsic motivation might be used to support student engagement and persistence in learning about science and engineering.
DATE: -
TEAM MEMBERS: Tara Chklovski
resource project Professional Development, Conferences, and Networks
The Coalition for Science After School (CSAS) was established in 2004 in response to the growing need for more STEM (science, technology, engineering, and mathematics) learning opportunities in out-of-school time. CSAS sought to build this field by uniting STEM education goals with out-of-school time opportunities and a focus on youth development. Over a decade of work, CSAS Steering Committee members, staff and partners advocated for STEM in out-of-school-time settings, convened leaders, and created resources to support this work. CSAS leadership decided to conclude CSAS operations in 2014, as the STEM in out-of-school time movement had experienced tremendous growth of programming and attention to science-related out-of-school time opportunities on a national level. In its ten-year strategic plan, CSAS took as its vision the full integration of the STEM education and out-of-school time communities to ensure that quality out-of-school time STEM opportunities became prevalent and available to learners nationwide. Key CSAS activities included: (1) Setting and advancing a collective agenda by working with members to identify gaps in the field, organizing others to create solutions that meet the needs, identifying policy needs in the field and supporting advocates to advance them; (2) Developing and linking committed communities by providing opportunities for focused networking and learning through conferences, webinars, and other outreach activities; and (3) Identifying, collecting, capturing, and sharing information and available research and resources in the field. The leadership of the Coalition for Science After School is deeply grateful to the funders, partners, supporters, and constituents that worked together to advance STEM in out-of-school time during the last decade, and that make up today's rich and varied STEM in out-of-school time landscape. We have much to be proud of, but as a movement there is much more work to be done. As this work continues to expand and deepen, it is appropriate for the Coalition for Science After School to step down as the many other organizations that have emerged over the last decade take on leadership for the critical work that remains to be done. A timeline and summary of CSAS activities, products, and accomplishments is available for download on this page. All resources noted in the narrative are also available for download below.
DATE: -
TEAM MEMBERS: Judy Nee Elizabeth Stage Dennis Bartels Lucy Friedman Jane Quinn Pam Garza Gabrielle Lyon Jodi Grant Frank Davis Kris Gutierrez Bernadette Chi Carol Tang Mike Radke Jason Freeman Bronwyn Bevan Leah Reisman Sarah Elovich Kalie Sacco
resource research Media and Technology
One of the most recent additions to the range of Immersive Virtual Environments has been the digital fulldome. However, not much empirical research has been conducted to explore its potential and benefits over other types of presentation formats. In this review we provide a framework within which to examine the properties of fulldome environments and compare them to those of other existing immersive digital environments. We review the state-of-the-art of virtual reality technology, and then survey core areas of psychology relevant to experiences in the fulldome, including visual perception
DATE:
TEAM MEMBERS: Simone Schnall Craig Hedge Ruth Weaver
resource research Public Programs
Mueller, Tippins, and Bryan's contrast of the current limitations of science education with the potential virtues of citizen science provides an important theoretical perspective about the future of democratized science and K-12 education. However, the authors fail to adequately address the existing barriers and constraints to moving community-based science into the classroom. We contend that for these science partnerships to be successful, teachers, researchers, and other program designers must reexamine questions about traditional science education and citizen-science programs and attend to
DATE:
TEAM MEMBERS: Steven Gray Kristina Nicosia Rebecca Jordan
resource research Media and Technology
This report summarizes an extensive review of the literature on assessment of learning in such informal settings as after-school programs, museums and science centers, community-based organizations, and online communities. In addition, we convened three expert meetings involving a total of 25 participants to discuss key issues, identify successful approaches and outstanding challenges, and review summaries of prior meetings in the series. Our aim is twofold: first, to offer to those who design and assess informal learning programs a model of good assessment practice, a toolkit of methods and
DATE:
TEAM MEMBERS: Jay Lemke Robert Lecusay Mike Cole Vera Michalchik