A frequently missing element in environmental education programs is a concerted effort by communities, organizations, government, and academic stakeholders to build meaningful partnerships and cultivate informal science learning opportunities via public participation in environmental research. This collaborative approach not only makes scientific information more readily available, it also engages community members in the processes of scientific inquiry, synthesis, data interpretation, and the translation of results into action. This project will build a co-created citizen science program coupled with a peer education model and an extensive communication of results to increase environmental STEM literacy. The project targets historically underrepresented populations that are likely to be disproportionately impacted by climate, water scarcity, and food security. Based upon past needs assessments in the targeted communities, gardens irrigated by harvested rainwater will become hubs for environmental STEM education and research. For this project, gardens irrigated by harvested rainwater will serve as hubs for environmental literacy education efforts. Researchers from the University of Arizona and Sonora Environmental Research Institute will work alongside community environmental health workers, who will then train families residing in environmentally compromised areas (urban and rural) on how to monitor their soil, plant, and harvested water quality. The project aims to: (1) co-produce environmental monitoring, exposure, and risk data in a form that will be directly relevant to the participants' lives, (2) increase the community's involvement in environmental decision-making, and (3) improve environmental STEM literacy and learning in underserved rural and urban communities. The project will investigate and gather extensive quantitative and quantitative data to understand how: (1) participation in a co-created citizen science project enhances a participant's overall environmental STEM literacy; (2) a peer-education model coupled with a co-created citizen science program affects participation of historically underrepresented groups in citizen science; and (3) the environmental monitoring approach influences the participant's environmental health learning outcomes and understanding of the scientific method. In parallel, this project will evaluate the role of local-based knowledge mediators and different mechanisms to communicate results. These findings will advance the fields of informal science education, environmental science, and risk communication. Concomitantly, the project will facilitate the co-generation of a robust dataset that will not only inform guidelines and recommendations for harvested rainwater use, it will build capacity in underserved communities and inform the safe and sustainable production of food sources. This research effort is especially critical for populations in arid and semiarid environments, which account for ~40% of the global land area and are inhabited by one-third of the world's population. This program will be available in English and Spanish and can truly democratize environmental STEM research and policy. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
This project formed a partnership between a research team with experience in computer science (CS) education and learning sciences research and a newly fashioned practitioner team focused on building a grassroots, informal, volunteer group created to help women help themselves and others learn to write computer code. This research-practitioner partnership had a two-pronged focus, first on improving the program offered to learners through making adjustments based on research findings, and second on investigating the phenomenon of how women in the workforce informally learn CS skills that enable them to rewrite their career paths to contribute to what we know from research. The context of the study was situated in the virtual community that has formed around the phenomenally successful Salesforce Customer Relationship Management software platform.
This Exploratory Pathways project aimed to fill a gap in the research; we know little about the phenomenon of adult women in the workforce who are patching together resources to learn CS skills with a goal of job enhancement or job change. This project took an ethnographic approach to studying the informal learning (both through online, written resources and through sharing of knowledge with others) of the women involved in a 10-week, virtual Women’s Coaching and Learning group. The organization of this group consisted of learners—novice coders in the Apex language that is used on the Salesforce software platform, of coaches—more knowledgeable coders, and of a steering committee that ran the group and created the informal curriculum followed in the 10-week course.
Our overarching research question in this study was: In what ways are informal CS learning opportunities being used and created by adult women, what are their experiences with those opportunities, and how does this suggest ways to enhance those opportunities in the future to increase effectiveness in broadening access to and engagement in informal CS learning experiences for women?
We broke the question down into a number of sub questions, including:
Sociocultural context: What past gendered interactions do women report that discouraged (or encouraged) them from learning to code? What do interactions look like in female-only coaching and learning groups? In what ways does a coaching and learning group support persistence? What social barriers and supports outside the group affect persistence?
Personal context: What are the characteristics and backgrounds of female administrators who seek out resources to teach themselves to code? What are the motivations for these women to teach themselves to code? What motivates them to seek out and join all-women coding groups?
Physical context: How are women learning to code both through written resources and in virtual, informal coaching and learning classes? What are the conceptual barriers and supports that they encounter, and what works for women in these classes to overcome barriers? What conceptual barriers and supports affect persistence?
Persistence and identity: In what ways does participating in a learning group with female coaching motivate (or not) women to persist in learning to code? How do their goals or reasons for learning to code change through their participation? How does their identity as a “coder” change or shift as they participate?
Our findings for these subquestions are summarized in the “project products” linked to below.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program supports new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This project will meet this goal through rigorous research and the broad implementation of an environmental science literacy professional development and learning program for informal educators and youth engaged in outdoor science programs (OSP). With growing support from the literature and the Next Generation Science Standards (NGSS), much attention has been placed on creating and leveraging interdisciplinary science learning opportunities beyond science classrooms. As such, an estimated 300 residential OSPs currently exist in the United States. Unfortunately, the informal educators often charged with facilitating these deep and impactful science learning experiences often lack robust formal training in evidenced-based, age-appropriate environmental science content knowledge and pedagogy specific for the youth in their programs. This issue is often more pronounced in under-resourced and under-served programs and communities. This project will directly address these pervasive challenges in the field by not only providing much needed science focused professional development and resources to informal educators but also by specifically targeting and training informal leaders and educators serving youth in predominately rural areas, low-income communities, and underrepresented communities.
Approximately 200 OSP leaders at 100 OSPs around the country will participate in a week-long, intensive training in the professional development model at one of five regional residential leadership institutes. OSP leaders will then redeliver the training to the approximately 1,500 OSP educators/field instructors in their home institutions. The OSP educators/field instructors will then use what they learn through the professional development to facilitate the environmental science learning program (i.e., curriculum, field experiences, resources, pedagogy) to over 1 million youth (grades 3-8) enrolled in their residential outdoor science programs. In addition, a rigorous implementation study, efficacy study and evaluation will be conducted. The implementation study will investigate: (a) Which of the professional learning model practices were implemented and (b) What successes and challenges the programs faced implementing the model. The mixed methods efficacy study will explore: (a) if outdoor science programs contribute to the development of science learning activation and environmental literacy? and (b) what are the features of these experiences that are correlated with increases in science learning activation and environmental literacy. Approximately 25-35 youth will be randomly selected from each of 50 randomly selected sites to participate in the efficacy study. The data and findings from the research and evaluation produced by this project will contribute to a relatively sparse knowledge and research base specific to youth efficacy and implementation processes and practices across nearly 1/3 of the estimated 300 existing residential outdoor science programs in the United States.
The connections between technology applications of all sorts and human users that are ubiquitous in informal learning and assume a great deal about how the technology is used and how learning takes place. Much of the research in this area has been focused on game design and interaction. This project will examine this interaction involving the use of gestures that represent how individuals work with systems and large data sets that represent complex systems like the oceans, to understand how basic elements of a project with a 3-D type of design might enhance the user experience and increase the utility and learning that takes place by understanding the cognitive elements of these game like interactions in specific STEM related settings like museums.
This exploratory pathways project will investigate the use of interactive, gesture-enabled, multi-touch spheres for teaching about ocean systems in science centers and museums. The gesture-enabled aspect of the project will improve on interactive table-top installations which can frustrate users who use unexpected gestures and receive no response leading to brief interaction and abandonment without significant interaction or learning. The project will investigate ways in which unsupported gestures would still produce a system response which would encourage the user to remain at the installation and continue to investigate. The effect of multiple gestures will be supported by using natural mappings between gestures and interactions with the on-sphere data.
The project investigates theories of embodied cognition that support the notion that by engaging with global-scale datasets on a spherical display more effectively models the earth in a non-distorted manner and therefore will be more natural and allow users to develop a more accurate conceptual model of how data relates to itself and the globe. In this way, the project shares some aspects of understanding about learning through game play. The sphere will not be a fully developed game but will share characteristics of game play.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Chemistry is an important and widely relevant field of science. However, when compared with other STEM content areas, chemistry is under-represented in U.S. science museums and other informal educational environments. This project will build, and build knowledge about, innovative approaches to delivering informal science learning activities in chemistry. The project will not only increase public interest and understanding of chemistry but also increase public perception of chemistry's relevance and increase the public's self-efficacy with respect to chemistry. This project outcomes will include a guide for practitioners along with activity materials that will be packaged into a kit, distributed, and replicated for use by informal science educators, chemists, and chemistry students at 250 sites across the U.S. The project team will reach out to organizations that serve diverse audiences and diverse geographic locations, including organizations in rural and inner-city areas. The kits will provide guidance on engaging girls, people with various abilities, Spanish speakers, and other diverse audiences, and include materials in Spanish. Written guides, training videos, and training slides will be included to support training in science communication in general, as well as chemistry in particular. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
This project will take an innovative approach to develop informal educational activities and materials about chemistry. Rather than starting with content goals, the project will start with a theoretical framework drawn from research about affecting attitudes about science related to interest, relevance, and self-efficacy. A design-based research approach (DBR) will be used to apply that framework to the development of hands-on educational activities about chemistry, while also testing and modifying the framework itself. (DBR blends empirical educational research with the theory-driven design of learning environments.) Existing or new educational activities that appear to embody key characteristics defined in the framework will be tested with public audiences for their impact on visitors. Researchers and educators will determine how different characteristics of the educational activities defined in the framework affect the outcomes. The activities will be modified and tested iteratively until the investigators achieve close alignment between framework and impacts.. The project team will continue the design-based research approach both to examine groups of activities in which synergies can have impacts beyond single interactions as well as to examine varied ways of training facilitators who can also significantly affect outcomes. In this way, the project will generate knowledge about how kits of hands-on informal learning activities can stimulate attitudes of interest, relevance, and self-efficacy with respect to the neglected field of chemistry. The project teams will broadly disseminate project outcomes within the educational research, science and informal Science, Technology, Engineering and Mathematics (STEM) education communities. While this project will focus on chemistry, the strategies it will develop and test through a design-based research process will provide valuable insight into effective approaches for informal STEM education more broadly.
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the teach pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeks to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia, PA. As such, this project will deepen understandings of program replication and of addressing the needs of youth in economically-challenged communities in order to promote mathematics learning.
The project's research studies will assess the multiple factors that make Math Corps successful with youth in Detroit and document the implementation of the program to the three replication sites. Research methods include discourse analyses, surveys, interviews, and pre/post-tests. The project will also conduct a retrospective evaluation of Math Corps based on quantitative datasets regarding both near-term and long-term youth outcomes.
This projects is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This Research in Service to Practice project will examine how a wide range of pre-college out-of-school-time activities facilitate or hinder females' participation in STEM fields in terms of interest, identity, and career choices. The study will address the ongoing problem that, despite females' persistence to degree once declaring a major in college, initially fewer females than males choose a STEM career path. To uncover what these factors might be, this study will look at the extent to which college freshmen's pre-college involvement in informal activities (e.g., science clubs, internships, shadowing of STEM professionals, museum-going, engineering competitions, citizen science pursuits, summer camps, and hobbies) is associated with their career aspirations and avocational STEM interests and pursuits. While deep-seated factors, originating in culture and gender socialization, sometimes lower females' interest in STEM throughout schooling, this study will examine the degree to which out-of-school-time involvement ameliorates the subtle messages females encounter about women and science that can interfere with their aspiration to a STEM careers.
The Social Cognitive Career Theory will serve as the theoretical framework to connect the development of interest in STEM with students' later career choices. An epidemiological approach will be used to test a wide range of hypotheses garnered from a review of relevant literature, face-to-face or telephone interviews with stakeholders, and retrospective online surveys of students. These hypotheses, as well as questions about the students' demographic background and in-school experiences, will be incorporated into the main empirical instrument, which will be a comprehensive paper-and-pencil survey to be administered in classes, such as English Composition, that are compulsory for both students with STEM interests and those without by 6500 students entering 40 large and small institutions of higher learning. Data analysis will proceed from descriptive statistics, such as contingency tables and correlation matrices, to multiple regression and hierarchical modeling that will link out-of-school-time experiences to STEM interest, identity, and career aspirations. Factor analysis will be used to combine individual out-of-school activities into indices. Propensity score weighting will be used to estimate causal effects in cases where out-of-school-time activities may be confounded with other factors. The expected products will be scholarly publications and presentations. Results will be disseminated to out-of-school-time providers and stakeholders, educators, and educational researchers through appropriate-level journals and national meetings and conferences. In addition, the Public Affairs and Information Office of the Harvard-Smithsonian Center for Astrophysics will assist with communicating results through mainstream media. Press releases will be available through academic outlets and Op-Ed pieces for newspapers. The expected outcome will be research-based evidence about which types of out-of-school STEM experiences may be effective in increasing young females' STEM interests. This information will be crucial to educators, service providers, as well as policy makers who work toward broadening the participation of females in STEM.
DATE:
-
TEAM MEMBERS:
Roy GouldPhilip SadlerGerhard Sonnert
resourceprojectProfessional Development, Conferences, and Networks
With support from NSF/AISL, the Exploratorium held the Generating Engagement and New Initiatives for All Latinos (GENIAL) Summit on June 5-6, 2017, in San Francisco, California.
The goals of the GENIAL Summit were to:
- Identify needs and opportunities for Latinos in informal science learning (ISL) environments.
- Facilitate and strengthen professional relationships.
- Identify recommendations and actionable insights with an outlook toward the future.
- Contribute to a more informed ISL field.
A total of 91 participants, a mix of practitioners, community leaders, media specialists, government officials, policy professionals, and researchers from across the United States and Puerto Rico participated in the Summit.
Summit outcomes will include: strengthened partnerships and new collaborations; examples of how participants of the GENIAL summit are applying the results of the gathering in their practice; and dissemination sessions, webinars, and post-summit documentation and articles with the results of GENIAL.
The Northwest Passage Project (NPP) is a collaborative effort between the University of Rhode Island (URI), Inner Space Center (ISC), Graduate School of Oceanography (GSO), the film company David Clark Inc., and several other partners, including six Minority Serving Institutions (MSIs) and three informal science education institutions. The project centers on a research expedition into the Arctic's Northwest Passage, which will engage intergenerational cohorts of high school, undergraduate, and graduate students in hands-on research aboard the U.S. tall ship SSV Oliver Hazard Perry (OHP). During the expedition, a professional film crew will produce a two-hour documentary focused on the NPP's innovative model of interdisciplinary informal STEM (science, technology, engineering, and mathematics) learning and highlight the expedition's research, participants, and the sociological issues related to the changing Arctic environment. Because the Canadian Arctic is remote and costly to access, the project will maximize NSF's investment by giving broad audiences access to the science and excitement of the expedition through the documentary. In addition, this informal science learning opportunity will not only engage students with scientists in authentic research, but also train the students to deliver daily live broadcasts from sea to three well-established U.S. informal science education institutions: the Smithsonian National Museum of Natural History (NMNH), the Exploratorium, and the Alaska Sea Life Center (ASLC). The daily broadcasts will also reach the public in real time via the project's interactive website, providing the opportunity for people to post questions to the scientists and students onboard the ship. The NPP has great potential to benefit society by enhancing awareness of the changing Arctic's ecosystems and increasing science literacy. The hands-on research experiences will enhance the college readiness of the participating high school students and encourage the undergraduate students from the six partner MSIs to consider a graduate course of study and/or pursue STEM careers. The graduate students will also be more career-ready, as they gain public communication and leadership skills necessary for 21st century scientists. The Northwest Passage Project is designed to advance knowledge and understanding within the practice of informal science education, as well as in the field of Arctic science. The project goals include: increasing public awareness and understanding of the changing Arctic ecosystem; increase public understanding about Arctic research and the scientific process; increase the Informal Science Education (ISE) field's understanding of the public's learning process when engaged in live interactions with scientists and student 'science communicators'; increase the ISE field's understanding of the value of immersive science experiences and impact on students from underserved and underrepresented populations; and to build or extend the capacity of ISE institutions to make connections between polar scientists, students, journalists and the public. The NPP is creative in that it combines the engagement of students in field-based scientific research, live broadcasts from sea to ISE institutions, and the production of a full-scale documentary for public audiences. A potentially transformative component to the ISE activities involves six Minority Serving Institution partners--Florida International University; University of Illinois, Chicago; California State University, Channel Islands; Texas State University; Virginia Commonwealth University and City College of New York--whose students will have the opportunity for a life-changing experience that may tip the scale toward their interest in STEM careers. Each of these students will develop news stories, host screenings of the film at their respective campuses, and share their experiences with peers, providing visual role models for other underrepresented students, who may never have thought themselves capable of becoming a scientist or science communicator. An additional project goal is to enhance the capacity and infrastructure of the three ISE partner institutions so that they may receive live broadcasts from the Inner Space Center in the future, beyond the funding period of the project. People, Places & Design Research will conduct the project's front-end and formative evaluation; MEM & Associates will conduct the summative evaluation. Some of the key evaluation questions will be: * Have ISE and MSI institution public visitors, who view either the live broadcasts or the documentary film (or both), become more aware of the changing Arctic ecosystem and the importance of scientific research in the Arctic? * What is the relative impact of the live broadcasts compared to the finished documentary, and the strengths and weakness of the respective media in translating the on-board experience? * Does a real environmental and social context for scientific evidence stimulate audiences to become more interested in the role of science/STEM? * Have students gained leadership skills and the ability to communicate science to their peers? * Have students increased their motivation and interest in pursuing STEM careers? This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Gail ScowcroftDavid ClarkBrice LooseDwight Coleman
This award supports the production of a longitudinal video documentary of the evolution of Advanced LIGO and will chronicle the most critical and exciting period in the history of gravitational wave science in the past 100 years. LIGO resumed the search for gravitational waves in 2015 with a newly upgraded detector and on September 14, 2015 detected gravitational waves for the first time, astounding not only the scientific community but the entire world. Using footage captured at critical periods between August 2015 and March 2016 during the discovery phase as well as new filming taking place over the next two years, the team will produce films which will impact at least hundreds of thousands of people and possibly many more than that. The goal is to educate, inspire, and motivate. Students at the high school and undergraduate levels may be more inspired to pursue STEM careers after watching scientific vignettes focusing on the exciting science and technology of Advanced LIGO. Scientific historians and sociologists will have the opportunity to use the hundreds of hours of available film clips as a video database to investigate in detail the discovery of gravitational waves as a case study of large scale collaborations ("Big Science"). Videos highlighting the cutting edge technological advances brought about by Advanced LIGO and their impacts on other fields of science and technology may prove effective for educating officials and policy makers on the benefits of fundamental science.
During the course of the project, a series of professionally made video shorts will be produced for the LIGO Laboratory and LSC for education and public outreach purposes through distribution on LIGO Laboratory, LSC web sites, and the LIGO YouTube Channel. Through an extensive series of film shoots, XPLR Productions will work with the LIGO Laboratory and the LIGO Scientific Collaboration (LSC) to capture key moments as LIGO scientists work to achieve Advanced LIGO's design sensitivity and carry out a series of observing runs over the next two years. The team will produce a series of video shorts explaining the important scientific and technological concepts and issues of Advanced LIGO by the scientific experts who create them. In the longer term, footage will used to produce either a feature length documentary film or a twelve-part series on television entitled 'LIGO' chronicling the discovery of gravitational waves and the exploration of exotic high-energy astrophysical phenomena such as colliding black holes. Intended for broad distribution through cinema or television, 'LIGO' will bring science to life for a wide audience.