This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.
This study addresses the increasing interest in family learning in informal settings by investigating strategies to better engage families in science talk and practices. As part of a larger design-based research study, we examine how scientists and parents use think-pair-share discussion prompts to support families’ understandings about local community water sources and facilitate experimentation with a surface and underground water model. Grounded in sociocultural theory of learning, we focus on parent-child interactions and family sensemaking. We analyzed four water quality workshops with 44
The RASOR project is designed to increase engagement of students from rural Alaska communities in biomedical/STEM careers. Rural Alaskan communities are home to students of intersecting identities underrepresented in biomedical science, including Alaska Native, low-income, first generation college, and rural. Geographic isolation defines these communities and can limit the exposure of students to scientifically-minded peers, professional role models, and science career pathways. However these students also have a particularly strong environmental connection through subsistence and recreational activities, which makes the one-health approach to bio-medicine an intuitive and effective route for introducing scientific research and STEM content. In RASOR, we will implement place-based mentored research projects with students in rural Alaskan communities at the high school level, when most students are beginning to seriously consider career paths. The biomedical one-health approach will build connections between student experiences of village life in rural Alaska and biomedical research. Engaging undergraduate students in research has proved one of the most successful means of increasing the persistence of minority students in science (Kuh 2008). Furthermore, RASOR will integrate high school students into community-based participatory research (Israel et al. 2005). This approach is designed to demonstrate the practicality of scientific research, that science has the ability to support community and cultural priorities and to provide career pathways for individual community members. The one-health approach will provide continuity with BLaST, an NIH-funded BUILD program that provides undergraduate biomedical students with guidance and support. RASOR will work closely with BLaST, implementing among younger (pre-BLaST) students approaches that have been successful for retaining rural Alaska students along STEM pathways and tracking of post-RASOR students. Alaska Native and rural Alaska students are a unique and diverse population underrepresented in biomedical science and STEM fields.
Escape rooms are an engaging and increasingly popular game format in which a team of players is “locked” in a room and challenged to solve a series of narrative-embedded puzzles encoded in the room’s artifacts in order to “escape” within a set period of time. The University of California Museum of Paleontology, with partners University of Kansas Natural History Museum and the California Academy of Sciences, aim to develop, evaluate, and disseminate a “serious game” (i.e., a game designed for a purpose other than entertainment) based on the escape room model. Our traveling/loanable pop-up escape room and associated extension activities will engage diverse families (ages 8 and up) in museums and libraries in solving a biomedical mystery that teaches fundamental concepts in biology, engages critical-thinking and collaboration skills, and stimulates interest in biomedical careers. STEM Escape will address NGSS-aligned content central to medical research – in particular, it will communicate basic concepts regarding evolutionary relationships, a topic with relevance to a wide variety of medical applications, such as determining the source of emerging infectious diseases, tracking the progression of disease within a host, and identifying new medicines. The project is designed to lay the groundwork for extended family interactions surrounding scientific content and biomedical careers. The immersive game will be supplemented by a set of solo and docent-led follow-up activities that reinforce key concepts and emphasize connections between players’ experience in the game and biomedical research careers. Learners will also receive takeaway media (e.g., activity book) that highlights a diverse set of NIH-funded researchers whose work directly relies on evolutionary patterns/processes. Caregivers will have the option of receiving a follow-up email with free at-home activities. The themed inflatable pop-up room will be wheelchair-accessible and all materials will be bilingual in English and Spanish. The STEM Escape experience will be developed with and for the diverse audiences visiting urban/suburban natural history museums and libraries, as well as with and for rural families, whom we will reach through rural libraries. The project will also produce and evaluate a suite of support materials to facilitate institutional adoption and deployment of the experience. Nine host sites across the country have committed to hosting the room (with an additional two sites in the planning stages), and after the life of the grant, the room will continue to make an impact as a rentable traveling exhibit. Long term, this project will improve the public’s understanding of medically relevant evolutionary content, increase interest in biomedical careers, particularly among underserved groups targeted, and improve our understanding of how immersive games can be used to serve educational objectives.
In October 2017, the PBS NewsHour team produced a week and a half of opioid-related content, including several online explainers, which presented the opportunity for a natural experiment for the Experiments in Transmedia project.
Knology (formerly New Knowledge Organization Ltd.) conducted a two-wave research study to advance understanding of the youth audience’s knowledge and news consumption on the topic.
The first wave of the study, conducted in September 2017, provides a baseline. The content aired in October 2017, and the second wave of the study, conducted in November 2017, asked a
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The employment demands in STEM fields grew twice as fast as employment in non-STEM fields in the last decade, making it a matter of national importance to educate the next generation about science, engineering and the scientific process. The need to educate students about STEM is particularly pronounced in low-income, rural communities where: i) students may perceive that STEM learning has little relevance to their lives; ii) there are little, if any, STEM-related resources and infrastructure available at their schools or in their immediate areas; and iii) STEM teachers, usually one per school, often teach out of their area expertise, and lack a network from which they can learn and with which they can share experiences. Through the proposed project, middle school teachers in low-income, rural communities will partner with Dartmouth faculty and graduate students and professional science educators at the Montshire Museum of Science to develop sustainable STEM curricular units for their schools. These crosscutting units will include a series of hands-on, investigative, active learning, and standards-aligned lessons based in part on engineering design principles that may be used annually for the betterment of student learning. Once developed and tested in a classroom setting in our four pilot schools, the units will be made available to other partner schools in NH and VT and finally to any school wishing to adopt them. In addition, A STEM rural educator network, through which crosscutting units may be disseminated and teachers may share and support each other, will be created to enhance the teachers’ ability to network, seek advice, share information, etc.
Hopa Mountain, working in partnership with Montana State University (MSU), will develop innovative and coordinated opportunities for Montana youth to strengthen their STEM (Science, Technology, Engineering and Mathematics) skills and knowledge while preparing them for higher education and careers in health sciences. The overall project goal of HealthMakers is to support rural and tribal youth’s interest and exposure to careers in the sciences while giving them the skills and resources to play leadership roles in increasing healthy family practices in their homes and communities. HealthMakers will achieve meaningful impacts annually through four strategies: (1) Health-focused college preparation programs for 50 teens; (2) Summer academic enrichment programs for 20 teens; (3) Community-based science literacy events for 2,000 children and their families, and (4) Professional development for educators, community members, and parents. Hopa Mountain and MSU will engage youth, educators, community leaders, and parents in training opportunities through HealthMakers. Participants will take part in community-based workshops, college tours, and summer institutes led by MSU faculty, healthcare professionals, Hopa Mountain staff, and their peers. Through these strategic aims, HealthMakers will help create a stronger workforce and inspire students to pursue careers in the sciences.
PUBLIC HEALTH RELEVANCE:
HealthMakers will support the development of health-related outreach and college preparation programs and training resources to create a better-informed workforce for Montana and inspire students to pursue careers in the sciences. These strategic aims and deliverables benefiting rural and tribal families and children, will help create a stronger workforce and inspire students to pursue careers in the sciences. Working together, Hopa Mountain and Montana State University will support rural and tribal youth’s interest and exposure to careers in the health sciences while giving them the skills and resources to play leadership roles in increasing healthy family practices in their communities.
The NIH Science Education Partnership Award (SEPA) program of Emory University endeavors to use an over-arching theme of citizen science principles to:
develop an innovative curriculum based on citizen science and experiential learning to evaluate the efficacy of informal science education in after-school settings;
promote biomedical scientific careers in under-represented groups targeting females for Girls for Science summer research experiences;
train teachers in Title I schools to implement this citizen science based curriculum; and
disseminate the citizen science principles through outreach.
This novel, experiential science and engineering program, termed Experiential Citizen Science Training for the Next Generation (ExCiTNG), encompasses community-identified topics reflecting NIH research priorities. The curriculum is mapped to Next Generation Science Standards.
A comprehensive evaluation plan accompanies each program component, composed of short- and/or longer-term outcome measures. We will use our existing outreach program (Students for Science) along with scientific community partnerships (Atlanta Science Festival) to implement key aspects of the program throughout the state of Georgia. These efforts will be overseen by a central Steering Committee composed of leadership of the Community Education Research Program of the Emory/Morehouse/Georgia Institute of Technology Atlanta Clinical Translational Science Institute (NIH CTSA), the Principal Investigators, representatives of each program component, and an independent K–12 STEM evaluator from the Georgia Department of Education.
The Community Advisory Board, including educators, parents, and community members, will help guide the program’s implementation and monitor progress. A committee of NIH-funded investigators, representing multiple NIH institutes along with experienced science writers, will lead the effort for dissemination and assure that on-going and new NIH research priorities are integrated into the program’s curriculum over time.
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
This project will engage community members and youth in 13 rural, tribal, and Hispanic communities in the Four Corners Region of the south western U.S. with the science and cultural assets of water. Water is a significant and scarce resource in this geographic area. The Four Corners Region experiences low annual precipitation and high year-to-year fluctuations in water availability. Thus, water is a topic of great interest to community members, whose lives are shaped by water-related events such as drought, flood, and wildfires. Rural tribal, and Hispanic communities are often underserved with respect to science programming; their public libraries often function as the local science center. The project's inter-disciplinary team will develop, deploy, research, and evaluate an interactive traveling exhibit for small libraries, designed around regional water topics and complemented by interactive programming and community engagement events. Additionally, the team will build local capacity by fostering a community of practice among the host librarians, including participation through a support system--the STAR Library Network--to increase their science programming.
This project creates a traveling exhibit and complementary programming around water topics. Through an exhibit co-design model, communities will provide input in the exhibit development, identify water topics that are critical to them, and engage the multi-generational audiences. The exhibit merges the captivating attraction of water with the underlying science content and community context, giving patrons the opportunity to explore these topics through active learning stations, informational panels, citizen science-based activities, and an interactive regional watershed model. Artistic representations of water will be developed by community groups and incorporated into the exhibit as a dynamic display element.
Project goals are to:
Spark interest in and increase understanding of water as a critical resource and cultural asset across rural, tribal, and Hispanic communities in the Four Corners Region.
Increase availability of and access to engaging programming for underserved rural, tribal, and Hispanic communities focusing on the science and cultural aspects of water in the Four Corners Region.
Build capacity for libraries to implement water-focused science programs, and increase available science learning and science communication resources tailored to these informal learning settings.
Foster a Community of Practice (CoP) for participating librarians to support the development of their programming and content knowledge.
Advance the body of research on informal learning environments and their role in developing community members' science ecosystems and science identities, particularly in library settings.
The project team will rigorously assess the extent to which program approaches and components stimulate patrons' interest in science, increase science knowledge, and support building a personal science identity. The model is based on the STEM Learning Ecosystems Framework. Robust evaluation will guide the program development through a front-end needs assessment and iterative revision cycles of implementation strategies.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
The Teen Science Cafe Network is an adaptation for teens, of the popular adult science cafe model, which brings people together in a social setting to have an animated conversation with a scientist on some interesting and timely topic. Since its inception in 2012, the Network has grown at a rapid rate: it is now in 130 sites in 45 states, the District of Columbia, and British Columbia. Multiple evaluations have documented its impact. Teens are shown to have increased STEM literacy, a more realistic picture of scientists as real people leading interesting lives, and a better understanding of the nature of science. This two-and-a-half-day conference is designed to review the state of this model of teen engagement in science and science communication. Participants will examine lessons learned from this and similar networks to consider the features needed to expand this model to other audiences (e.g., rural teens, teenage college students, teenagers on military bases, and teens served by local chapters of professional societies based on ethnicity and gender).
Leaders of the Teen Science Cafe Network, along with an advisory committee comprised of individuals who are successfully managing networks, will explore these fundamental questions: 1) How can the field best take advantage of this large and growing network? 2) How can the current community of practice be leveraged for growth? 3) What are some of the most effective strategies for achieving and maintaining effective, long-term partnerships with organizations such as 4-H, science centers, networks of afterschool providers, science festivals, professional societies, and libraries? 4) What are possible outcomes for promoting discipline-specific cafes in areas such as ocean science, astrophysics, geoscience, and polar science? Outputs from the conference include a refined set of guiding principles for the current network and a white paper describing the features of strong and effective networks and recommendations for scaling.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Michelle HallJanice MokrosMichael Mayhew