The summative evaluation report for Project TRUE focuses on program implementation, participant experiences, organizational capacity outcomes and project scale-up over the five-year project.
Appendix includes logic model and instruments.
Museums, science centers, zoos and other informal science education (ISE) institutions often focus on the idea of "authenticity" to engage the public. Authenticity includes providing something real, original, or even awe-inspiring to the visitor or learner--be it an object, a context, or an experience. While those educators, exhibit designers, and program developers who work in ISE settings often recognize authenticity as an important part of many informal learning experiences, this may be simply be an assumption driven by tradition in practice versus a strategy supported by evidence. This project seeks to better understand how and/or why "the real thing" may (or may not be) important for supporting informal science learning. By examining what is already known about authenticity and learning, the project will inform best practices in ISE as well as point to gaps in knowledge that might need further research. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This research synthesis takes a systematic approach to identify and compile both theoretical and empirical literature to better understand the role authenticity may play in supporting informal science learning. This project will gather ISE literature related to the effects of "authenticity" on learner outcomes, and will look to neighboring disciplines such as psychology, anthropology, media studies, linguistics, marketing and others to seek relevant theoretical perspectives and empirical work that might further understanding of the potential role of authenticity in ISE. The initial phase of the project will focus on gathering theoretical perspectives and positions that help explain the value or importance (or perhaps non-importance) of "realness" as it relates to learning, interest, and experience. A panel of experts from multiple disciplines will convene to help identify key perspectives and frameworks that may clarify the role or impacts of authenticity. A second phase focuses on gathering and assessing empirical studies that support (or refute) the relevant perspectives and theories identified from the initial multi-disciplinary foray into authenticity. To ensure breadth and depth of review, the PIs, research librarians, graduate students, and special topics classes will engage in identifying, evaluating, summarizing, and synthesizing the relevant research (including gray literature) to produce an initial synthesis report that will be reviewed by select experts from the earlier panel. A second convening of practitioners (exhibit developers, educators, program designers, etc.) will be used to further contextualize the findings in ways that may better inform current practices in providing effective ISE. The resulting products include a peer-reviewed research synthesis and a practitioner handbook.
The proposed project's Broader Impacts lie in the potential to inform ISE practice in exhibit and program design and in the delivery of ISE-related experiences. Although the importance of the authenticity of an object or experience may ultimately be determined by the individual, this study will be able to provide guidance to help practitioners and scholars in making sometimes difficult design choices. Such insights may also inform other learning environments (e.g. the classroom) as well as other disciplinary areas (e.g. history, anthropology, art).
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Addressing Societal Challenges through STEM (ASCs) received NSF AISL funding to conduct a Literature Review and Synthesis to answer the question: How are informal learning institutions advancing the use of STEM knowledge and scientific reasoning in the ways that individuals, families, and communities understand what they can do, and apply their learning to solving the societal challenges of our time? Using a definition of societal challenges based on research around the public understanding of social problems, this systematic literature review will identify, analyze, and synthesize three bodies of peer and field-reviewed literature (peer-reviewed journals, graduate theses, and evaluation reports of nationally-funded project).
Over the past decade, Informal STEM learning organizations have increasingly engaged in innovative ways to present STEM knowledge within the context of societal challenges such as climate change, energy sources, cyber-security, Nanotechnologies, coastal resilience, and other topics. These efforts significantly expand the traditional work of Informal STEM Learning (ISL) organizations, often leading to new types of interventions, partnerships, impacts, and assessment tools. Analyzing and interpreting the aggregate of this work will advance theoretical and practical knowledge about the potential of ISL’s in advancing the place of STEM in addressing societal challenges.
Demonstrating and articulating the characteristics of how ISL organizations are addressing societal challenges, encourages and informs the ways institutions can address the NSF strategic goal to “Advance the capability of the Nation to meet current and future challenges.” The project outputs aim to Enhance Knowledge-building, Build Capacity of the Field, and Maximize Strategic Impact by informing the strategies used by organizations and individuals. The results also aim to Broaden Participation by articulating the ways STEM knowledge is embedded and linked to personal experiences and choices.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Consideration of the needs of individuals with a wide range of disabilities is not always considered in the early design stages of an informal STEM learning (ISL) activity or program. The primary access approach for people with disabilities becomes the provision of accommodations once the ISL product or environment is created. In contrast, the Universal Design approach considers users with a wide range of characteristics throughout the design process and works to create products and environments that are accessible, usable, and inclusive. This project, called AccessISL, led by the University of Washington's DO-IT (Disabilities, Opportunities, Internetworking and Technology) Center and Museology Program, includes an academic museology program and local ISL sites, representing museums, zoos, aquariums, makerspaces, science centers, and other sites of informal STEM learning. Insights will be gained through the engagement of people with disabilities, museology graduate students and faculty, and ISL practitioners. The AccessISL project model, composed of a set of approaches and interventions, builds on existing research and theory in the fields of education science, change management, effective ISL practices, and inclusive design processes. The project will collect evidence of policies and practices (or lack thereof) that improve the inclusiveness of ISL with respect to a wide range of disabilities and considers approaches for the design and development of new strategies; explores what stakeholders need to make change happen; uncovers challenges to the adoption of inclusive practices in public ISL settings and explores ways to overcome them; and proposes relevant content that might be included in museology curriculum. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project addresses the following two objectives:
For ISL personnel and museology faculty: to increase knowledge, skills, and actions to make ISL programs, facilities, courses, and resources more welcoming and accessible to participants with disabilities and embed relevant practices within their work.
For postsecondary STEM students with disabilities and museology students: to increase knowledge and skills in advocating for ISL offerings that are welcoming and accessible to everyone, including those with a wide variety of disabilities, and to encourage individuals with disabilities to pursue careers in ISL.
The project employs a student-centered approach and a set of practices that embrace the social model of disability, social justice education, disability as a diversity issue, intersectionality, and Universal Design. A leadership team of interns--each member a STEM student with a disability or a museology graduate student--along with project staff will engage with the University of Washington's Museology Program to identify and implement strategies for making ISL activities and courses more welcoming and accessible to individuals with disabilities. An online community of practice will be developed from project partners and others nationwide. A one-day capacity building institute will be held to include presentations, student/personnel panels for sharing project and related experiences, and group discussions to explore issues and further identify systemic changes to make ISL programs more welcoming and accessible to individuals with disabilities. As prototypes of the AccessISL Model are developed, evaluation activities will primarily be formative (looking for strengths and weaknesses) and remedial (identifying/implementing changes that could be made to improve the model). The model will continue to be fine-tuned through formative evaluation. Evaluation of the model components will focus on the experience of a range of stakeholders in the project. Specifically, quantitative data collected will include levels and quality of engagement, accessibility recommendations and products developed, and delivery of ISL services. Qualitative data will be collected through observations, surveys, focus groups, interviews, and case studies.
AccessISL project products will include proceedings of an end-of-project capacity building institute, promising practices, case studies, a video, and other online resources to help ISL practitioners and museology faculty that will result in making future ISL opportunities more inclusive of people with disabilities. AccessISL will advance knowledge and ensure long-term impact using multiple strategies:
broadening the STEM participation of people with disabilities as well as women, racial/ethnic minorities, and other underrepresented groups through the application of universal design
strengthening associations and creating synergy and durable relationships among stakeholders,
encouraging teaching about disability, accessibility, and universal design in museology courses,
empowering students with disabilities and current and future ISL practitioners to advocate for accessible ISL and develops an infrastructure to promote accessible ISL programs nationwide, and
contributing to the body of promising practices with products that will (a) enhance understanding of issues related to the inclusion of people with disabilities in ISL programs and (b) promote inclusive practices.
Outcomes will benefit society by making STEM opportunities available to more people and enhancing STEM fields with the talents and perspectives of people with disabilities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
In April 2018, FHI 360, under the leadership of Maryann Stimmer and Merle Froschl, convened a meeting of thought leaders in Washington, D.C. to capture a “snapshot” of STEM education. They subsequently conducted additional interviews with more than 50 local and national policy leaders; public and private funders; researchers; PreK-12 and post-secondary educators; parents, and leaders of afterschool programs, science centers and youth-serving organizations. The purpose of this summary report is to identify current trends and gaps to inform research, policy, and practice in order to reinforce
This poster was presented at the 2019 AISL PI Meeting in Washington, DC. It provides an overview of a project designed to broaden participation of blind students in engineering fields through the development of spatial ability skills and the showcasing of nonvisually accessible teaching methods and techniques.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Museum of Science, Boston (MOS) and Boston University (BU) will conduct a Pilot and Feasibility Study project that leverages the current Living Laboratory (LL) model and expand it to engage high school students (teens) in experimental psychology research, science communication and science education activities. In LL, which is now an extensive network of museums and university researchers across the country, scientists and museum staff collaborate to engage children in studies on the museum floor and educate caregivers about the research. Multi-site implementation and evaluation of LL has also documented positive impacts for undergraduate researchers. Many sites are eager to extend these benefits to high school students by engaging them as practitioners within the model and by providing them with opportunities to engage in current research, education and communication, thereby helping to foster stronger youth identities with science and its applications in society. This project expands a ten-year LL partnership between MOS and BU to: 1) pilot a program in which high school students both conduct scientific research and engage the public in learning about science; 2) explore strategies for museums and universities to collaboratively engage, support and mentor high school students in science research, communication and education activities; 3) document curricular, other programmatic, and evaluation materials; and 4) convene professional participants to provide feedback on pilot materials, and assess the viability of implementing similar programs at additional sites. Guided by developmental evaluation, these activities will generate knowledge for the field, and act to increase professional capacity to integrate experiences for teens at multiple LL sites in future projects. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This project, an NSF INCLUDES Design and Development Launch Pilot, managed by the University of Nevada, Reno, addresses the grand challenge of increasing underrepresentation regionally in the advanced manufacturing sector. Using the state's Learn and Earn Program Advanced Career Pathway (LEAP) as the foundation, science, technology, engineering and mathematics (STEM) activities will support and prepare Hispanic students for the region's workforce in advanced manufacturing which includes partnerships with Truckee Meadows Community College (TMCC), the state's Governor's Office of Economic Development, Charles River Laboratories, Nevada Established Program to Stimulate Competitive Research (Nevada EPSCoR) and the K-12 community.
The expected outcomes from the project will inform the feasibility, expandability and transferability of the LEAP framework in diversifying the state's workforce locally and the STEM workforce nationally. Formative and summative evaluation will be conducted with a well-matched comparison group. Dissemination of project results will be disseminated through the Association for Public Land-Grant Universities (APLU), STEM conferences and scholarly journals.
DATE:
-
TEAM MEMBERS:
David ShintaniJulie EllsworthKarsten HeiseRobert StachlewitzRegina Tempel
resourceprojectProfessional Development, Conferences, and Networks
The University of Maine will address the grand challenge of increasing Native American participation in the science,technology, engineering and mathematics (STEM) enterprise in an NSF INCLUDES Design and Development Launch Pilot project addressing culturally relevant pedagogy, incorporating Community Elders, Cultural Knowledge Keepers, and mainstream secondary and higher education institutions in the development of STEM pedagogy that can be replicated to other underrepresented and underserved populations. Partners in the effort include the Wabanaki Youth in Science program (WaYS)(a non-profit organization), Salish Kootenai College (a Tribal College), Massachusetts Institute of Technology (a research university), the National Indian Education Association (a non-profit membership organization) and the current NSF INCLUDES Design and Development Launch Pilot project at the University of Maine (the Stormwater Research Management Team (SMART)). This NSF INCLUDES partnership provides students with evidence-based STEM activities involving culturally relevant internships, mentoring, STEM professional development activities and other support. Non-native students will reciprocally participate in Native American learning environments.
The foundation for the project's activities is based on the WaYS program in science education that incorporates Traditional Ecological Knowledge (TEK). The goals of the project are to: 1) create and integrate curriculum that embraces TEK and western science as equal partners; 2)develop and implement protocols to incorporate a continued mentorship program for WaYS and STREAM engineering students; 3)develop a framework to bridge the gap between high school and college; and 4) foster collaboration among Community Elders, Cultural Knowledge Keepers and University of Maine faculty in a model that could be transferred to other communities. Internal and external evaluation activities will add to the scholarly literature on educating Native Americans and non-native students in STEM disciplines. Dissemination of project results will include published peer-reviewed journal articles on newly developed pedagogy and conference presentations at the American Indian Science and Engineering (AISES) national conference, the National Diversity in STEM Conference, National Science Teachers Association, AAAS, ASEE and the National NSF INCLUDES Network.
DATE:
-
TEAM MEMBERS:
Darren RancoJohn DaigleMindy CrandallShaleen Jain
Improving retention rates in postsecondary engineering degree programs is the single most effective approach for addressing the national shortage of skilled engineers. Both mathematics course placement and performance are strong graduation predictors in engineering, even after controlling for demographic characteristics. Underrepresented students (e.g., rural students, low-income students, first-generation students, and students of color) are disproportionately represented in cohorts that enter engineering programs not yet calculus-ready. Frequently, the time and cost of obtaining an engineering degree is increased, and the likelihood of obtaining the degree is also reduced. This educational problem is particularly acute for African American students who attended select high schools in South Carolina, with extremely high-poverty rates. As a result, the investigators proposed an NSF INCLUDES Launch Pilot project to develop a statewide consortium in South Carolina - comprising all of the public four-year institutions with ABET-approved engineering degree programs, all of the technical colleges, and 118 high schools with 70% or higher poverty rates, to pinpoint and address the barriers that prevent these students from being calculus ready in engineering.
This NSF INCLUDES Launch Pilot project will map completion/attrition pathways of students by collecting robust cross-sectional data to identify and understand the complex linkages between and behind critical decisions. Such data have not been available to this extent, especially focused on diverse populations. Further, by developing structural equation models (SEMs), the investigators will be able to build on extant research, contributing directly to understanding the relative impact of a range of latent variables on the development of engineering identity, particularly among African American, rural, low-income, and first-generation engineering students. Results of the pilot interventions are likely to contribute to the empirical and theoretical literature that focus on engineering persistence among underrepresented populations. Project plans also include developing a centralized database compatible to the Multiple Institution Database for Investigation of Engineering Longitudinal Development (MIDFIELD) project to share institutional data with K-12 and postsecondary administrators, engineering educators, and education researchers with NSF INCLUDES projects and beyond.
DATE:
-
TEAM MEMBERS:
Anand GramopadhyeDerek BrownEliza GallagherKristin Frady
The LiFE Project, an NSF INCLUDES Design and Development Launch Pilot, will investigate and design a collaborative effort to counter the stereotypical expectation that boys are "naturally" better at science and math which becomes a self-fulfilling prophecy, silently shaping the girls'own perceptions of their ability. LiFE collaborators will address this problem at its source: the early learning experiences of elementary school girls. The elementary-middle school period is critical because by 8th grade, many girls have left the STEM pathway forever. The key to reversing the trend is finding effective ways to showcase STEM as a collaborative, people-rich space in which girls can participate together, be themselves, and engage in exploration. Research indicates that girls prefer collaborative activities that can make a difference in the world. Partnering with a coalition of economically and racially diverse New Jersey elementary schools, LiFE will employ "iSTEAM" learning strategies that encourage girls to apply the tools of various disciplines to investigate and solve real-world problems in an open environment of innovation, collaboration, and communication. This approach promises to be especially effective in engaging girls.
LiFE will build on a successful Girls Science Club (GSC) model that introduces girls in grades 3-4 to hands-on iSTEAM exploration activities using Problem/Project-Based Learning strategies. Additional activities will leverage the expertise of the project's corporate/government partners (including Apple and USARMY) to build communication and leadership skills. LiFE will sustain the GSC's benefits by developing clubs for grades 5-6 involving enriched content and long-term independent projects. Eventually, a tiered peer network will link girls from elementary school through women college students and female STEM professionals--each tier mentoring the tiers below. This network will sustain a crucial "sense of community" to retain women in STEM. Within LiFE's social innovation framework approach, participating districts will tailor the GSC to their community while also working together toward shared common goals. LiFE will study the impact of GSCs on persistence of girls' interest in STEM into grade 7. Based on this research, LiFE will develop a cost-effective template that can be replicated across the US. LiFE will bring problem-based iSTEAM concepts to girls of all academic levels in their elementary schools years while, having a community focus with participant-developed projects in a non-competitive environment and leveraging the resources of academic, corporate and government partners to foster broader participation by women in STEM careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Bruce BukietJames LipumaNancy Steffen-Fluhr