Skip to main content

Community Repository Search Results

resource project Public Programs
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.

Making, which supports interest-driven skill-development and learning, has been recognized as having the potential to engage underserved youth in STEM. Makerspaces are community spaces that allow participants to create items using tools, such as 3-D printers, computer-aided design, and digital fabrication technologies. Makerspaces and making-related programs are often inaccessible, unaffordable, or simply not available to underserved youth. Digital Harbor will partner with recreation centers, two in Pittsburgh and two in Baltimore, to research, refine and implement an equity-based approach to making that will engage underserved youth aged 12-16 in making. The project will prepare out-of-school time (OST) educators to collaboratively develop culturally sensitive curricula with underserved youth to engage them in maker-based technology and computer science experiences. The project will (1) design a professional development program that will prepare and support local educators to collaboratively design and deliver localized, maker-based, STEM curricula; (2) research the impact of these programs on both educators' and youth's self-efficacy, creativity, and attitudes towards STEM; and (3) develop and evaluate an online Localization Toolkit that will prepare educators in makerspaces across the nation in using an equity-based approach to create localized content. The project will result in four new maker sites (two in Baltimore and two in Pittsburgh directly impact 4 sites (10 educators and 240 youth). The project will result several resources that will support the development and educational programs of other community sites. The resources will include the Localization Toolkit, Case Studies, Best Practices, and Research Study. The Localization Toolkit has the potential to strengthen infrastructure and capacity building in OST maker-based programs, as well as other informal and formal education programs using similar pedagogies and design principles.

The project will use a mixed-methods approach in researching the challenges and processes involved in establishing the four maker sites in Baltimore and Pittsburgh, the approaches and effectiveness of the professional development program on OST educators, and the impacts of the project of participation on the self-efficacy, creativity, and attitudes on participating youth and educators. The research study will apply several instruments and data collection sources to develop quantitative data, including youth attendance logs, the Upper Elementary and Middle/High School Student Attitudes toward STEM survey, a retrospective technology self-efficacy survey and pre-post surveys. In addition to project document review, the researchers will collect qualitative data through educator interviews, educator focus groups, and youth focus groups. Project research and resources will reach key audiences of learning scientists and OST educators through articles in peer-reviewed and practitioner journals, public events and professional conferences. These audiences will also be reached through the project website, which will share project resources. The project will reach OST sites across the country directly through dissemination partners, including the National Recreation and Parks Association, Association of Science and Technology Centers, and statewide out-of-school networks.

This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Foad Hamidi Andrew Coy
resource project Exhibitions
For thousands of years, Native Hawaiian/Pacific Islander (NHPI) seafarers have successfully utilized systemic observation of their environment to traverse vast expanses of open ocean and thrive on the most remote islands on earth. Developing NHPI trust in the scientific enterprise requires building connections that bridge the values and concepts of 'ike kupuna (traditional knowledge) with scientific knowledge systems and contemporary technology. This project will develop and research a pop-up science exhibit that connects indigenous Hawaiian knowledge with contemporary Western science concepts. The exhibit will show how community knowledge (that is consistent with underlying scientific principles and natural laws) has informed innovation by indigenous peoples. This community-initiated and developed project will begin with a single pop-up exhibit designed to incorporate several hands-on culture-based STEM activities that integrate traditional and modern technologies. For example, the exhibit may cover indigenous systems of star navigation for ocean voyaging, systems of netting for food and water containers, or systems of home design with local and natural materials. This project seeks to develop preliminary evidence of the effectiveness of such an approach for supporting rural Hawaiian youths' STEM engagement, understanding, and personal connections to Native Hawaiian STEM knowledge. Findings from this pilot and feasibility study will inform the development of a larger pop-up science center grounded in indigenous Hawaiian STEM knowledge, and advance intellectual knowledge around culturally sustaining pedagogy by helping informal STEM education practitioners understand community initiated and developed STEM exhibits.

This pop-up science center pilot will be led by a local Hawaiian community organization, INPEACE, in collaboration with several local community members and other community-based organizations. The preliminary research will iteratively explore whether and how an existing Hawaiian culture-based framework can be used to design hands-on STEM exhibits to enhance rural learner engagement, depth of STEM knowledge, and connection to Native Hawaiian STEM knowledge. Research efforts led by Kamehameha Schools, which has a long history of conducting research from an indigenous worldview, will engage 120 learners from various rural communities across Hawaii, from which 40 will be pre-selected middle-school youth, and 80 individuals will be from public audiences of learners ages 12 and up. Through a series of observations, interviews, pre and post surveys with validated instruments, and focus groups, the research will probe: (1) The learners' thoughts on the science practice and its relevance to old and new Hawaii and modern society. (2) The level at which related STEM topics have been understood, and (3) The learners' perceptions about their connection to Native Hawaiian STEM knowledge. Results from this pilot study will inform a future pop-up science center development project, and add to the scarce literature on community-driven, culturally sustaining exhibition development.

This Pilots and Feasibility Studies project is funded by the NSF Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Maile Keliipio-Acoba
resource project Public Programs
The goal of the National Science Foundation?s Research Coordination Network (RCN) program is to advance a field or create new directions in research or education by supporting groups of investigators to communicate and coordinate their research, training and educational activities across disciplinary, organizational, geographic and international boundaries. This RCN will bring together scholars and practitioners working at the intersection of equity and interdisciplinary making in STEM education. Making is a culture that emphasizes interest-driven learning by doing within an informal, peer-led and creative social environment. Hundreds of maker spaces and maker-oriented classroom pedagogies have developed across the country. Maker spaces often include digital technologies such as computer design, 3-D printers, and laser cutters, but may also include traditional crafts or a variety of artist-driven creations. The driving purpose of the project is to collectively broaden STEM-focused maker participation in the United States through pursuing common research questions, sharing resources, and incubating emergent inquiry and knowledge across multiple working sites of practice. The network aims to build capacity for research and knowledge, building in consequential and far-reaching mechanisms to leverage combined efforts of a core group of scholars, practitioners, and an extended network of formal and informal education partners in urban and rural sites serving people from groups underrepresented in STEM. Maker learning spaces can be particularly fruitful spaces for STEM learning toward equity because they foster interest-driven, collective, and community-oriented learning in making for social and community change. The network will be led by a team of multi-institutional and multi-disciplinary researchers from different geographic regions of the United States and guided by a steering committee of prominent researchers and practitioners in making and equity will convene to facilitate network activities.

Equitable processes are rooted in a commitment to understand and build on the skills, practices, values, and knowledge of communities marginalized in STEM. The research network aims to fill in gaps in current understandings about making and equity, including the many ways different projects define equity and STEM in making. The project will survey the existing research terrain to develop a dynamic and cohesive understanding of making that connects to learners' STEM ideas, communities, and historical ways of making. Additionally, the network will collaboratively develop central research questions for network partners. The network will create a repository for ethical and promising practices in community-based research and aggregate data across sites, among other activities. The network will support collaboration across a multiplicity of making spaces, research institutions, and community organizations throughout the country to share data, methodologies, ways of connecting to local communities and approaches to robust integration of STEM skills and practices. Project impacts will include new research partnerships, a dissemination hub for research related to making and equity, professional development for researchers and practitioners, and leveraging collective research findings about making values and practices to improve approaches to STEM-rich making integration in informal learning environments. The project is funded by NSF's Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of settings. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches, and resources for use in a variety of settings.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Maria Olivares Eli Tucker-Raymond Edna Tan Jill Castek Cynthia Graville
resource project Public Programs
Exploratorium’s The Phenomenal Genome: Evolving Public Understanding of Genetics in the Post-Mendelian Era project addresses the increasing need to develop genomic literacy in the public at large. The explosion of genomics research over the past two decades has led to an increasingly complex picture of the determinants of human health and human phenotypes, and the applications of this research are now making their way into the clinic, the media, and the hands of consumers. The goal of this project is to create a model for increasing genomic literacy through Informal Science Education programming (ISE), creating a pathway for better decision making for the health of individuals and society at large. The Phenomenal Genome focuses on general science museum visitors and teachers of middle and high school students.

The core of the Exploratorium’s approach to science education is the creation of intriguing, provocative and investigable phenomena that are experienced directly and personally through exhibits, facilitated explorations, programs, and teacher professional development. Over two years, we will develop, test, and iterate inquiry-based professional development to help teachers develop understanding and integrate the principles of contemporary genomics and genetics into their classrooms. 120 middle and high school teachers will be served during this period, and many more beyond that, as the activities and workshops developed become a regular part of our teacher professional development programming. A learning scientist specializing in teacher learning will conduct research to determine which approaches and experiences are most effective for this context, and why.

In a parallel process, we will develop and test exhibits and experiences on the museum floor for museum visitors, using a similar iterative process of prototype testing with an embedded learning scientist to study visitor learning. We plan to define the approaches that work across audiences and contexts, as well as those that work best in particular contexts.

Through this work, we will develop new resources for teaching and learning contemporary genomics and genetics, and identify promising practices in communicating contemporary genomics and genetics in informal spaces across audiences. We will disseminate our findings via conferences, peer-reviewed articles, and workshops for the ISE community.
DATE: -
TEAM MEMBERS: Hilleary Osheroff Kristina Yu
resource project Public Programs
For nearly 20 years, the UAB Center for Community OutReach Development (CORD) has conducted SEPA funded research that has greatly enhanced the number of minority students entering the pipeline to college and biomedical careers, e.g., nearly all of CORD’s Summer Research Interns since 1998 (>300) have completed/are completing college and most of them are continuing on to graduate biomedical research and/or clinical training and careers. CORD’s programs that focused on high and middle school students have drawn many minority students into biomedical careers, but a low percentage of minority students benefit from these programs because far too many are already left behind academically in grades 4-6, due, at least in part, to a significant drop in science grades between grades 4 and 6, a drop from which most students never recover. A major contributor to this effect is that most grade 4-6 teachers in predominantly minority schools lack significant formal training in science and often are not fully aware of the great opportunities offered by biomedical careers.

In SEEC II, CORD will deliver intensive inquiry-based science training to grade 4-6 teachers, providing them with science content and hands-on science experiences that will afford their student both content and skills that will make them excited about, and competitive for, the advanced courses needed to move into biomedical research careers. SEEC II will also link teachers together across the elementary/middle school divide and bring the teachers together with administrators and parents, who will experience firsthand the excitement that inquiry learning brings and the significant advancement it provides in science and in reading and math. At monthly meetings and large annual celebrations, the parents, teachers and administrators will learn about the opportunities that biomedical careers can provide for the student who is well prepared. They will also consider the financial and educational steps required to ensure that students have the ability to reach these professions.

SEEC II will also expand CORD’s middle school LabWorks and Summer Science Camps to include grade 4-5 students and provide the teachers with professional learning in informal settings. During summer training, in small groups, the teachers will expand one of the inquiry-based science activities that they complete in the training, and they will use these in their classrooms and communicate with the others in their group to perfect these experiences in the school year. Finally, the teachers and grade 4-5 students will develop science and engineering fair-type research projects with which they will compete both on the school level and at the annual meeting. Thus, the students will share with their parents the excitement that science brings. The Intellectual Merit of SEEC II will be to test a model to enhance grade 4-6 teacher development and vertical alignment, providing science content, exposure to biomedical scientists and training in participatory science experiments, thus positioning teachers to succeed. The Broader Impacts will include the translation and testing of a science education model to assist minority students to avoid the middle school plunge and reach biomedical careers.
DATE: -
TEAM MEMBERS: J. Michael Weiss
resource project Public Programs
The concept of One Health emphasizes the connection between human health, the health of animals and the health of the environment – with the goal of improving all health. The One Health approach supports collaborations between physicians, veterinarians, dentists, nurses, ecologists, and other science, health and environmentally-related disciplines. The One Health approach is increasingly important as our population rises, agriculture intensifies, and habitat destruction increases.

The goal of our “One Health” project is to increase adolescents’ understanding of One Health concepts and the importance of One Health collaborations. We will accomplish this by developing and disseminating: (1) Classroom lessons for high school students that are case-based, incorporate hands-on activities, and align with the Next Generation Science Standards, and; (2) Activities for middle and high school students that are suitable for use in a variety of informal (non-school) education settings. During this five-year project we will:
• Collaborate with scientists and life science teachers to develop case-based, hands-on One Health lessons for high school students.
• Develop and use a reliable and valid pre/post assessment to determine the impact of the One Health lessons on student learning.
• Implement a dissemination plan in which we will recruit, train and support a national network of “teacher-presenters” to lead professional development workshops for their peers throughout the US.
• Develop activities that will be used for middle school and high school One Health field trip programs at the University of Rochester’s Life Sciences Learning Center.
• Collaborate with informal educators to create One Health activities to be used in their outreach programs.

This project is significant because it will improve students’ understanding of the One Health approach to promoting the health of people, animals, and the environment. This project will also significantly impact teachers’ awareness of One Health, and how One Health concepts are aligned with NGSS and can be incorporated into their existing curriculums. This project is innovative because it will develop One Health lessons and activities for use in a variety of settings, through partnerships with scientists, science teachers, and informal science educators. This project will also feature an innovative model for disseminating the One Health lessons to teachers nationwide using peer-to-peer professional development.
DATE: -
TEAM MEMBERS: Dina Markowitz
resource project Public Programs
The employment demands in STEM fields grew twice as fast as employment in non-STEM fields in the last decade, making it a matter of national importance to educate the next generation about science, engineering and the scientific process. The need to educate students about STEM is particularly pronounced in low-income, rural communities where: i) students may perceive that STEM learning has little relevance to their lives; ii) there are little, if any, STEM-related resources and infrastructure available at their schools or in their immediate areas; and iii) STEM teachers, usually one per school, often teach out of their area expertise, and lack a network from which they can learn and with which they can share experiences. Through the proposed project, middle school teachers in low-income, rural communities will partner with Dartmouth faculty and graduate students and professional science educators at the Montshire Museum of Science to develop sustainable STEM curricular units for their schools. These crosscutting units will include a series of hands-on, investigative, active learning, and standards-aligned lessons based in part on engineering design principles that may be used annually for the betterment of student learning. Once developed and tested in a classroom setting in our four pilot schools, the units will be made available to other partner schools in NH and VT and finally to any school wishing to adopt them. In addition, A STEM rural educator network, through which crosscutting units may be disseminated and teachers may share and support each other, will be created to enhance the teachers’ ability to network, seek advice, share information, etc.
DATE: -
TEAM MEMBERS: Roger Sloboda
resource project Public Programs
This application requests support to enable a team of experienced science educators and biomedical and behavioral health network scientists to develop and implement the Worlds of Connections curriculum. Most middle school students are familiar with patient care-related health careers (e.g., nurses, dentists, surgeons), but few know about emerging careers in network science that can be leveraged to improve population health. This innovative and research-based science program is strategically designed to increase awareness of, understanding of, and interest in the important role of network science for health. This project will design learning activities that incite interest in network science applications to biomedical and public health research. The long- term goal is to enhance the diversity of the bio-behavioral and biomedical workforce by increasing interest in network science among members of underrepresented minority communities and to promote public understanding of the benefits of NIH-funded research for public health. The goal of this application is to identify and create resources that will overcome barriers to network science uptake among underserved minority middle school youth. The central hypothesis is that the technology-rich field of network science will attract segments of today’s youth who remain uninterested in conventional, bio-centric health fields. Project activities are designed to improve understanding of how informal STEM experiences with network science in health research can increase STEM identities, STEM possible selves, and STEM career aspirations among youth from groups historically underrepresented in STEM disciplines at the center of health science research (Aim 1) and create emerging media resources via augmented reality technologies to stimulate broad interest in and understanding of the role of network science in biomedical and public health research (Aim 2). A team led by University of Nebraska-Lincoln sociologists will partner with the University of Nebraska at Omaha; state museums; centers for math, science, and emerging media arts; NIH-funded network scientists; educators; community learning centers at local public schools; learning researchers; undergraduates; software professionals; artists; augmented reality professionals; storytellers; and evaluation experts to accomplish these goals and ensure out of school learning will reinforce Next Generation Science Standards. The Worlds of Connections project is expected to impact 35,250 youth and 20,570 educators in Lincoln and Omaha, Nebraska by: adding network science modules to ongoing 6th-8th-grade afterschool STEM clubs in community learning centers; adding network science for health resources to a summer graduate course on “activating youth STEM identities” for sixth to twelfth grade STEM teachers; connecting teachers with local network scientists; creating free, downloadable, high-quality emerging media arts-enhanced stories; and publishing peer-reviewed research on the potential of network science to attract youth to health careers. Coupled with the dissemination plan, the project design and activities will be replicable, allowing this project to serve as a model to guide other projects in STEM communication.

PUBLIC HEALTH RELEVANCE:
The lack of public understanding about the role of network science in the basic biological and social health sciences limits career options and support for historically underrepresented groups whose diverse viewpoints and questions will be needed to solve the next generation of health problems. The Worlds of Connections project will combine network science, social science, learning research, biology, computer science, mathematics, emerging media arts, and informal science learning expertise to build a series of monitored and evaluated dissemination experiments for middle school science education in high poverty schools. Broad dissemination of the curriculum and project impacts will employ virtual reality technologies to bring new and younger publics into health-related STEM careers.
DATE: -
TEAM MEMBERS: Julia Mcquilan Grace Stallworth
resource project Public Programs
Underrepresented minorities (URMs) represent 33% of the US college age population and this will continue to increase (1). In contrast, only 26% of college students are URMs. In the area of Science Technology, Engineering and Mathematics (STEM), only 15% of college students completing a STEM major are URMs (2). While there have been gains in the percent of Hispanic and Black/African Americans pursuing college degrees, the number of Native American college students remains alarmingly low. In 2013, Native Americans represented only 1% of entering college students and less than 50% finished their degree. Moreover, 1% of students pursuing advanced degrees in STEM-related fields are Native American/Alaska Native. With regards to high school graduation rates, the percent of Native American/Alaska Native students completing high school has decreased with only 51% of students completing high school in 2010 compared to 62 % and 68% for Black and Latino students respectively. While identifying ways to retain students from all underrepresented groups is important, developing programs targeting Native American students is crucial. In collaboration with the Hopi community, a three-week summer course for Native American high school students at Harvard was initiated in 2001. Within three years, the program expanded to include three additional Native American communities. 225 students participated in the program over a 10-year period; and 98% of those responding to the evaluation completed high school or obtained a GED and 98% entered two or four year colleges including 6 students who entered Harvard. This program was reinitiated in 2015 and we plan to build on the existing structure and content of this successful program. Specifically, in collaboration with two Native American communities, the goal of the program is 1) to increase participants’ knowledge of STEM disciplines and their relevance to issues in participants’ communities via a three week case-based summer course for Native American high school students; 2) to help enhance secondary school STEM education in Native American communities by providing opportunities for curriculum development and classroom enhancement for secondary school teachers in the participating Native American communities; and 3) to familiarize students with the college experience and application process and enhance their readiness for college through workshops, college courses and internships. Through these activities we hope to 1) increase the number of Native American students completing high school; 2) increase the number of Native American students applying and being accepted to college; 3) increase the number of Native American students pursuing STEM degrees and careers; 4) increase the perception among Native American students that attending and Ivy plus institution is attainable; 5) increase the feeling of empowerment that they can help their community by pursuing advanced degrees in STEM.

PUBLIC HEALTH RELEVANCE:
This proposal supports a summer program for high school students and teachers from Native American communities. The program goals are to encourage students to complete high school and prepare them for college and to also consider degrees in science, technology, engineering, and math.
DATE: -
TEAM MEMBERS: Sheila Thomas
resource project Public Programs
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.

This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Robert Powell Marc Stern Brandon Frensley
resource project Media and Technology
This project will research and develop the Circuit, a mobile phone and web-based application that will empower families and the general public to discover the broad spectrum of informal Science, Technology, Engineering and Mathematics (STEM) opportunities that exist in most communities. These informal STEM resources include science and children's museums, science and computer camps, maker spaces, afterschool programs, citizen science and much more. There is currently no "one-stop" searching for these resources. Instead, participants must conduct multiple, inefficient Internet searches to find the sought for STEM resources. The Circuit will enable users to efficiently search a rich informal STEM database, identifying resources by location, geography, age levels, science discipline, type of program and other factors. The Circuit builds on SciStarter, an existing online platform that connects thousands of prospective and active citizen scientists to citizen science projects. SciStarter has made possible the collection and organization of several thousand citizen science projects that would otherwise be scattered across the web. The Circuit will build on SciStarter's technical achievements in the citizen science sector, while systematically encompassing the offerings of established national networks. By integrating existing networks of informal STEM resources, the app will afford the public with unrivaled access to informal STEM opportunities, while collecting data that reveals patterns of engagement towards understanding factors of influence between different types of STEM experiences.

The app will provide researchers with new opportunities for researching how families and adults participate in the ecosystem of informal STEM resources in their communities. The Circuit will develop web tools to aggregate and organize digital content from trusted, currently siloed, informal STEM networks of content providers. These include science festivals, science and children's museums, the American Association for the Advancement of Science (AAAS), and Discover Magazine (3 million readers), the largest general interest science publication. Each content partner will feed the app with information directly or through their membership and encourage adoption of The Circuit within their respective communities. The project will design digital tools, including APIs (application program interfaces) to acquire and share digital content, embeddable tools to record and analyze data about movement, engagement, and persistence across domains, and social media tools and related APIs to distribute, track, and analyze content, engagement and demographics. (An API is a code that allows two software programs to communicate with each other.) The project will conduct small-scale, proof-of-conduct studies, to test the viability of the platform to support future, independent full-scale research. An analytics dashboard will be designed and tested with partners, researchers, and evaluators to ensure access to data on patterns of visits, clicks, referrals, searches, "joins," bookmarks, shares, contributions, user-locations, persistence, and more, within and across domains. Because each partner will feed their analytics into the shared dashboard, this will provide unprecedented and much-needed data to advance research in informal STEM learning. The Circuit will allow the tracking of patterns of engagement across networks and programs. Anonymized analytics of behavioral data from end users of The Circuit will support new approaches to advance evidence-based understanding of connected informal STEM learning by exhibiting engagement patterns across informal STEM domains. Through volunteer participation by the public, the Circuit will explore the geographic and demographic patterns of participants in the system, and derive important design lessons for its own and future efforts to create curated systems of connected learning across STEM education in informal settings.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
resource project Public Programs
The role of afterschool programs in the science, technology, engineering, and mathematics (STEM) learning ecosystem has grown over the past two decades, which has led to increasing efforts to support and improve program quality. These efforts include developing STEM programs and curricula, creating standards for facilitating informal STEM learning experiences, building networks of support, and developing tools for assessment and evaluation. However, such efforts may have limited impact in terms of ongoing quality improvement. STEM curricula vary in disciplinary focus, quality and may not apply to local contexts and needs. Many afterschool programs resort to using simple STEM kits or online activities rather than rigorous curricula with support for educators. The project will study how the California Department of Education's (CDE) efforts to change organizational culture to support continuous quality improvement (CQI) have affected the offerings and quality of afterschool STEM in the state's more than 4,500 publicly funded afterschool sites. The EPISTEMIC project will contribute new research findings on how CQI can increase access to higher quality STEM learning opportunities for underserved youth. Even more important, the project will provide new insights on how organizational culture affects participation in and implementation of afterschool CQI.

The team will use an organizational theory framework and a mixed methods approach to conduct three research activities: (1) Describe the organizational context through interviews, participant observations, and artifact analysis to map and describe the overall support system as a context for understanding organizational culture change; (2) Describe change over time in organizational culture, CQI processes, and STEM program offerings and quality through surveys/interviews of afterschool youth, staff, directors, and grantee representatives; and (3) Generate explanations about the relationships between organizational culture, CQI, and STEM quality in different contexts through in depth case studies. Bringing organizational culture, CQI, and STEM offerings and quality into shared focus is the most important intellectual contribution of this work. Organizational theory's sensemaking concept will guide analyses to describe, exemplify, and generate theoretical explanations for patterns in organizational culture, CQI, and STEM program changes, with attention to relevant contextual factors.

Continuous quality improvement provides tools for afterschool STEM staff to identify needs and ways to improve. The EPISTEMIC study will contribute recommendations on the systemic, organizational, and cultural aspects of improvement strategies relevant to policymakers, funders, support providers, and afterschool organizations in California, as well as other state or nongovernmental support systems around the country. The study will also produce CQI guidelines for reflecting on and incorporating changes to organizational culture as part of CQI for afterschool staff and site directors. These will be helpful for practitioners around the country. The study's focus on three organizational contexts -- school district, national afterschool, and local afterschool -- will extend the relevance of the findings and recommendations, which will be disseminated through forums, workshops, and articles in practice and policy-oriented publications. The study will also benefit the research community by providing a framework and methods for studying organizational culture and CQI. The findings on the relationships between organizational culture, CQI, and STEM offerings and outcomes will provide a foundation for further research on how these relate to STEM learning outcomes for youth. EPISTEMIC is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE: -
TEAM MEMBERS: Patrik Lundh Andrea Beesley Timothy Podkul Carrie Allen