This project is expanding an effective mobile making program to achieve sustainable, widespread impact among underserved youth. Making is a design-based, participant-driven endeavor that is based on a learning by doing pedagogy. For nearly a decade, California State University San Marcos has operated out-of-school making programs for bringing both equipment and university student facilitators to the sites in under-served communities. In collaboration with four other CSU campuses, this project will expand along four dimensions: (a) adding community sites in addition to school sites (b) adding rural contexts in addition to urban/suburban, (c) adding hybrid and online options in addition to in-person), and (d) including future teachers as facilitators in addition to STEM undergraduates. The program uses design thinking as a framework to engage participants in addressing real-world problems that are personally and socially meaningful. Participants will use low- and high-tech tools, such as circuity, coding, and robotics to engage in activities that respond to design challenges. A diverse group of university students will lead weekly, 90-minute activities and serve as near-peer mentors, providing a connection to the university for the youth participants, many of whom will be first-generation college students. The project will significantly expand the Mobile Making program from 12 sites in North San Diego County to 48 sites across California, with nearly 2,000 university facilitators providing 12 hours of programming each year to over 10,000 underserved youth (grades 4th through 8th) during the five-year timeline.
The project research will examine whether the additional sites and program variations result in positive youth and university student outcomes. For youth in grades 4 through 8, the project will evaluate impacts including sustained interest in making and STEM, increased self-efficacy in making and STEM, and a greater sense that making and STEM are relevant to their lives. For university student facilitators, the project will investigate impacts including broadened technical skills, increased leadership and 21st century skills, and increased lifelong interest in STEM outreach/informal science education. Multiple sources of data will be used to research the expanded Mobile Making program's impact on youth and undergraduate participants, compare implementation sites, and understand the program's efficacy when across different communities with diverse learner populations. A mixed methods approach that leverages extant data (attendance numbers, student artifacts), surveys, focus groups, making session feedback forms, observations, and field notes will together be used to assess youth and university student participant outcomes. The project will disaggregate data based on gender, race/ethnicity, grade level, and site to understand the Mobile Making program's impact on youth participants at multiple levels across contexts. The project will further compare findings from different types of implementation sites (e.g., school vs. library), learner groups, (e.g., middle vs. upper elementary students), and facilitator groups (e.g., STEM majors vs. future teachers). This will enable the project to conduct cross-case comparisons between CSU campuses. Project research will also compare findings from urban and rural school sites as well as based on the modality of teaching and learning (e.g., in-person vs. online). The mobile making program activities, project research, and a toolkit for implementing a Mobile maker program will be widely disseminated to researchers, educators, and out-of-school programs.
Recent studies have advocated for a shift toward educational practices that involve learners in actively contributing to science, technology, engineering, and mathematics (STEM) as a shared and public endeavor, rather than limiting their involvement to the construction of previously established knowledge. Prioritizing learners’ agency in deciding what is worth knowing and how learning takes place may create more equitable and inclusive learning experiences by centering the knowledge, cultural practices, and social interactions that motivate learning for people across ages, genders, and backgrounds. In informal learning environments, families’ social interactions are critical avenues for STEM learning, and science centers and museums have developed strategies for prompting families’ sustained engagement and conversation at STEM exhibits. However, exhibits often guide visitors’ exploration toward predetermined insights, constraining the ways that families can interact with STEM content, and neglecting opportunities to tap into their prior knowledge. Practices in the maker movement that emphasize skill-building and creative expression, and participatory practices in museums that invite visitors to contribute to exhibits in consequential ways both have the potential to reframe STEM learning as an ongoing, social process that welcomes diverse perspectives. Yet little is known about how these practices can be scaled, and how families themselves respond to these efforts, particularly for the diverse family audiences that science centers and museums aim to serve. Further, although gender and ethnicity both affect learning in informal settings, studies often separate participants along a single dimension, obscuring important nuances in families’ experiences. By addressing these outstanding questions, this research responds to the goals of the Advancing Informal STEM Learning (AISL) program, which seeks to advance evidence-based understanding of the design and development of STEM learning opportunities for the public in informal environments. This includes providing multiple pathways for broadening engagement in STEM learning experiences and advancing innovative research on STEM learning in informal environments.
Research will address (1) how families perceive and act on their collective epistemic agency while exploring STEM exhibits (i.e., how they work together to negotiate and pursue their own learning goals); (2) whether and how families’ expressions of agency are influenced by gender and ethnicity; and (3) what exhibit design features support expressions of agency for the broadest possible audience. Research studies will use interviews and observational case studies at a range of exhibits with distinct affordances to examine families’ epistemic agency as a shared, social practice. Cultural historical activity theory and intersectional approaches will guide qualitative analyses of families’ activities as systems that are mediated by the physical environment and social setting. Education activities will involve an ongoing collaboration between researchers, exhibit designers, educators, and facilitators (high-school and college-level floor staff), using a Change Laboratory model. The group will use emerging findings from the research to create a reflection tool to guide the development of more inclusive learning experiences at STEM exhibits, and a set of design principles for supporting families’ expressions of agency. A longitudinal ethnographic study will document the development of inclusive exhibit design practices throughout the project as well as how the Change Lab participants develop their sociocultural perspectives on learning and exhibit design over time. Analyzing these shifts in practice within the Change Lab will provide a deeper understanding of what works and what is difficult or does not occur when working toward infrastructure change in museums. By considering how multiple aspects of families’ identities shape their learning experiences, this work will generate evidence-based recommendations to help science centers and museums develop more inclusive practices that foster a sense of ownership over the learning process for the broadest possible audience of families.
The NIH Science Education Partnership Award (SEPA) program of Emory University endeavors to use an over-arching theme of citizen science principles to:
develop an innovative curriculum based on citizen science and experiential learning to evaluate the efficacy of informal science education in after-school settings;
promote biomedical scientific careers in under-represented groups targeting females for Girls for Science summer research experiences;
train teachers in Title I schools to implement this citizen science based curriculum; and
disseminate the citizen science principles through outreach.
This novel, experiential science and engineering program, termed Experiential Citizen Science Training for the Next Generation (ExCiTNG), encompasses community-identified topics reflecting NIH research priorities. The curriculum is mapped to Next Generation Science Standards.
A comprehensive evaluation plan accompanies each program component, composed of short- and/or longer-term outcome measures. We will use our existing outreach program (Students for Science) along with scientific community partnerships (Atlanta Science Festival) to implement key aspects of the program throughout the state of Georgia. These efforts will be overseen by a central Steering Committee composed of leadership of the Community Education Research Program of the Emory/Morehouse/Georgia Institute of Technology Atlanta Clinical Translational Science Institute (NIH CTSA), the Principal Investigators, representatives of each program component, and an independent K–12 STEM evaluator from the Georgia Department of Education.
The Community Advisory Board, including educators, parents, and community members, will help guide the program’s implementation and monitor progress. A committee of NIH-funded investigators, representing multiple NIH institutes along with experienced science writers, will lead the effort for dissemination and assure that on-going and new NIH research priorities are integrated into the program’s curriculum over time.
DATE:
-
TEAM MEMBERS:
Adam MarcusTheresa Gillespie
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
resourceprojectWebsites, Mobile Apps, and Online Media
The intent of this five-year project is to design, deliver, and study professional development for Informal Science Learning (ISL) educators in the arena of equity-focused STEAM (Science, Technology, Engineering, Art, and Mathematics) teaching and learning. While the strategy of integrating art and science to promote interest, identity, and other STEM-related learning has grown in recent years, this domain is still nascent with respect to a guiding set of best practices. Through prior work, the team has developed and implemented a set of design principles that incorporate effective practices for broadening participation of girls in science via science-art integration on the topic of the biology, chemistry and optics of "Colors in Nature." The continued initiative would impact the ISL field by providing a mechanism for ISL educators in museums, libraries and after-school programs to adopt and implement these STEAM design principles into their work. The team will lead long-term (12-18 months) professional development activities for ISL educators, including: 1) in-person workshops that leverage their four previously developed kits; 2) online, asynchronous learning activities featuring interactive instructional videos around their STEAM design principles; 3) synchronous sessions to debrief content and foster communities of practice; and 4) guided design work around the development or redesign of STEAM activities. In the first four years of the project, the team will work with four core institutional partners (Sitka Sound Science Center, Sno-Isle Libraries, the Fairbanks North Star Borough School District after-school program, and the Pima County Public Library system) across three states (Alaska, Washington, and Arizona). In the project's later stages, they will disseminate their learning tools to a broad, national audience. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project has three main goals: (1) To support ISL educators in offering meaningful STEAM activities, (2) To create institutional change among the partner organizations, and (3) To advance the ISL field with respect to professional development and designing for STEAM Programming. The research questions associated with the professional development activities address the ways in which change occurs and focus on all three levels: individual, institutional, and the ISL field. The methods are qualitative and quantitative, including videotaped observations, pre and post interviews, surveys and analysis of online and offline artifacts. In addition, the project evaluation will assess the implementation of the project's professional development model for effectiveness. Methods will include observations, interviews, surveys and Website analytics and program data.
Women continue to be underrepresented in computer science professions. In 2015, while 57% of professional occupations in the U.S. were held by women, only 25% of computing occupations were held by women. Furthermore, the share of computer science degrees going to women is smaller than any STEM field, even though technology careers are the most promising in terms of salaries and future growth. Research suggests that issues contributing to this lack of computer science participation begin early and involve complex social and environmental factors, including girls' perception that they do not belong in computer science classes or careers. Computer science instruction often alienates girls with irrelevant curriculum; non-collaborative pedagogies; a lack of opportunities to take risks or make mistakes; and a heavy reliance on lecture instead of hands-on, project-based learning. Computer science experiences that employ research-based gender equitable best practices, particularly role modeling, can help diminish the gender gap in participation. In response to this challenge, Twin Cities PBS (TPT), the National Girls Collaborative (NGC) and Code.org will lead Code: SciGirls! Media for Engaging Girls in Computing Pathways, a three-year project designed to engage 8-13 year-old girls in coding through transmedia programming which inspires and prepares them for future computer science studies and career paths. The project includes five new PBS SciGirls episodes featuring girls and female coding professionals using coding to solve real problems; a new interactive PBSKids.org game that allows children to develop coding skills; nationwide outreach programming, including professional development for informal educators and female coding professionals to facilitate activities for girls and families in diverse STEM learning environments; a research study that will advance understanding of how the transmedia components build girls' motivation to pursue additional coding experiences; and a third-party summative evaluation.
Code: SciGirls! will foster greater awareness of and engagement in computer science studies and career paths for girls. The PBS SciGirls episodes will feature girls and female computer science professionals using coding to solve real-world challenges. The project's transmedia component will leverage the television content into the online space in which much of 21st century learning takes place. The new interactive PBSKids.org game will use a narrative framework to help children develop coding skills. Drawing on narrative transportation theory and character identification theory, TPT will commission two exploratory knowledge-building studies to investigate: To what extent and how do the narrative formats of the Code: SciGirls! online media affect girls' interest, beliefs, and behavioral intent towards coding and code-related careers? The studies aim to advance understanding of how media builds girls' motivation to pursue computer science experiences, a skill set critical to building tomorrow's workforce. The project team will also raise educators' awareness about the importance of gender equitable computer science instruction, and empower them with best practices to welcome, prepare and retain girls in coding. The Code: SciGirls! Activity Guide will provide educators with a relevant resource for engaging aspiring computer scientists. The new media and guide will also reside on PBSLearningMedia.org, reaching 1.2 million teachers, and will be shared with thousands of educators across the SciGirls CONNECT and National Girls Collaborative networks. The new episodes are anticipated to reach 92% of U.S. TV households via PBS, and the game at PBSKids.org will introduce millions of children to coding. The summative evaluation will examine the reach and impact of the episodes, game and new activities. PIs will share research findings and project resources at national conferences and will submit to relevant publications. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.