This is a brief literature review examining the theory and practice of Community-Based Participatory Research (CBPR). It highlights CBPR's liberatory intent, and focuses on CBPR practice in indigenous communities and among youth.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. Informal STEM learning opportunities are often rare in rural locations where the early childhood education system is also under-resourced. Through partnerships with educational researchers, early math educators, pediatric health experts, and pediatric clinics, this project will develop and study a new opportunity for informal math learning. The project will work with pediatric clinics that serve rural immigrant families who are racially, culturally, and linguistically diverse. The project leverages the high levels of trust many caregivers have in their child’s pediatrician to improve math learning during critical early years. This project will build on a previous program where physician text messages to caregivers supported youth literacy development. In this instance the project will support caregivers’ math interactions with their 3- and 4-year-olds to cultivate children's math knowledge and skills. The text messaging program will be grounded in research in child development, mathematics learning, parenting practices, and adult behavior change. Texts will also provide caregiver supports for how to engage their children in mathematical activates in their everyday lives and provide information about the important skills children are developing. Text messages will be co-developed with caregiver input, and focus on content underlying mathematical development such as Number Sense, Classification and Patterning, Measurement, Geometry, and Reasoning. Caregivers will receive text messages from their pediatric clinics three times a week for eight months. For example, three related texts supporting Number Sense include: “FACT: Kids enjoy counting and it prepares them for K! Mealtimes are a fun time to practice counting objects;” “TIP: At a meal, say: Can you count all the cups on the table? All the plates? What else can you count? (Forks) Tell them: Great job!” and “GROWTH: You are helping kids to count & get ready for K. At the park, ask: How many bikes are there? How many birds? Count together & find out!” Throughout the planning and implementation phases of the project the team will work closely with early education math experts, key advisors, and caregivers to ensure the text messaging program is tailored to meet the cultural, linguistic, and contextual needs of rural caregivers and children.
The project will research impacts of the text messaging program on children, caregivers, and clinical staff. First, the project will investigate the impact of the texting program on children through a randomized trial, and pre-and-post measures of early childhood math skills and abilities. Second, using interviews at baseline and in a 9-month follow-up, the project will study the texting program’s impact on caregivers’ perceptions regarding the importance of math learning for young children. Third, the project will explore the impact of the text messaging program on health professionals’ understanding of math learning in early childhood by collecting qualitative data and assessing attitudes about the clinic’s role in supporting early math. Caregivers and clinic staff will also participate in focus groups to better understand impacts for each of these groups. The project will reach 1000 families, who will be randomly assigned to treatment or control groups through block-randomization, stratified by caregiver language and child’s age. This parent-informed project will build evidence toward new approaches to promoting early math in the pediatric clinic, an informal environment that can reach all families and can leverage innovative technology. Findings will be shared widely though a communication and engagement plan that includes children, caregivers, physicians and clinic staff, informal STEM educators, researchers, and policy makers.
DATE:
-
TEAM MEMBERS:
Lisa ChamberlainSusanna LoebJaime Peterson
Hands-on tinkering experiences can help promote more equitable STEM learning opportunities for children from diverse backgrounds (Bevan, 2017; Vossoughi & Bevan, 2014). Latine heritage families naturally engage in and talk about engineering practices during and after tinkering in a children’s museum (Acosta & Haden, in press). We asked how the everyday practice of oral stories and storytelling could be leveraged during an athome tinkering activity to support children’s informal engineering and spatial learning.
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
For at-risk children who cannot attend preschool, accessing science activities depends almost entirely on parents—but many parents have limited skills for supporting such learning. PBS station WGBH has recently launched a series of free family apps based on the Emmy Award-winning preschool science series, PEEP and the Big Wide World. The apps were developed to be used jointly by parent and child for a shared learning experience. Available on Google Play and the App Store in both Spanish and English, PEEP Family Science apps cover the topics of shadows, sound, color, and ramps, respectively.
To engage parents and young children in exploring science together, media producers from WGBH (Boston’s public media station) and researchers from Education Development Center (EDC) collaborated with two home-visiting organizations—Home Instruction for Parents of Preschool Youngsters (HIPPY USA) and AVANCE—to design and test PEEP Family Science, an app-based intervention with science-focused digital media resources and associated supports for diverse, low-income families. Both organizations target families whose children do not attend preschool. These home visiting organizations play a unique
Refugee youth are particularly vulnerable to STEM disenfranchisement due to factors including limited or interrupted schooling following displacement; restricted exposure to STEM education; and linguistic, cultural, ethnic, socioeconomic, and racial minority status. Refugee youth may experience a gap in STEM skills and knowledge, and a conflict between the identities necessary for participation in their families and communities, and those expected for success in STEM settings. To conduct research to better understand these challenges, an interrelated set of activities will be developed. First, youth will learn principles of physics and computing by participating in cosmic ray research with physicists using an instructional approach that builds from their home languages and cultures. Then youth periodically share what they are learning in the cosmic ray research with their parents, siblings, and science teachers at family and community science events. Finally, youth conduct reflective research on their own STEM identity development over the course of the project. Research on learning will be conducted within and across these three strands to better understand how refugee youth develop STEM-positive identities. This project will benefit society by improving equity and diversity in STEM through (1) creating opportunities for refugee youth to participate in physics research and to develop computing skills and (2) producing knowledge on STEM identity development that may be applied more broadly to improve STEM education. Deliverables from this project include: (a) research publications on STEM identity and learning; (b) curriculum resources for teaching physics and computing to multilingual youth; (c) an online digital storytelling exhibit offering narratives about belonging in STEM research which can be shared with STEM stakeholders (policy makers, scientists, educators, etc.); and (d) an online database of cosmic ray data which will be available to physicists worldwide for research purposes. This Innovations in Development proposal is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This program is designed to provide multiple contexts, relationships, and modes across and within which the identity work of individual students can be studied to look for convergence or divergence. To achieve this goal, the research applies a linguistic anthropological framework embedding discourse analysis in a larger ethnography. Data collected in this study include field notes, audio and video recordings of naturalistic interactions in the cosmic ray research and other program activities, multimodal artifacts (e.g., students' digital stories), student work products, interviews, and surveys. Critically, this methodology combines the analysis of identity formation as it unfolds in moment-to-moment conversations (during STEM learning, and in conversations about STEM and STEM learning) with reflective tasks and the production of personal narratives (e.g., in digital stories and interviews). Documenting convergence and divergence of STEM identities across these sources of data offers both methodological and theoretical contributions to the field. The research will offer thick description of the discursive practices of refugee youth to reveal how they construct identities related to STEM and STEM disciplines across settings (e.g., during cosmic ray research, while creating digital stories), relationships (e.g., peer, parent, teacher), and the languages they speak (e.g., English, Swahili). The findings will be of potential value to instructional designers of informal learning experiences including those working with afterschool, museums, science centers and the like, educators, and scholars of learning and identity.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Tino NyaweloJohn MatthewsJordan GertonSarah Braden
This award takes an innovative approach to an ongoing, pervasive, and persistent societal issue: women are still drastically underrepresented in computing careers. This project targets middle school-aged girls because it is a time when many of them lose interest and confidence in pursuing technical education and computing careers. This project will design, develop, and deploy a one-week experience focused on middle school girls that targets this issue with a novel combination of teaching techniques and technology. The project will use wearable computing devices to support girls' social interactions as they learn computing and solve technical challenges together. The goals of the project are to raise interest, perceived competence, and involvement in the computational ability of girls. Additionally, the project aims to increase a sense of computational community for girls that makes pursuing computational skills more relevant to their identities and lives, and that helps continued participation in computing. The project will deploy a one-week experience four times per year with a socioeconomically diverse range of campers. The project will also develop a 'program in a box' kit that can be broadly used by others wishing to deliver a similar experience for girls.
The planned research will determine if a one-week experience that uses social wearable construction in the context of live-action role play can use the mediating process of computational community formation to positively impact middle school girls' engagement with and interest in computation. Computational community is defined as girls engaging together in the process of learning computation, trading resources and knowledge, and supporting growth. Research participants will include 100 6th to 9th-grade girls. At least 75% of the participants will be either low income, first-generation college-bound, or underrepresented in higher education. Students will be recruited through the longstanding partnerships with title one schools in the Salinas Valley, the Educational Partnership Center, and in the Pajaro Valley Unified School district, where 82% of the students are Hispanic/Latinx, 42% are English Learners, and 73% are eligible for free or reduced lunch. The research questions are: 1) Does the proposed experience increase girls' self-reported competence, self-efficacy, and interest in computational skills and careers? and 2) Will the proposed experience lead to activity-based evidence of learning and integration of computational skills at the group social level? The project will use a mixed-methods, design-based research approach which is an iterative design process to rapidly collect and analyze data, and regularly discuss the implications for practice with the design team. Data will be collected using observations, interviews, focus groups, surveys, and staff logs. Quantitative data will be analyzed using frequencies, means, and measures of dispersion will be applied to survey data from both time points. Pearson correlation coefficients will be used to describe the bivariate relationship between continuous factors. ANOVAs will assess whether there are significant differences in continuous measures across groups. Qualitative data will be analyzed using a constant comparison method.
This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This project would expand the informal STEM learning field's understanding of how to use digital science media to increase STEM educational experiences and opportunities for English language learners. Across the U.S. there are significant STEM opportunity and achievement gaps for English learners with varying levels of English proficiency. This is at a time when the U.S. is facing a shortage of STEM professionals in the workforce including the life and physical science fields. This project aims to close these gaps and improve English learners' STEM learning outcomes using digital media. Within community colleges, there are multiple site-based programs to provide content to help English learners to learn English and to improve their math and literacy skills. Involving the state community college networks is a critical strategy for gathering important feedback for the pedagogical approach as well as for recruiting English learner research participants. The team will initially study an existing YouTube chemistry series produced by Complexly then produce and test new videos in Spanish using culturally relevant instructional strategies. The target audience is 18-34-year-old English learners. Project partners are Complexly, a producer of digital STEM media and EDC, a research organization with experience in studying informal STEM learning.
The project has the potential to advance knowledge about the use of culturally relevant media to improve STEM opportunities and success for English language learners. Using a Design-Based Implementation Research framework the research questions include: 1) what are the effective production and instructional strategies for creating digital media to teach science to English learners whose native language is Spanish? 2) what science content knowledge do English learners gain when the project's approach is applied to a widely available set of YouTube videos? and 3) how might the findings from the research be applied to future efforts targeting English learners? The project has the potential to significantly broaden participation in science and engineering. Phase 1 of the research will be an exploration of how to apply strategic pedagogical approaches to digital media content development. Interviews will be conducted with educators in 3 focal states with high numbers of English language learners (NY, CA, TX) to reflect on pedagogical foundations for teaching science to English learners. A survey of 30 English learners will provide feedback on the perceived strengths and weaknesses of a selection of existing YouTube chemistry videos. Phase 2 will create/test prototypes of 6 adapted chemistry videos. Forty students (ages 18-34) will be recruited and participate in cognitive interviews with researchers after viewing these videos. Based on this input additional videos will be produced with revised instructional strategies for further testing. Additional rounds of production and testing will be conducted to develop an English learners mini chemistry series. Phase 3 will be a pilot study to gauge the science learning of 75 English learners who will view an 11-episode chemistry miniseries. It will also identify gaps in expected learning to determine whether any further adjustments are necessary to the instructional approach.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Kelsey SavageCeridwen RileyStan MullerHeather LavigneCaroline ParkerKatrina Bledsoe
How can creators of STEM learning media reach underserved parents and children, and support the kinds of playful STEM interactions that are foundational for future STEM learning?
This research report summarizes findings from a pilot study of Cyberchase: Mobile Adventures in STEM, a program that uses mobile text messaging and short videos to encourage hands-on family learning among low-income Latino families.
In the study, 95 mostly Latino families received weekly text messages with video clips from the popular children's series Cyberchase, and fun activities to do with their
Science television shows are an important source of informal learning and enrichment for preschool-aged children. However, one limitation of television programming is that it is largely a one-way, non-interactive medium. Research suggests that children learn best through active engagement with content, and that parents can make TV watching more interactive by co-viewing and talking with their children. However, many parents and other adults may lack the time or experience and comfort with science language and content to provide critcial just-in-time support for their children. This study seeks to take advantage of recent advances in artificial intelligence that now allow children to enjoyably interact with automated conversational agents. The research team will explore whether such conversational agents, embedded as an on-screen character in a science video, can meaningfully interact with children about the science content of the show by simulating the benefits of co-viewing with an adult. If successful, the project could lay the foundation for a new genre of science shows, helping transform video watching into more interactive and engaging learning experiences. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project will develop interactive videos incorporating a conversational agent in three 11-minute episodes of a future children's animated television program. The videos will enable children to speak with the main character of the show as the character solves everyday science mysteries, thus priming children to engage in observation, prediction, pattern finding, and problem solving through scaffolded conversation. This study will be carried out in two iterative cycles with the goal of developing and testing the embedded conversational function for each episode. In each cycle, the project team, which includes experts in children's TV production, as well as educational and HCI researchers will develop the storyboard and conversation prompts and follow-ups, create animated videos based on the revised script, and create a mobile application of the interactive video integrated with the conversational agent. Field testing with 10 children will be conducted to iteratively improve the embedded conversational function. In the pilot testing stage, a controlled study will be conducted with 30 children in each group (N=120): 1) watching the episode with the embedded conversational function; 2) watching the episode with a human partner carrying out the dialogue in the script rather than the virtual character; 3) watching the episode with pseudo-interaction, in which the animated character asks questions but does not attempt to understand or personally respond to children's answers; and 4) watching the episode with no dialogue. Data collected from the experiments will be used to examine whether and in what ways use of a conversational agent affects children's engagement, attention, communication strategies, perceptions, and science learning, and whether these effects vary by children's age, gender, socioeconomic status, language background, and oral language proficiency in English. The project will provide a comprehensive evaluation of the feasibility and potential of incorporating conversational agents into screen media to foster young children's STEM learning and engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Mark WarschauerDaniel WhitesonSara DeWittAndres BustamanteAbby Jenkins