As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. Informal STEM learning opportunities are often rare in rural locations where the early childhood education system is also under-resourced. Through partnerships with educational researchers, early math educators, pediatric health experts, and pediatric clinics, this project will develop and study a new opportunity for informal math learning. The project will work with pediatric clinics that serve rural immigrant families who are racially, culturally, and linguistically diverse. The project leverages the high levels of trust many caregivers have in their child’s pediatrician to improve math learning during critical early years. This project will build on a previous program where physician text messages to caregivers supported youth literacy development. In this instance the project will support caregivers’ math interactions with their 3- and 4-year-olds to cultivate children's math knowledge and skills. The text messaging program will be grounded in research in child development, mathematics learning, parenting practices, and adult behavior change. Texts will also provide caregiver supports for how to engage their children in mathematical activates in their everyday lives and provide information about the important skills children are developing. Text messages will be co-developed with caregiver input, and focus on content underlying mathematical development such as Number Sense, Classification and Patterning, Measurement, Geometry, and Reasoning. Caregivers will receive text messages from their pediatric clinics three times a week for eight months. For example, three related texts supporting Number Sense include: “FACT: Kids enjoy counting and it prepares them for K! Mealtimes are a fun time to practice counting objects;” “TIP: At a meal, say: Can you count all the cups on the table? All the plates? What else can you count? (Forks) Tell them: Great job!” and “GROWTH: You are helping kids to count & get ready for K. At the park, ask: How many bikes are there? How many birds? Count together & find out!” Throughout the planning and implementation phases of the project the team will work closely with early education math experts, key advisors, and caregivers to ensure the text messaging program is tailored to meet the cultural, linguistic, and contextual needs of rural caregivers and children.
The project will research impacts of the text messaging program on children, caregivers, and clinical staff. First, the project will investigate the impact of the texting program on children through a randomized trial, and pre-and-post measures of early childhood math skills and abilities. Second, using interviews at baseline and in a 9-month follow-up, the project will study the texting program’s impact on caregivers’ perceptions regarding the importance of math learning for young children. Third, the project will explore the impact of the text messaging program on health professionals’ understanding of math learning in early childhood by collecting qualitative data and assessing attitudes about the clinic’s role in supporting early math. Caregivers and clinic staff will also participate in focus groups to better understand impacts for each of these groups. The project will reach 1000 families, who will be randomly assigned to treatment or control groups through block-randomization, stratified by caregiver language and child’s age. This parent-informed project will build evidence toward new approaches to promoting early math in the pediatric clinic, an informal environment that can reach all families and can leverage innovative technology. Findings will be shared widely though a communication and engagement plan that includes children, caregivers, physicians and clinic staff, informal STEM educators, researchers, and policy makers.
DATE:
-
TEAM MEMBERS:
Lisa ChamberlainSusanna LoebJaime Peterson
Early childhood is a critical time for developing foundational knowledge, skills, and interest in science, technology, engineering, and mathematics (STEM). For that reason, the Public Broadcasting Service (PBS) places a great priority on developing early childhood STEM content, especially through its television shows that are watched by over 60% of young children in the United States. Research suggests that adding in-the-moment interaction to television watching promotes learning and engagement. Toward this end, researchers from the University of California, Irvine and PBS KIDS have prototyped interactive versions of science shows that children view on internet-connected devices while they communicate with the main character powered by an AI conversational agent. Pilot studies show that when children watch these new interactive videos with the main character pausing periodically to ask probing questions about the learning goals of the episode and following up with appropriate responses, they are more engaged and learn more about science, with heightened benefits for children who speak languages other than English at home. Based on these early results, in this Innovations in Development project the research team will develop, test and produce publicly available conversational episodes for two PBS KIDS television shows, one focused on science and the other on computational thinking.
The project will iteratively study and develop six conversational videos with novel forms of support for children, including extended back-and-forth conversation that builds upon a child's responses, visual scaffolding that facilitates verbal communication, and bilingual language processing so that children can answer in English or Spanish. The conversational videos will be evaluated in both lab-based and home settings. The lab-based study will involve 600 children ages 3-7 in a predominantly low-income Latino community in Southern California, in which researchers compare children’s learning and engagement when watching the conversational videos with three other formats: (1) watching the non-interactive broadcast version of the video; (2) watching the video with pseudo-interaction, in which the main character asks questions and gives a generic response after a fixed amount of time but can’t understand what the child says; or (3) watching the broadcast version of the video with a human co-viewer who pauses the video and asks questions. The home-based study will involve 80 families assigned to watch either the non-interactive or interactive videos as many times as they want over a month at home. In both the lab-based and home studies, pre- and post-tests will be used to examine the impact of video watching on science and language learning, and log data will be used to assess children’s verbalization and engagement while watching. Following the home study, the six videos will be further refined and made available for free to the public through the PBS KIDS apps and website, which are visited by more than 13 million users a month. Beyond providing engaging science learning opportunities to children throughout the country, this study will yield important insights into the design, usability, feasibility, and effectiveness of incorporating conversational agents into children’s STEM-oriented video content, with implications for extending this innovation to other educational media such as e-books, games, apps, and toys.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program.
DATE:
-
TEAM MEMBERS:
Mark WarschauerSilvia LovatoAndres BustamanteAbby JenkinsYing Xu
resourceprojectProfessional Development, Conferences, and Networks
Millions of Latinx youth, aged 14 to 18, work formal or informal jobs to provide income for themselves or their families. In the context of these workplaces, Latinx youth demonstrate numerous skills that are essential to industrial engineering, such as minimizing workplace injuries or optimizing processes to maximize efficiency. However, their workplace ingenuity and skills are often underrecognized by educational systems. To counter this lack of recognition, the purpose of this project is to iteratively develop and research an out-of-school engineering program for working Latinx youth. This program is designed to recognize and build from youths’ workplace experiences by connecting them with industrial engineering concepts and practices, such as those used to promote worker safety. This program is also designed for youth to articulate transformational visions of industrial engineering, which expand current goals, values, and methods commonly embraced within this discipline. This year-long program will be facilitated by educators of existing out-of-school programs (e.g., Mathematics, Engineering, and Science Achievement), in partnership with undergraduate mentors from the Society for Professional Hispanic Engineers and other local organizations that serve Latinx youth (e.g., Latinos in Action). Approximately 220 youth are expected to participate in the programming. Researchers will explore whether and how youth participants develop identities in engineering, as well as how the educators and mentors understand and enact assets-based, out-of-school engineering education grounded in youths’ experiences. Researchers will also identify the individual, institutional, and systemic factors that support or inhibit sustained implementation of the program over time in different sites and contexts. This project will result in a set of empirically tested, bilingual program materials that will be disseminated widely to professional organizations dedicated to out-of-school programming and to serving Latinx youth.
This project will result in a localizable, transferable, and sustainable model for an out-of-school time program that recognizes and amplifies Latinx youths’ workplace funds of knowledge and leverages them toward youth-driven visions and applications of engineering. This program, which will connect with other people and sites in youths’ learning ecosystems, is grounded in principles of translanguaging, transformational mentorship, and educational dignity and recognition. In partnership with youth participants, researchers will use a social design experiment to explore the following research questions: What are the engineering identity trajectories of working high school youth, and how do specific moments of identity negotiation and recognition relate to broader patterns across program sessions and identity trajectories for individual participants over time? To answer these questions, a pre-, mid- and post-program Engineering Identity Scale; recordings of program implementations; interviews; and youth artifacts will be analyzed using various methods such as critical multimodal discourse analysis. After implementations of the program across multiple sites, researchers will use design-based implementation research to answer the following questions: How do educators and mentors understand and enact assets-based pedagogies designed to foster recognition across sites? What institutional and systemic features (designed or naturalistic) support or inhibit productive adaptations and implementations of the program? These questions will be answered using constant comparative analyses of data sources such as interviews with the program educators and mentors, observations of program implementations, observations of professional development sessions, and public documents. Culturally responsive, educative evaluation will be used to iteratively improve the program. The resulting research and program materials will be disseminated widely through professional organizations dedicated to Latinx youth, engineering education, and out-of-school learning.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments.
DATE:
-
TEAM MEMBERS:
Amy Wilson-LopezAlfonso Torres-RuaMarisela Martinez-ColaColby Tofel-GrehlAlfonso Torres-Rua
Access to STEM information is unequal, with rural and poor communities often receiving the fewest public education science and science literacy opportunities. Rural areas also face unique STEM teaching and technology integration challenges. In fact, LatinX communities in rural areas are less likely to have access to educational resources and language supports available to LatinX communities in urban centers. This project will help address these inequities by engaging rural librarians, bilingual science communicators, polar scientists, and a technical team to create a series of five bilingual virtual reality (VR) experiences to enhance STEM understanding and appreciation. Project researchers will create a new channel for disseminating polar science, working first with rural Latinx communities in Wisconsin to create a new network between rural communities and university researchers. Involving rural librarians in the co-design of instruction process will produce new ways for rural libraries to engage their local communities and their growing Latinx populations with polar science learning experiences. Each of the five VR experiences will focus on a different area of research, using the captivating Arctic and Antarctic environments as a central theme to convey science. VR is a particularly powerful and apt approach, making it possible to visit places that most cannot experience first-hand while also learning about the wide range of significant research taking place in polar regions. After design, prototyping and testing are finished, the VR experiences will be freely available for use nationally in both rural and urban settings. Public engagement with science creates a multitude of mutual benefits that result from a better-informed society. These benefits include greater trust and more reasoned scrutiny of science along with increased interest in STEM careers, many of which have higher earning potential. The project team will partner with 51 rural libraries which are valued community outlets valuable outlets to improve science literacy and public engagement with science. The effects of this project will be seen with thousands of community members who take part in the testing of prototype VR experiences during development and scaled engagement through ongoing library programs utilizing the final VR experiences for years to come.
This project will create new informal STEM learning assessment techniques through combining prior efforts in the areas of educational data mining for stealth assessment and viewpoint similarity metrics through monitoring gaze direction. Results of the project contribute to the field of educational data mining (EDM), focusing on adopting its methods for VR learning experiences. EDM is a process of using fine grained interaction data from a digital system to support educationally relevant conclusions and has been applied extensively to intelligent tutors and more recently, educational videogames. This project will continue building on existing approaches by expanding to include the unique affordances of VR learning media, specifically gaze. The project will focus on predicting user quitting as well as assessing key learning goals within each experience and triangulate these predictive models with user observations and post-experience surveys. The eventual application of this foundational research would address the problem in assessing a learner using measures external to the experience itself (i.e., surveys) and instead provide new methods that instrument learners using only data generated by their actions within the learning context. These techniques will provide a new means for evaluating informal learning in immersive technology settings without need for explicit tagging. The findings from this project will enable a greater understanding of the relationship between a user’s experience and their learning outcomes, which may prove integral in the creation of educational interventions using VR technology.
This Innovations in Development project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to (a) advance new approaches to and evidence-based understanding of the design and development of STEM learning in informal environments; (b) provide multiple pathways for broadening access to and engagement in STEM learning experiences; (c) advance innovative research on and assessment of STEM learning in informal environments; and (d) engage the public of all ages in learning STEM in informal environments. This project is also supported by the Office of Polar Programs.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project aims to understand ways to empower Latinx families (adult caregivers) to feel confident in their ability to support their middle school-aged girls in science and engineering activities. The project involves seven weeks of family programming around rockets or urban farming, as well as separate conversation groups for adult family members and girls. The project is relevant for several reasons: females and Latinx individuals are both underrepresented in science, technology, engineering, and math (STEM) coursework and careers; girls tend to lose interest in STEM by middle school age; and adult family members may have an impact on their children's attitudes and interests. The project partners with school districts and nonprofit organizations in Arizona and California.
This multidisciplinary project's priority is broadening participation, with a focus on increasing Latina girls' science and engineering interests through Family Project-Based Learning Activities, Conversation Groups, and a cultivated Community of Learners. It is based on the frameworks of Social Cognitive Career Theory and Community Cultural Wealth. The project aims to empower families (adult caregivers) to feel confident in their ability to support their daughters in science and engineering activities, which is often low especially among Latinx parents. The project will develop and evaluate two out-of-school enrichment methods for aiding families in encouraging and supporting their daughters in science: Family Problem-Based Learning Activities, which focus on rockets and urban farming, and Conversation Groups, which provide information and discussion for separate groups of parents and girls. A series of pilot studies will be conducted with 80 families to iteratively evaluate and improve the materials and procedure prior to the main study with 180 families, featuring a factorial design with a control group.
The materials developed and research findings may inform similar projects, especially those for students from culturally and linguistically diverse backgrounds and projects seeking to enhance the role of families in learning. The hypothesis guiding the project is that the greatest gains will be produced with the synergistic combination of enrichment methods. Another component that can potentially have broad impact is working to create environments where Community Cultural Wealth is recognized and enhanced through interactions of different families, creating Communities of Learners. This can inform projects that recognize the importance of community and/or that seek to use culture as an asset. The proposed study will engage three geographically distributed universities and several community partners. It will also provide university students and community leaders opportunities for work on instructional design, implementation, and research. The team will disseminate their findings and methods through multiple avenues to reach researchers, parents, leaders, curators, and educators in informal and K-12 settings.
This Research in Service to Practice award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Katherine Short-MeyersonPeter RilleroPeter MeyersonMargarita Jimenez-SilvaChristopher Edwards
This project responds to the Faculty Early Career Development Program (CAREER) solicitation (NSF 17-537) and is sponsored by the Advancing Informal STEM Learning program at the National Science Foundation. CAREER: Talking Science: Early STEM Identity Formation Through Everyday Science Talk (Talking Science) addresses the critical issue of the development of children's identification with science, technology, engineering and mathematics (STEM) fields and the limited knowledge about the development of STEM identity through conversations, particularly among very young children from underserved and underrepresented populations. Talking Science is based on the premise that individuals who develop STEM interests and identify with STEM at a young age tend to participate in STEM fields more so than individuals who develop these later in life. This study investigates how STEM-related conversations outside of school with friends and family during formative years (i.e., 7 - 12 years old) shape youths’ STEM identity later in life and their engagement in STEM. The goals of Talking Science are (1) To develop an understanding of the features and context of conversations held between children and their caregivers/teachers that support STEM identity development in both majority and Hispanic/Latine populations; and (2) To translate the research outcomes into informal STEM learning practices that positively contribute to young people's perceptions of STEM fields in their future.
To achieve its goals, this work addresses the following research questions: (1) What is the content, context, and structure of STEM-related conversations with friends and family that youth ages 7 - 12 participate in?; (2) How do the features of conversation (i.e., content, context, structure) relate to the development of youth's STEM interests, sense of recognition as STEM people, and self-identification with STEM?; (3) How do the cultural values and science talk experiences of Hispanic/Latine youth shape conversation features related to youth's STEM interests, sense of recognition as STEM people, and self-identification with STEM?; and (4) Does professional development for practitioners that focuses on encouraging youth to engage in STEM-related conversations with friends and family positively contribute to youth's STEM interest, sense of recognition, and self-identification with STEM? To address these questions, the study adopts a qualitative research approach that applies phenomenological strategies in research design, data collection, and analysis to allow for exploration of the meaning of lived experiences in social and cultural contexts. Participants include elementary-age youths (ages 7 - 12) and caregivers from socially, culturally, linguistically, and economically diverse backgrounds. To inform the development of interview protocols in terms of the kinds of childhood talk that leave a long-term impact on students, including the kinds of talk experiences remembered by students who choose or persist towards a STEM career in college, the project also recruits college students pursuing STEM degrees as participants. Data gathering and interpretation strategies include surveys and interviews. The outcomes of this research will constitute a theoretical framework and models that guide the development of both professionals and programmatic activities at informal learning institutions, particularly around scaffolding participation in STEM through family science talk.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.