Over a three-year period, the Lawrence Hall of Science will conduct research on the conversations of groups and families encountering an Augmented Reality (AR) experience in a museum environment. The research program will identify which design elements best facilitate conversations among groups of visitors, and determine if these conversations are both rich in scientific content and gender-balanced. The project will focus on four specific activities: understanding the learning associated with current AR activities, implementing design-based research to develop visitor conversation supports, designing and developing new AR programs with embedded conversation supports, and conducting iterative hypothesis-based research on how learning conversations happen in AR learning environments. The museum community will gain insights on design principles for supporting collaborative learning using AR. Project staff will disseminate results via conference workshops for museum professionals on designing AR to enhance family learning, and through publication in professional journals.
For an award-winning, public media YouTube science and nature series like KQED’s Deep Look, which delights its audiences by exploring unusual, tiny animals and plants up-close in ultra-high definition, how do you quantify and assess the value of different kinds of behind-the-scenes content when your original short videos are so fantastic at engaging your target audience?
Below is a summary of the key findings of the behind-the-scenes survey. Attached is the full report.
1. The measurable benefits of appending a fully produced behind-the-scenes video to a Deep Look episode appear to
Peer production projects involve people in many tasks, from editing articles to analyzing datasets. To facilitate mastery of these practices, projects offer a number of learning resources, ranging from project-defined FAQsto individually-oriented search tools and communal discussion boards. However, it is not clear which project resources best support participant learning, overall and at different stages of engagement. We draw on Sørensen's framework of forms of presence to distinguish three types of engagement with learning resources: authoritative, agent-centered and communal. We assigned
DATE:
TEAM MEMBERS:
Corey Brian JacksonCarsten OsterlundKevin CrowstonMahboobeh HarandiLaura Trouille
This NOVA multiplatform media initiative consisted of a 2-hour nationally broadcast PBS documentary, Polar Extremes; a 10-part original digital series, Antarctic Extremes; an interactive game, Polar Lab; accompanying polar-themed digital shorts, radio stories, text reporting, and social media content; a collection of educational resources on PBS LearningMedia; and community screening events and virtual field trips for science classrooms. Across multiple media platforms the project’s video content had nearly 13 million views.
The research explored the potential for informal STEM learning
This award takes an innovative approach to an ongoing, pervasive, and persistent societal issue: women are still drastically underrepresented in computing careers. This project targets middle school-aged girls because it is a time when many of them lose interest and confidence in pursuing technical education and computing careers. This project will design, develop, and deploy a one-week experience focused on middle school girls that targets this issue with a novel combination of teaching techniques and technology. The project will use wearable computing devices to support girls' social interactions as they learn computing and solve technical challenges together. The goals of the project are to raise interest, perceived competence, and involvement in the computational ability of girls. Additionally, the project aims to increase a sense of computational community for girls that makes pursuing computational skills more relevant to their identities and lives, and that helps continued participation in computing. The project will deploy a one-week experience four times per year with a socioeconomically diverse range of campers. The project will also develop a 'program in a box' kit that can be broadly used by others wishing to deliver a similar experience for girls.
The planned research will determine if a one-week experience that uses social wearable construction in the context of live-action role play can use the mediating process of computational community formation to positively impact middle school girls' engagement with and interest in computation. Computational community is defined as girls engaging together in the process of learning computation, trading resources and knowledge, and supporting growth. Research participants will include 100 6th to 9th-grade girls. At least 75% of the participants will be either low income, first-generation college-bound, or underrepresented in higher education. Students will be recruited through the longstanding partnerships with title one schools in the Salinas Valley, the Educational Partnership Center, and in the Pajaro Valley Unified School district, where 82% of the students are Hispanic/Latinx, 42% are English Learners, and 73% are eligible for free or reduced lunch. The research questions are: 1) Does the proposed experience increase girls' self-reported competence, self-efficacy, and interest in computational skills and careers? and 2) Will the proposed experience lead to activity-based evidence of learning and integration of computational skills at the group social level? The project will use a mixed-methods, design-based research approach which is an iterative design process to rapidly collect and analyze data, and regularly discuss the implications for practice with the design team. Data will be collected using observations, interviews, focus groups, surveys, and staff logs. Quantitative data will be analyzed using frequencies, means, and measures of dispersion will be applied to survey data from both time points. Pearson correlation coefficients will be used to describe the bivariate relationship between continuous factors. ANOVAs will assess whether there are significant differences in continuous measures across groups. Qualitative data will be analyzed using a constant comparison method.
This Innovations in Development award is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This Innovations in Development project addresses the need to broaden girls' participation in STEM studies and career pathways. While women make up 47% of the U.S. workforce, they hold only 28.3% of STEM jobs and only 1 in 10 employed engineers and scientists are minority women. Girls of low socioeconomic status start losing interest and confidence in STEM during middle school, and this decline often continues as girls get older. Multiple sociocultural barriers contribute to girl's loss of confidence including gender and ethnic stereotypes; lack of culturally responsive programming; limited exposure to women role models; and few or no hands-on STEM experiences. This project builds upon the success of SciGirls, the PBS television show and national outreach program, which provides professional development on research-based gender equitable and culturally responsive teaching strategies designed to engage girls in STEM. It is a collaboration between Twin Cities Public Television, the Cornell Lab of Ornithology, and the National Park Service. The project's goal is to create media-rich citizen science experiences for girls, particularly girls of color and/or from rural areas, which broaden their STEM participation, build positive STEM identities and increase girls' understanding of scientific concepts, while leveraging citizen science engagement at national parks. Project deliverables include 1) creating five new PBS SciGirls episodes that feature real girls working with women mentors in 16 National Parks, 2) producing five new role model videos of women National Park Service STEM professionals, nationally disseminated on multiple PBS platforms, 3) providing professional development for educators and role models. This project will increase access to STEM education for girls of color and/or from rural areas, inspiring and preparing them for future STEM workforce participation. It will build the capacity of educators and National Park Service women role models to create educational and professional programs that are welcoming to girls of varying racial, ethnic, socioeconomic, and geographic backgrounds. SciGirls' massive reach to diverse audiences via PBS broadcast and multiple PBS digital platforms will amplify public scientific literacy, particularly for 21st- century audiences that connect, learn and live online.
The research study conducted by the Cornell Lab of Ornithology will address these questions: 1) To what extent does the use of culturally responsive and gender equitable multimedia in citizen science programming affect girls' learning outcomes, and contribute to the development of positive STEM identity' 2) how will their experiencing citizen science in the parks influence girls' connection to nature? At the beginning of the project all participating girls (n=160) will complete a survey on their interest in science, efficacy for doing science, and knowledge of citizen science and project-specific subject matter. Researchers will use the suite of DEVISE instruments most of which have been validated for youth to measure these constructs. To measure connection to nature, researchers will use the Connection to Nature Index, a scale developed for children. Interviews with the girls will be used to obtain qualitative data to supplement the survey data. Pre-post data will be analyzed to determine the influence of the culturally responsive media and experiences on girls' STEM identities. Researchers will share findings with the project evaluator to triangulate data between educators' implementation of the strategies and girls' learning outcome providing a more holistic picture of the overall program.
This Innovations in Development award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
The SciGirls in Space Front End Evaluation included surveys with project advisors, girls and families about the nature and extent of partner program offerings to help inform production of media and use of media in outreach. Question 1: To what extent do advisors, girls and their family members find the girls and professionals featured in the (existing) episodes and role model videos to be effective role models? Question 2: To what extent do they find episode topics and stories relevant to their everyday lives?
We found that the learners seeking out resources to teach themselves to code were generally college educated women who were motived either by the desire to be able to read and understand the code written by hired developers or the desire to become developers themselves. The importance of a female-focused learning setting was mixed; while most women acknowledged a more comfortable atmosphere created by such a setting, very few cited that as a primary reason for joining the group.
All learner participants in this study persisted through the ten weeks of the Women’s Coaching and Learning
In 2016, ETR received a National Science Foundation grant to study, under Principal Investigator Louise Ann (“Lou Ann”) Lyon, PhD, a newly formed, real-world organization dedicated to helping women in the workforce learn to write computer code. This project formed a partnership between a research team with experience in computer science (CS) education and learning sciences research and a newly fashioned practitioner team focused on building a grassroots, informal, volunteer group created to help women help themselves and others learn to write computer code. This research-practitioner
This project aims to broaden participation in STEM education among underserved populations through innovative and inclusive approaches to technology education. The project is designed to enhance knowledge and comfort with technology and develop computational thinking among women who were formerly incarcerated and are now seeking to reenter the workforce or adjust to their lives outside the criminal justice system ("women in transition") in the Midwest. While women have become the fastest growing segment of the incarcerated population, prison education and reentry programs are not well prepared to respond to this influx. Women in transition are rarely exposed to STEM education and they are generally isolated from the digital world while in prison. Consequently, they face post-incarceration challenges in accessing and using rapidly changing digital technologies. Against this backdrop, this three-year technology education project will aim to help women in transition in Kansas and Missouri develop STEM skills relevant to job applications and post-incarceration adjustments. The project may serve as a template for building evidence-based workforce preparation efforts in informal settings, and the concurrent online peer networking and app development may also facilitate adaptation for and scaling to other regions and other similarly digitally disadvantaged populations. This project is funded by the AISL program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project design is informed by the research team's past experiences offering technology education to women in transition and other underserved populations in the Midwest. The design includes three interrelated aspects: (1) technology education, (2) web/mobile app development, and (3) original empirical research. The research team will offer hybrid (online and offline) technology training programs to 300 women in transition in Kansas and Missouri. Learners will attend weekly face-to-face technology classes at different levels (introductory, intermediate, and advanced) at public libraries. A member-only online site and an accompanying mobile application for online tutorials and virtual meet-ups will enhance exposure to different types of technologies. Starting with interest-based technology topics including online resume building, information verification, and identity protection, the team will introduce women to deeper STEM topics including elementary coding skills and computational thinking. Empirical research will examine how different modalities of offering technology education are associated with learning outcomes for women participating in the program and the association of increasing knowledge and skills in digital technologies with self-efficacy, perceived social support, employment, and reduced recidivism.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Hyunjin SeoHannah BrittonMegha RamaswamyBaek-Young ChoiSejun Song
Science television shows are an important source of informal learning and enrichment for preschool-aged children. However, one limitation of television programming is that it is largely a one-way, non-interactive medium. Research suggests that children learn best through active engagement with content, and that parents can make TV watching more interactive by co-viewing and talking with their children. However, many parents and other adults may lack the time or experience and comfort with science language and content to provide critcial just-in-time support for their children. This study seeks to take advantage of recent advances in artificial intelligence that now allow children to enjoyably interact with automated conversational agents. The research team will explore whether such conversational agents, embedded as an on-screen character in a science video, can meaningfully interact with children about the science content of the show by simulating the benefits of co-viewing with an adult. If successful, the project could lay the foundation for a new genre of science shows, helping transform video watching into more interactive and engaging learning experiences. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project will develop interactive videos incorporating a conversational agent in three 11-minute episodes of a future children's animated television program. The videos will enable children to speak with the main character of the show as the character solves everyday science mysteries, thus priming children to engage in observation, prediction, pattern finding, and problem solving through scaffolded conversation. This study will be carried out in two iterative cycles with the goal of developing and testing the embedded conversational function for each episode. In each cycle, the project team, which includes experts in children's TV production, as well as educational and HCI researchers will develop the storyboard and conversation prompts and follow-ups, create animated videos based on the revised script, and create a mobile application of the interactive video integrated with the conversational agent. Field testing with 10 children will be conducted to iteratively improve the embedded conversational function. In the pilot testing stage, a controlled study will be conducted with 30 children in each group (N=120): 1) watching the episode with the embedded conversational function; 2) watching the episode with a human partner carrying out the dialogue in the script rather than the virtual character; 3) watching the episode with pseudo-interaction, in which the animated character asks questions but does not attempt to understand or personally respond to children's answers; and 4) watching the episode with no dialogue. Data collected from the experiments will be used to examine whether and in what ways use of a conversational agent affects children's engagement, attention, communication strategies, perceptions, and science learning, and whether these effects vary by children's age, gender, socioeconomic status, language background, and oral language proficiency in English. The project will provide a comprehensive evaluation of the feasibility and potential of incorporating conversational agents into screen media to foster young children's STEM learning and engagement.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Mark WarschauerDaniel WhitesonSara DeWittAndres BustamanteAbby Jenkins
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by engaging in hands-on field experience, laboratory/project-based entrepreneurship tasks and mentorship experiences.
Twin Cities Public Television project on Gender Equitable Teaching Practices in Career and Technical Education Pathways for High School Girls is designed to help career and technical education educators and guidance counselors recruit and retain more high school girls from diverse backgrounds in science, technology, engineering and math (STEM) pathways, specifically in technology and engineering. The project's goals are: 1) To increase the number of high school girls, including ethnic minorities, recruited and retained in traditionally male -STEM pathways; 2) To enhance the teaching and coaching practices of Career and Technical Education educators, counselors and role models with gender equitable and culturally responsive strategies; 3) To research the impacts of strategies and role model experiences on girls' interest in STEM careers; 4) To evaluate the effectiveness of training in these strategies for educators, counselors and role models; and 5) To develop training that can easily be scaled up to reach a much larger audience. The research hypothesis is that girls will develop more positive STEM identities and interests when their educators employ research-based, gender-equitable and culturally responsive teaching practices enhanced with female STEM role models. Instructional modules and media-based online resources for Minnesota high school Career and Technical Education programs will be developed in the Twin Cities of Minneapolis and St. Paul and piloted in districts with strong community college and industry partnerships. Twin Cities Public Television will partner with STEM and gender equity researchers from St. Catherine University in St. Paul, the National Girls Collaborative, the University of Colorado-Boulder (CU-Boulder), the Minnesota Department of Education and the Minnesota State Colleges and Universities System.
The project will examine girls' personal experiences with equitable strategies embedded into classroom STEM content and complementary mentoring experiences, both live and video-based. It will explore how these experiences contribute to girls' STEM-related identity construction against gender-based stereotypes. It will also determine the extent girls' exposure to female STEM role models impact their Career and Technical Education studies and STEM career aspirations. The study will employ and examine short-form autobiographical videos created and shared by participating girls to gain insight into their STEM classroom and role model experiences. Empowering girls to respond to the ways their Career and Technical Education educators and guidance counselors guide them toward technology and engineering careers will provide a valuable perspective on educational practice and advance the STEM education field.