Skip to main content

Community Repository Search Results

resource evaluation Media and Technology
“Monkeying Around: Digital Media and Parent/Child Engagement Resources to Increase Preschool Computational Thinking” is a new project that uses animation, live-action videos, and hands-on activities to support joint engagement of children and caregivers around computational thinking concepts and practices. WGBH, a leading producer of educational STEM media, developed prototypes of videos and hands-on activities around the project’s computational thinking learning goals for young children. Education Development Center (EDC), WGBH’s research partner for the project, conducted a small formative
DATE:
TEAM MEMBERS: Heather Lavigne Leslie Cuellar
resource project Media and Technology
Video has become a key tool for scientific communication because it increases the outreach and impact of projects, furthers scientific research within and across fields of study, and offers an accessible medium to engage the public in the understanding of science. This project supports the expansion of an interactive, online STEM Videohall where hundreds of NSF-funded researchers share their work through brief video narratives and interactive discussion. While the Videohall is accessible year-round, periodic annual Showcase events are used to drive visitors to the site where they can engage with one another, the project investigators and trained facilitators. The Videohall is a multiplier of NSF's investments in individual projects because it allows STEM education researchers to become aware of, and learn from, related work that is funded across NSF programs and directorates, and other federal agencies. In 3-minute video narratives, investigators share ideas, resources, data, evidence of impact, strategies and challenges. The Videohall platform supports open access and is designed to foster communication in ways that scale beyond traditional formats such as academic conferences. Moreover, because the online STEM Videohall is open to the public, it allows STEM investigators to share their work with multiple stakeholder communities including K-12 educators and school leaders, informal educators and community organizations, the STEM industry, education policy makers and families. Finally, because each video narrative is accompanied by a facilitated online discussion thread, investigators have a unique and valuable mechanism for receiving feedback from these various stakeholder communities. The STEM Videohall project is funded by the Discovery Research K-12 program (DRK-12), which seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

This project brings together seven NSF-funded resource centers who work with their respective communities to encourage Principal Investigators to share video narratives of their work through annual NSF STEM Showcase events. Each annual Showcase event presents videos created by 150-230 projects; many of the projects are affiliated with one of the seven resource centers, but others are from projects across NSF directorates and beyond. During a one-week period, Principal Investigators, their project staff, as well as the public at large, are invited to engage in interactive discourse, providing queries, comments, and feedback. Participants also vote for favorite presentations through "Presenters' Choice," "Public Choice," and "Facilitators' Choice," processes. This participant voting system serves to increase engagement and enhances outreach of the event through social media. After the one-week Showcase event concludes, all of the videos along with the related discourse remain available to the public online, who continue to access the Showcase throughout the year. Based on prior pilot work, it is estimated that over the course of a year, over 30,000 visitors, from over 150 countries, will engage with each annual Showcase. Videos from annual showcase events will be shared, reused, and repurposed to create new products with new constituencies. The project includes technical development efforts to iteratively improve its interactive platform, outreach efforts before each annual Showcase event, facilitation of the week-long event, and intensive dissemination efforts. A research component examines the extent of participation on various constituencies, the benefit of participation to projects, and the success of the events in terms of dissemination nationally and internationally.
DATE: -
resource project Media and Technology
Purpose: This project team will develop and test Zaption, a mobile and desktop platform designed to support educators in effectively and efficiently utilizing video (e.g., from YouTube, Vimeo, or their own desktop) as an interactive teaching and learning object. Personalized learning devices (e.g., smartphones, tablets) populated with video content provide opportunities for students to access educationally-meaningful content anywhere and anytime. Yet, video has yet to realize its potential as a learning tool in or out of the classroom. One reason for this is that watching video can be a passive experience for students, whereas learning requires active engagement. A second reason is that even if students are actively engaged while watching a video, there is no easy way to elicit student responses to a video. And finally, there is no easy way to feed student responses to teachers as formative assessment data to guide subsequent instruction.

Project Activities: During Phase I, (completed in 2014), the team expanded a pre-existing prototype by building a mobile app to enable anytime use and increase its functionality for teachers. At the end of Phase I, pilot research with 150 students in 7 classrooms demonstrated that the prototype operated as intended, teachers were able to integrate the videos within instructional practice, and students found the mobile app helpful and engaging. In Phase II, the team will add additional components to the prototype and will develop content-specific modules for use in high school physics classes. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Zaption for supporting student's physics learning. The study will include 32 Grade 10 physics classrooms, half of whom will be randomly assigned to use Zaption and half of whom will follow business as usual procedures. Analyses will compare pre-and-post scores of student's physics learning.

Product: Zaption will be a mobile and web-based platform to support the use of any video (e.g., from YouTube, Vimeo, or their own desktop) as a teaching and learning tool. Zaption will include an authoring engine where users can find and select video clips and easily insert interactive elements such as questions, discussions, and annotations into the videos. Users will then publish videos directly on Zaption's website, or on any learning management system or classroom website. Students will be able to view videos as homework or in class, respond individually to the questions and prompts, and get feedback on their responses. Teachers will use Zaption Analytics to receive immediate and actionable data showing whether students actually watched and engaged with a video, and how students responded to the questions and prompts.
DATE: -
TEAM MEMBERS: Chris Walsh
resource evaluation Media and Technology
To explore the role and impact of The Innovation Lab at Youth Radio, Rockman et al, an independent research and evaluation organization, conducted an external evaluation of the project. With funding from the National Science Foundation’s Advancing Informal STEM Learning (AISL) program, the Innovation Lab sought to develop and research a scalable, evidence-informed theory of action to engage underrepresented youth in Science, Technology, Engineering, and Mathematics (STEM) learning through the collaborative creation and dissemination of original journalistic media, technology, and curriculum
DATE:
TEAM MEMBERS: Alex Gurn Kristin Bass Ellin O'Leary Elisabeth Soep Julia Hazer
resource project Media and Technology
Child Trends is a nonprofit organization focused on improving the lives of children and their families by conducting research and sharing the resulting knowledge with practitioners and the public. In this project, Child Trends will conduct research and development to launch a Child Trends News Service aimed at providing news reports that feature social science child-centric research. The resulting work is designed to improve outcomes for at-risk children, particularly Latinos, the largest and fastest-growing minority group among U.S. children. Working with a professional news syndication company, the Child Trends News Service will produce engaging reports for key news media outlets that feature the latest actionable social science research related to behaviors that help mitigate negative child outcomes associated with poverty, lack of education, violence, among other challenges. Child Trends will draw attention to the reports through social media and outreach to stakeholders. By airing these reports on local television news programs in English and Spanish, millions of people will have greater access to this information. This is early R&D work to demonstrate that local television stations will air these stories and to examine the audience impact—how does accessing this social science research through preferred media channels influence news audiences’ knowledge and attitudes toward specific social science research? The study will also delve deeper to better understand how news might, or might not, motivate behavioral change. The study will provide valuable lessons to the informal science education and the STEM communication science field.

The overarching aim of this project is to use commercial news to reach populations, especially Latinos, who have historically been underrepresented in science, technology, engineering and math (STEM) education and careers. The goals of the project are to:
* Leverage mass media news outlets to effectively communicate developments in social science research on child well-being and development to Latino audiences.
* Advance the field of informal STEM learning by exploring how the public interacts with actionable social science child research.
* Expand the reach and application of the news products through strategic collaborations with provider organizations serving at-risk Latino families; the child research and STEM fields; and other organizations working on Latino family issues.
Activities include the development and formative testing of the news service, the qualitative and quantitative testing of the news service's impact on audiences, and evaluation of the implementation of the project's components. The quantitative research, using a control group and treatment group, will work to establish preliminary evidence that the Child Trends News Service will result in changes in viewers' knowledge, attitudes, and intent to adopt behaviors related to child-centric social science research. The Child Trends' project team will be informed by an Advisory Board and Technical Working Group as well by working closely with Abriendo Puertas, the largest U.S. parenting education program for low-income Latino parents. Child Trends will partner with Ivanhoe Broadcast News to produce and distribute the materials. Group I&I Consultancy will evaluate the project. In year-two, Child Trends will produce a research brief on lessons learned and research outcome measures. The proposed research and development will be conducted over a two-year period; findings will inform ongoing service and additional research.

This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE: -
TEAM MEMBERS: Alicia Torres
resource project Media and Technology
Currently, many young people - especially girls and youth of color - lose confidence and interest in science, technology, engineering and math (STEM) pathways due to a perceived disconnect between their own identity and STEM fields. To address this challenge, Twin Cities PBS (TPT) is implementing SciGirls CONNECT2. This three-year Research in Service to Practice award examines how gender equitable and culturally responsive teaching strategies influence middle school girls' confidence, interest and motivation around STEM studies, and their choices around STEM careers. A set of research-based strategies, called the SciGirls Seven, are currently employed in SciGirls, an NSF-funded informal STEM educational outreach program serving 125+ educational partner organizations nationwide. The goal is to update and enrich the SciGirls Seven, providing educators with a critical, current, and more effective resource to motivate girls in STEM studies and careers. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.

Florida State University will conduct a formal research study investigating the hypothesis that STEM programs that use gender equitable and culturally responsive strategies contribute to girls' positive STEM identity development, including their sense of self-efficacy, persistence and aspirations around future STEM careers. This research will include a literature review and a study of girls' STEM identity creation. The mixed methods study will include quantitative and qualitative data collection and analysis measuring changes in students' STEM identity and teachers' confidence in STEM teaching. The quantitative data will come from the student, parent and teacher pre/post surveys. The qualitative research will be conducted via case studies at four sites and the qualitative data will include observations, focus groups and interviews. Girls at all partner sites will create videos that will allow the research team to gather additional insight. The independent firm Knight Williams, Inc. will conduct the project's external evaluation.

The project will work with a subset of 16 current SciGirls partners. These geographically diverse partners will reach youth in all-girls and co-ed informal STEM education programs in a variety of settings. More than half serve Hispanic or other minority populations. The updated strategies will be disseminated to the 2,500 educators within the SciGirls partner network and the 18,800 STEM education organizations of the National Girls Collaborative Project (NGCP) network. Dissemination of the strategies and literature review will focus on the informal STEM education field through publications and presentations, posts at PBS LearningMedia, a free online space reaching 1.5 million teachers and educators.
DATE: -
TEAM MEMBERS: Rita Karl Karen Peterson Roxanne Hughes Alicia Santiago
resource project Media and Technology
The goal of this three-year initiative is to expand the implementation of a currently active and proven climate education method delivered by TV weathercasters around the country. The work is a partnership of George Mason University, Yale University, Climate Central (a non-profit climate science research and media production organization), the American Meteorological Society, and NOAA and NASA. This project will include four activities: (1) recruiting 200 TV more weathercasters nationwide (currently just over 100 are participating); (2) providing participating weathercasters with professional development activities and training on use of Climate Matters materials to help them become confident and competent climate educators; (3) developing and distributing to participating weathercasters timely, localized, broadcast-ready graphics and science information, when possible tied to local weather and climatic events, to make it easy for them to educate their viewers about the local relationships between the climate and the weather; and (4) research and evaluation activities to improve the rate of use and effectiveness of Climate Matters materials by weathercasters over time and to study the effect on learning about climate by the public. Learning outcomes by the public will be evaluated using a quasi-experimental method with nationally representative surveys of the public, conducted twice per year over the course of the project. The guiding hypothesis is that there will be a dose-response relationship between the extent of TV weathercaster use of Climate Matters materials in a community (i.e., a media market) and change over time in viewers' understanding of the climate. The development of Climate Matters is based on theories of informal and experiential learning. The scaling up of the initiative applies methods derived from diffusion of innovation and social marketing theories.
DATE: -
TEAM MEMBERS: Ed Maibach Heidi Cullen
resource project Media and Technology
This media and research project will develop and study the use of new media, broadcast television, and social networks to introduce Citizen Science to a national audience, and motivate their direct involvement and participation. Project deliverables will include: four nationally-distributed public TV programs hosted by Waleed Abdalati, Director of CIREs at the University of Boulder and former NASA Chief Scientist; online videos for training and outreach of citizen science partners; digital engagement via social media; and a custom-designed application ('2nd screen app') that enables users to obtain additional informational content, share information, and connect with other viewers. The evaluation and research study will build new knowledge on how these deliverables can motivate the public to become citizen science participants. The investigators estimate the four television programs will reach approximately 80% of U.S. television households. In addition, videos and other content will be distributed through channels such as iTunes, Hulu, Netflix, and social media. Target audiences will include the general public, citizen science activists, and professional scientists. Underrepresented groups will be reached through special Google Hangouts, and professional societies such as SACNAS and AGU. The research components of the project will provide evidence on how traditional researchers respond to citizen science, and explore the deliverables' use as recruitment tools for citizen science projects and impacts on viewers' attitudes, behaviors, and skills related to citizen science. Data will be collected from multiple sources, including online surveys, in-person focus groups, and analyses of users' online postings. Retrospective surveys will be administered to explore changes in behavior regarding whether respondents have increased their interaction with professional scientists, or participated in citizen science initiatives. A quasi-experimental study will be conducted to assess the value added by the 2nd screen app.
DATE: -
TEAM MEMBERS: Geoffrey Haines-Stiles Waleed Abdalati Erna Akuginow Camellia Sanford-Dolly
resource project Media and Technology
This Michigan State University and University of Texas-Austin project will focus on making science communication more scientific. It will primarily use interview and survey research to improve societal understanding of how those involved in science communication, particularly scientists, think about science communication. The goal is to use this knowledge to help improve science communication training and recruiting with a focus on increasing the likelihood that scientists will adopt evidence-based communication strategies to increase public interest, engagement, and identification with science, technology, engineering, and math (STEM). A central underlying reason for the study is a mismatch between scientists' motivations and goals when interacting with public audiences and what research suggests would be the most positive and productive with public audiences. This study is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project will be conducted in three phases. The first is interviews with a wide range of science communication experts to assess priority research questions. These interviews will be followed by surveys with U.S.-based members of up to 10 different scientific societies representing a broad range of academic fields as well as a survey of science communication researchers. The survey will focus on three different public engagement modes, including face-to-face engagement, online engagement, and engagement via the news media. Consistent with the Theory of Planned Behavior, the surveys will assess scientists' attitudes about public engagement and specific public engagement goals, as well as perceptions of social norms (both descriptive and injunctive) and efficacy beliefs (both internal and external). These will be used as predictors of general and goal-specific engagement willingness, as well as reported past behavior, using multigroup modeling. Potential communication goals of interest include transferring knowledge, developing interest and excitement, building trust in scientists, demonstrating openness and a willingness to listen, shaping how people think about subjects (i.e. framing), and/or defending science. The final phase of the project will explore the potential to design experiments aimed at testing the impact that mention of specific goals has on communication training recruitment as well as the degree to which online content about various goals is attractive to scientists interested in developing their communication skills. The research is the most targeted and largest attempt to date to understand how scientists' views about the public and communication processes may shape science communication behavior.
DATE: -
TEAM MEMBERS: John Besley Anthony Dudo
resource project Media and Technology
This early-stage design and development, integrated media and research project will contribute important new understandings to the informal science learning literature by exploring science engagement on social media when integrated with broadcast television. It will help answer questions including: What does such engagement look like? Who participates? How and why does it happen? and What is the degree or depth of engagement? The project builds on the previous successful work by WGBH nationally distributing the television series NOVA scienceNOW and the research expertise of EDC. WGBH's NOVA scienceNOW program will collaborate with EDC to develop new metrics to understand how and why learners engage with science on social media. Deliverables will include six one-hour episodes of NOVA scienceNOW, short online videos, moderated online discussion events, and an online film festival. A new social Media Initiative will develop six live broadcast microblogging events, six post-broadcast online discussion events, daily social media updates, and an online film festival that will feature user generated videos. A range of STEM content in the videos and online posts will be framed around big science and engineering questions such as animal communication and survival systems, the biology of sleep, climate change, new technologies, energy, genetics, and natural disasters. The continued innovations and expansion of social media channels provides significant new opportunities for providing learner's access to high quality science content, researchers, and opportunities to participate in science. In the first phase of this work to deepen the evidence based understanding of how social media supports informal science engagement, NOVA and EDC will collaborate to develop new measurement instruments: (1) a Network Profile to quantitatively represent the size and activity of NOVA's social media network; (2) an Informal Science Engagement (ISE) index to measure the degree of engagement by coding and analyzing conversations and posts; (3) a Follower Profile to assess the degree of activity and the nature of the engagement; and (4) a Science Social Media Engagement survey instrument. They will then use these measures and data collection protocols to explore whether and how the initiative might influence science engagement. External expert reviewers with content and methodological expertise will review all aspects of the project at critical junctures. This project will contribute important new knowledge and research instruments and methods to better understand how the learning opportunities of social media channels can be realized most effectively. This has significant potential for broad and lasting benefits to society as well as advancing the informal science learning field.
DATE: -
TEAM MEMBERS: Paula Apsell
resource project Media and Technology
This full scale/collaborative research project targets underserved youth who will collaborate with STEM professionals to co-create community-relevant technology and media content creating a potentially scalable model. App Lab DIY is a collaboration between Youth Radio, the MIT Media Lab's Center for Mobile Learning, and the Mozilla Foundation. There are multiple and well integrated project strategies. Youth working with professionals will design, create, and disseminate original apps that engage users around community issues (e.g. urban wildlife mapping; Community DNA). They will work directly with the MIT Media Lab/Mobile Learning Center to improve App Inventor, an open-source tool. Youth participants will create media content for national on-air and online outlets including NPR. They will design digital badges to validate and document what they've learned creating media and apps. Curricular resources and tools for educators will be created and disseminated to advance STEM learning among underserved youth. Deliverables include: 1) creation of three apps (media-rich, STEM-relevant, community valued) that engage communities; 2) improvements in App Inventor, MIT's open-source tool that democratizes app develop for and by all; 3) radio stories that are integrated with the apps; 4) a multimedia toolkit for informal and formal educators to adapt in their programs; 5) a pilot badging system to mark mastery of skills associated with youth-driven media production and technological innovation; and 6) a research study focusing on the use of app development to drive STEM learning and engagement among underserved youth. Original research will be conducted by an embedded Scholar-in-Residence to inform and advance the field about driving STEM engagement via media/tech innovation. The Scholar-in-Residence will use Participant-Action-Research to inform and improve practice and study the big general questions about how the program works and why. The evaluation will leverage the instruments and methods established in Youth Radio's past NSF grants to study the impact on the youth's skills, knowledge and attitudes. They will also study impacts on two additional audiences: educators using the multimedia toolkit and users of the mobile apps. Approximate 1000 Youth Radio students will participate in the project over the three years through contributions to app development, radio production, and digital badges creation. The multimedia toolkit will be nationally disseminated to STEM educators with a large potential reach.
DATE: -
TEAM MEMBERS: Ellin O'Leary Elisabeth Soep Harold Alelson teresa chin Kristin Bass
resource project Media and Technology
This research and development project explores the mechanisms that initiate and support innovation in early childhood education, especially in combining informal learning via public media and technology with teacher and family interactions to maximize children's math learning. Deliverables include 27 episodes of Peg+Cat, an animated math adventure series on PBS, 8 related online games and apps, summer math institutes and school-year training for preschool/Head Start teachers, and complementary activities and resources to support parent's knowledge and practice and student's engagement, interest, and learning of foundational math concepts. The research agenda will test several hypotheses regarding the strategies to extend teacher's math content knowledge and pedagogy and parent/ caregiver's understanding and valuing of math. A key question will focus on how coupled learning opportunities (professional development for teachers, transmedia, and support for families) enable and sustain children's engagement and learning in math. Formative evaluation of the media components will use focus groups of 3-5 year olds to assure develerables are engaging and accessible. The summative evaluation by Rockman et al will focus on how well the project met its overall goals including the project implementation, and impacts on Head Start teachers, parents/caregivers, and preschoolers. The project's transmedia deliverables will reach millions of preschoolers through daily PBS broadcasts and online games and apps. Fifty Head Start teachers will participate in the two-year professional development program and will be using new content knowledge and pedagogy to teach 550 Head Start children in southwest Pennsylvania and engage their parents/caregivers. The Head Start infrastructure will provide further dissemination of the project's findings and resources.
DATE: -
TEAM MEMBERS: Hedda Sharapan Chris Rodgick Cynthia Tananis Nancy Bunt Mallary Swartz Camellia Sanford-Dolly