Skip to main content

Community Repository Search Results

resource evaluation Media and Technology
Ruff Family Science is an exploratory project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. More specifically, the project is undertaking a research and design process to create prototype
DATE:
TEAM MEMBERS: Mary Haggerty Heather Lavigne Jessica Andrews
resource project Media and Technology
Worldwide, four million people participate in geocaching--a game of discovering hidden treasures with GPS-enabled devices (including smart phones). Geocachers span all ages and tend to be interested in technology and the outdoors. To share information about the Montana Climate Assessment (MCA), an NSF-funded scientific report, Montana State University created a custom trackable geocaching coin featuring the MCA Website and logo. We then recruited volunteers to hide one coin in each of Montana’s 56 counties. Volunteer geocachers enthusiastically adopted all 56 counties, wrote blogs and social media posts about the coins, and engaged local Scout troops and schools. Other geocachers then found and circulated the coins while learning about Montana’s climate. One coin has traveled nearly 4,000 miles; several have visited other states and Canada. 95% of the volunteers said the project made them feel more connected to university research, and they told an average of seven other people about the project. Nearly all of the participants were unfamiliar with the Montana Climate Assessment prior to participating. The geocaching educational outreach project included several partnerships, including with Geocaching Headquarters in Seattle (a.k.a. “Groundspeak”); Cache Advance, Inc., an environmentally friendly outdoor gear company; and Gallatin Valley Geocachers. An advisory board of geocachers helped launch the project.
DATE:
TEAM MEMBERS: Suzi Taylor Ray Callaway M.J. Nehasil Cathy Whitlock
resource project Media and Technology
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The goal of this project is to make 21st century quantum science comprehensible and engaging to non-expert informal adult learners. This project has strong potential to add new knowledge about the public's perception and understanding of quantum physics. This scientific content is often difficult for informal audiences to grasp, and there are relatively few accessible learning resources for a non- professional audience. The development of this online, interactive resource with short animations, graphics, and simulations has strong potential to fill this gap. It will develop a visually driven online resource to engage non-expert audiences in understanding the basics of quantum physics. The web design will be modular, incorporating many multimedia elements and the structure will be flexible allowing for future expansion. All content would be freely available for educational use. There is potential for extensive reach and use of the resources by informal adult learners online as well as learners in museums, science centers, and schools. Project partners are the Joint Quantum Institute at the University of Maryland and the National Institute of Standards and Technology, College Park. An independent evaluation of the project will add new knowledge about informal learners' perceptions and/or knowledge about quantum science and technology. An initial needs assessment via focus groups with the general public will be designed to find out more about what they already know about quantum physics topics and terminology, as well as what they want to know and what formats they prefer (games, simulations, podcasts, etc.). In person user testing will be used with early versions of the project online resource using a structured think-aloud protocol. Later in year 1 and 2, online focus groups with the general public will be conducted to learn what they find engaging and what they learned from the content. Iterative feedback from participants during the formative stage will guide the development of the content and format of the online resources. The Summative Evaluation will gather data using a retrospective post-survey embedded with a pop-up link on the Atlas followed by interviews with a subset of online users. Google Analytics will be used to determine the breadth and depth of their online navigation, what resources they download, and what websites they visit afterward. A post-only survey of undergraduate and graduate students who participated in resource development will focus on changes in students' confidence around their science communication skills and level of quantum physics understanding.
DATE: -
TEAM MEMBERS: Emily Edwards Curtis Suplee
resource research Media and Technology
A majority of Americans rely on general outlets for science news but more say specialty sources get the facts right about science. This report presents findings from a survey conducted among a nationally representative sample of 4000+ adults from May 30-June 12, 2017. The survey asked about a range of issues from how the public encounters science news and assesses what and who to trust to other ways that people engage with science information in everyday life, including participation in citizen science research projects, hobbies, and consumption of entertainment programming built around
DATE:
TEAM MEMBERS: Cary Funk Amy Mitchell Tom Caiazza
resource evaluation Media and Technology
As part of the National Science Foundation (NSF) funding for the In Defense of Food project directed by Kikim Media, the independent evaluation firm Knight Williams Inc.1 conducted a summative evaluation of the project’s key deliverables, which included: a PBS television broadcast program, an outreach effort, and an educational curriculum. This report (Study 2 of 3) focuses on the outreach effort.
DATE:
TEAM MEMBERS: Valerie Knight-Williams Divan Williams Rachael Teel Dobrowolski Gabriel Simmons Michael Schwarz
resource project Media and Technology
This is an Early-concept Grant for Exploratory Research supporting research in Smart and Connected Communities. The research supported by the award is collaborative with research at the University of Colorado. The researchers are studying the use of technologies to enable communities to connect youth and youth organizations to effectively support diverse learning pathways for all students. These communities, the youth, the youth organizations, formal and informal education organizations, and civic organizations form a learning ecology. The DePaul University researchers will design and implement a smart community infrastructure in the City of Chicago to track real-time student participation in community STEM activities and to develop mobile applications for both students and adults. The smart community infrastructure will bring together information from a variety of sources that affect students' participation in community activities. These include geographic information (e.g., where the student lives, where the activities take place, the student transportation options, the school the student attends), student related information (e.g., the education and experience background of the student, the economic status of the student, students' schedules), and activity information (e.g., location of activity, requirements for participation). The University of Colorado researchers will take the lead on analyzing these data in terms of a community learning ecologies framework and will explore computational approaches (i.e., recommender systems, visualizations of learning opportunities) to improve youth exploration and uptake of interests and programs. These smart technologies are then used to reduce the friction in the learning connection infrastructure (called L3 for informal, formal, and virtual learning) to enable the student to access opportunities for participation in STEM activities that are most feasible and most appropriate for the student. Such a flexible computational approach is needed to support the necessary diversity of potential recommendations: new interests for youth to explore; specific programs based on interests, friends' activities, or geographic accessibility; or programs needed to "level-up" (develop deeper skills) and complete skills to enhance youths' learning portfolios. Although this information was always available, it was never integrated so it could be used to serve the community of both learners and the providers and to provide measurable student learning and participation outcomes. The learning ecologies theoretical framework and supporting computational methods are a contribution to the state of the art in studying afterschool learning opportunities. While the concept of learning ecologies is not new, to date, no one has offered such a systematic and theoretically-grounded portfolio of measures for characterizing the health and resilience of STEM learning ecologies at multiple scales. The theoretical frameworks and concepts draw together multiple research and application domains: computer science, sociology of education, complexity science, and urban planning. The L3 Connects infrastructure itself represents an unprecedented opportunities for conducting "living lab" experiments to improve stakeholder experience of linking providers to a single network and linking youth to more expanded and varied opportunities. The University of Colorado team will employ three methods: mapping, modeling, and linking youth to STEM learning opportunities in school and out of school settings in a large urban city (Chicago). The recommender system will be embedded into youth and parent facing mobile apps, enabling the team to characterize the degree to which content-based, collaborative filtering, or constraint based recommendations influence youth actions. The project will result in two measurable outcomes of importance to key L3 stakeholder groups: a 10% increase in the number of providers (programs that are part of the infrastructure) in target neighborhoods and a 20% increase in the number of youth participating in programs.
DATE: -
TEAM MEMBERS: Nichole Pinkard
resource project Media and Technology
This is an Early-concept Grant for Exploratory Research supporting research in Smart and Connected Communities. The research supported by the award is collaborative with research at DePaul University. The researchers are studying the use of technologies to enable communities to connect youth and youth organizations to effectively support diverse learning pathways for all students. These communities, the youth, the youth organizations, formal and informal education organizations, and civic organizations form a learning ecology. The DePaul University researchers will design and implement a smart community infrastructure in the City of Chicago to track real-time student participation in community STEM activities and to develop mobile applications for both students and adults. The smart community infrastructure will bring together information from a variety of sources that affect students' participation in community activities. These include geographic information (e.g., where the student lives, where the activities take place, the student transportation options, the school the student attends), student related information (e.g., the education and experience background of the student, the economic status of the student, students' schedules), and activity information (e.g., location of activity, requirements for participation). The University of Colorado researchers will take the lead on analyzing these data in terms of a community learning ecologies framework and will explore computational approaches (i.e., recommender systems, visualizations of learning opportunities) to improve youth exploration and uptake of interests and programs. These smart technologies are then used to reduce the friction in the learning connection infrastructure (called L3 for informal, formal, and virtual learning) to enable the student to access opportunities for participation in STEM activities that are most feasible and most appropriate for the student. Such a flexible computational approach is needed to support the necessary diversity of potential recommendations: new interests for youth to explore; specific programs based on interests, friends' activities, or geographic accessibility; or programs needed to "level-up" (develop deeper skills) and complete skills to enhance youths' learning portfolios. Although this information was always available, it was never integrated so it could be used to serve the community of both learners and the providers and to provide measurable student learning and participation outcomes. The learning ecologies theoretical framework and supporting computational methods are a contribution to the state of the art in studying afterschool learning opportunities. While the concept of learning ecologies is not new, to date, no one has offered such a systematic and theoretically-grounded portfolio of measures for characterizing the health and resilience of STEM learning ecologies at multiple scales. The theoretical frameworks and concepts draw together multiple research and application domains: computer science, sociology of education, complexity science, and urban planning. The L3 Connects infrastructure itself represents an unprecedented opportunities for conducting "living lab" experiments to improve stakeholder experience of linking providers to a single network and linking youth to more expanded and varied opportunities. The University of Colorado team will employ three methods: mapping, modeling, and linking youth to STEM learning opportunities in school and out of school settings in a large urban city (Chicago). The recommender system will be embedded into youth and parent facing mobile apps, enabling the team to characterize the degree to which content-based, collaborative filtering, or constraint based recommendations influence youth actions. The project will result in two measurable outcomes of importance to key L3 stakeholder groups: a 10% increase in the number of providers (programs that are part of the infrastructure) in target neighborhoods and a 20% increase in the number of youth participating in programs.
DATE: -
TEAM MEMBERS: Bill Penuel Tamara Sumner Nichole Pinkard
resource project Media and Technology
This Research in Service to Practice project, a collaboration of Pepperdine University and the New York Hall of Science, will establish a network of STEM-related Media Making Clubs comprised of after-school students aged 12 - 19 and teachers in the U.S. and in three other countries: Kenya, Namibia and Finland. The media produced by the students may include a range of formats such as videos, short subject films, games, computer programs and specialized applications like interactive books. The content of the media produced by the students will focus on the illustration and teaching of STEM topics, where the shared media is intended to help other students become enthused about and learn the science. This proposal builds on the principal investigator's previous work on localized media clubs by now creating an international network in which after-school students and teachers will collaborate at a distance with other clubs. The central research questions for the project pertain to three themes at the intersection of learning, culture and collaboration: the impact of participatory teaching, virtual networks, and intercultural, global competence. The research will combine qualitative, cross-cultural and big data methods. Critical to the innovation of the project, the research team will also develop a network assessment tool, adapting epistemic network analysis methods to the needs of this initiative. This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE: -
TEAM MEMBERS: Eric Hamilton Katherine McMillan Priya Mohabir
resource project Media and Technology
This project formed a partnership between a research team with experience in computer science (CS) education and learning sciences research and a newly fashioned practitioner team focused on building a grassroots, informal, volunteer group created to help women help themselves and others learn to write computer code. This research-practitioner partnership had a two-pronged focus, first on improving the program offered to learners through making adjustments based on research findings, and second on investigating the phenomenon of how women in the workforce informally learn CS skills that enable them to rewrite their career paths to contribute to what we know from research. The context of the study was situated in the virtual community that has formed around the phenomenally successful Salesforce Customer Relationship Management software platform.

This Exploratory Pathways project aimed to fill a gap in the research; we know little about the phenomenon of adult women in the workforce who are patching together resources to learn CS skills with a goal of job enhancement or job change. This project took an ethnographic approach to studying the informal learning (both through online, written resources and through sharing of knowledge with others) of the women involved in a 10-week, virtual Women’s Coaching and Learning group. The organization of this group consisted of learners—novice coders in the Apex language that is used on the Salesforce software platform, of coaches—more knowledgeable coders, and of a steering committee that ran the group and created the informal curriculum followed in the 10-week course.

Our overarching research question in this study was: In what ways are informal CS learning opportunities being used and created by adult women, what are their experiences with those opportunities, and how does this suggest ways to enhance those opportunities in the future to increase effectiveness in broadening access to and engagement in informal CS learning experiences for women?

We broke the question down into a number of sub questions, including:


Sociocultural context: What past gendered interactions do women report that discouraged (or encouraged) them from learning to code? What do interactions look like in female-only coaching and learning groups? In what ways does a coaching and learning group support persistence? What social barriers and supports outside the group affect persistence?
Personal context: What are the characteristics and backgrounds of female administrators who seek out resources to teach themselves to code? What are the motivations for these women to teach themselves to code? What motivates them to seek out and join all-women coding groups?
Physical context: How are women learning to code both through written resources and in virtual, informal coaching and learning classes? What are the conceptual barriers and supports that they encounter, and what works for women in these classes to overcome barriers? What conceptual barriers and supports affect persistence?
Persistence and identity: In what ways does participating in a learning group with female coaching motivate (or not) women to persist in learning to code? How do their goals or reasons for learning to code change through their participation? How does their identity as a “coder” change or shift as they participate?


Our findings for these subquestions are summarized in the “project products” linked to below.
DATE: -
TEAM MEMBERS: Louise Ann ("Lou Ann") Lyon Jill Denner
resource project Websites, Mobile Apps, and Online Media
The Baltimore Symphony Orchestra (BSO), in collaboration with the Psychology Department of the University of Maryland Baltimore County (UMBC) and Octava (a technology company), are conducting a pilot exploratory research project to assess the effectiveness of delivering informal science learning (ISL) to adult audiences through live music in a concert hall environment. The first half of the study is being timed to coincide with the 2016 annual meeting in Baltimore of the League of American Orchestras. Audiences will be introduced to the core idea that symmetry is a central concept both in science and in music, and they will experience these ideas via the orchestral music of pieces such as Aaron Copland's Appalachian Spring and Beethoven's Symphony. No. 5. The project goals are: to test whether and the extent to which informal STEM learning can occur among adults (ages 18+) during live orchestral performances and how the science content may enhance the audience experience; and to develop assessment tools for measuring audience learning and retention of scientific concepts delivered in connection with live musical performances both through interactive technology and through traditional program notes. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.

The pilot study will investigate the interaction of key variables related to the audience composition, the learning formats (use of app technology, program notes, or not), and the science concepts. The tablet application technology, under continued development by Octava, presents unobtrusive program notes that act as a concert companion in real time as a concert proceeds. The mixed methods research methodology will produce quantitative and qualitative data using pre- and post-test instruments and focus group interviews. A follow-up questionnaire will be sent to participants six weeks after the performances to ascertain whether what was learned was retained over a period of time. Dissemination of project findings will be to professionals in science, science education and music fields.
DATE: -
TEAM MEMBERS: Jessica Abel Linda Baker Tonya Robles Carol Bogash
resource project Media and Technology
The National Association of Hispanic Nurses (NAHN), in association with the Hispanic Communications Network (HCN), proposes to address the shortage of bilingual professionals in all health fields by recruiting and interviewing bilingual role models and arranging to broadcast those interviews nationwide. Leveraging HCN’s nationally broadcast health education radio shows, whose cumulative audiences are larger than
NPR’s “All Things Considered,” this project has the potential to reach one out of every three US Hispanics during its first five years. This media campaign is intended to inspire Hispanic parents to encourage their children to study science and aspire to careers in the biomedical professions. It is also intended to inspire and empower Spanish-speaking adults from all walks of life to consider careers in the health professions. All broadcasts will tie to NAHN’s interactive website so that students and adults interested in changing careers can find mentors and educational resources. NAHN will also use Youtube, Facebook, mobile phone applications, and other new and popular social media technologies to reach a broad cross-section of English speaking youth and young adults. In addition to the national media outputs, attendees at NAHN’s annual conferences will have the opportunity to receive training in public speaking and media relations so they can more effectively use local media in their own communities to address health disparities and promote careers in the biomedical and health professions. NAHN will develop a standardized, bilingual Toolkit for public presentations. The Toolkit will include a PowerPoint presentation embedded with video containing gender and other- stereotype-busting role model interviews with Hispanic nurses; links to an online database of volunteer mentors; and a bilingual terminology packet that will aid nurses in creating linguistic and cognitive bridges between audience and professional knowledge bases. We expect that the refined Toolkit will empower nurses and other health professionals to become more effective public health educators and career role models during their presentations at community health events, career fairs, achievement clubs, and school assemblies. An Advisory Committee of other health organizations, professionals, and advocates will recommend Role Models and provide periodic feedback. Bilingual independent evaluators associated with the UC Berkeley School of Public Health will conduct qualitative and quantitative formative, iterative, and summative evaluations throughout the project. Their recommendations and findings will be incorporated into the project design and deliverables and shared with relevant fields.
DATE: -
TEAM MEMBERS: Angie Millan Jim Booth
resource project Media and Technology
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. This project will study why (or why not) young career adults, aged 18-35 engage with the PBS NewsHour science content via broadcast and/or online avenues to advance their STEM knowledge and skills. This age group has shifted away from viewing traditional broadcast news media and increasingly looks to social media channels for science content. Multiple layers of STEM digital content delivered across multiple platforms (including social media) will be used to identify the attributes that engage and motivate these 18-35 year olds. Deliverables include 12 broadcast segments each year with STEM research coverage and a range of transmedia efforts (e.g. additional formats distributed via Instagram, Vine, YouTube, etc.) for testing with the target audience. A complementary component of the project will be an apprenticeship program in which each year five college age students from journalism schools join the professional reporters at the NewsHour to produce STEM content using new and innovative strategies engage to 18-35 year olds. The PBS NewsHour broadcast is currently viewed by 1.4 million adults each night and the website has 2.6 million unique visitors each month. The research will attempt to define the learning ecologies of 18-35 year olds using psychographic profiles and case studies to illustrate the range of science learners including those in underrepresented groups. The first research component uses a quantitative approach to assess the reaction of the early career adults to the 12 STEM broadcast segments in their original form and after repackaging for social media. A control group audience will watch the original broadcast of each STEM segment and respond to an online questionnaire that will establish how viewers use and/or pass on STEM content and to whom. The test audience will view the content that has been repackaged and presented on a different media platform responding to the same online questionnaire and allowing comparisons of the two groups. The second research component will focus on the college-age journalism apprentices and use participatory action research. The apprentices will collect data about their experiences and reflect on their contributions to STEM reporting. The third research component will be an ethnographic study of the post-production and editorial teams at the PBS NewsHour using focus groups to elicit feedback and evaluate their metacognitive thinking about how to produce stories for early career adults. Data will be collected and analyzed from three groups: early career adults 18-35 years of age; journalism apprentices; and the PBS NewsHour editorial teams. Overall the research will provide new knowledge about producing and distributing digital STEM media that engages and impacts early career adults.
DATE: -