Summary brief describing summative evaluation associated with the MarcellusByDesign component of Marcellus Matters: EASE. Marcellus Matters: Engaging Adults in Science and Energy (EASE) was a program of Penn State University’s Marcellus Center for Outreach and Research (MCOR), in collaboration with other experts across the university. The first year of program activities took place in 2012, and the project continued through September 2016. EASE was a multidisciplinary initiative that provided adults in rural Pennsylvania with opportunities to increase their knowledge of science and energy
Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of a program developed to immerse adult learners in the processes of scientific research by teaching participants to locate and report orphan and abandoned natural gas wells.
Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of a ten-week adult/community education program about topics related to natural gas development.
Because of the siloed nature of formal educational curricula, students who opt out of STEM coursework, for whatever reason, lose the opportunity to engage with the domain of science almost entirely, thereby closing the door to the STEM workforce pipeline. This disproportionately impacts students of color and women. This project advances an alliance that consists of a consortium of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and local businesses. The project built around this alliance will leverage interdisciplinary spaces in the curriculum, particularly the humanities and social sciences, across academic levels, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life. The PIs establish a physical Community STEM Center as an anchoring institution for STEM engagement. This Center will be situated within the community that the alliance serves, bringing STEM opportunities and engagement to students instead of asking them to come where STEM education is currently provided. The activities enacted through the Community STEM Center will focus on enduring problems experienced by the communities, where students, community residents, teachers, and experts from higher education, industry and other community-based entities can come together to work on understanding them and developing evidenced centered advocacy as a means for addressing them. To facilitate the work at the Community STEM Center, the project creates a Community Ambassadors Program (CAP), leveraging participation across alliance members in partnership with the community. This Design and Development Launch Pilot will cultivate the necessary knowledgebase to develop a scalable model for implementation across diverse urban communities.
Technical Summary
This Design and Development Launch Pilot focuses on shifting the narrative of STEM education away from a solitary focus on formalized educational experiences and targets STEM content. This project develops and facilitates a parallel set of activities designed to engage under-represented students in learning how and why STEM is relevant to their lives, and approached through new and non-traditional educational dimensions. The five main objectives of this proposed pilot are to: (1) Develop a pilot alliance of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and industry;(2)Establish a physical Community STEM Advocacy Center as an anchoring institution for change embedded within the community that the pilot alliance serves; (3) Leverage interdisciplinary spaces in curricula, across academic levels, particularly the humanities and social sciences, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life; (4) Create a Community Ambassadors Program (CAP), leveraging participation across higher education pilot alliance members in partnership with the community; and (5)Conduct an evaluation of project initiatives and research regarding the usability and feasibility of a systemic approach to developing community-based, interdisciplinary pathways to broaden STEM participation pathways. Efforts to examine the impact of this community-based, interdisciplinary approach concentrates on the proximal outcomes related to STEM interest, self-efficacy and identity. Data will be collected in pre/post format across our three constituent samples: 1) Community STEM Advocacy Center participants; 2) k-12 students; and, 3) postsecondary students. Analysis of data will be conducted through MANCOVAs to account for potential co-variation among construct scores. Qualitative data will also be collected to contextualize findings and enable the development of a rich case study. At least two observations will be conducted in the Community STEM Advocacy Center and the two classroom implementations to document engagement, participant interactions and level of STEM content.
DATE:
-
TEAM MEMBERS:
Kimberly LawlessDonald WinkLudwig Carlos NitscheAixa AlfonsoJeremiah Abiade
Child Trends is a nonprofit organization focused on improving the lives of children and their families by conducting research and sharing the resulting knowledge with practitioners and the public. In this project, Child Trends will conduct research and development to launch a Child Trends News Service aimed at providing news reports that feature social science child-centric research. The resulting work is designed to improve outcomes for at-risk children, particularly Latinos, the largest and fastest-growing minority group among U.S. children. Working with a professional news syndication company, the Child Trends News Service will produce engaging reports for key news media outlets that feature the latest actionable social science research related to behaviors that help mitigate negative child outcomes associated with poverty, lack of education, violence, among other challenges. Child Trends will draw attention to the reports through social media and outreach to stakeholders. By airing these reports on local television news programs in English and Spanish, millions of people will have greater access to this information. This is early R&D work to demonstrate that local television stations will air these stories and to examine the audience impact—how does accessing this social science research through preferred media channels influence news audiences’ knowledge and attitudes toward specific social science research? The study will also delve deeper to better understand how news might, or might not, motivate behavioral change. The study will provide valuable lessons to the informal science education and the STEM communication science field.
The overarching aim of this project is to use commercial news to reach populations, especially Latinos, who have historically been underrepresented in science, technology, engineering and math (STEM) education and careers. The goals of the project are to:
* Leverage mass media news outlets to effectively communicate developments in social science research on child well-being and development to Latino audiences.
* Advance the field of informal STEM learning by exploring how the public interacts with actionable social science child research.
* Expand the reach and application of the news products through strategic collaborations with provider organizations serving at-risk Latino families; the child research and STEM fields; and other organizations working on Latino family issues.
Activities include the development and formative testing of the news service, the qualitative and quantitative testing of the news service's impact on audiences, and evaluation of the implementation of the project's components. The quantitative research, using a control group and treatment group, will work to establish preliminary evidence that the Child Trends News Service will result in changes in viewers' knowledge, attitudes, and intent to adopt behaviors related to child-centric social science research. The Child Trends' project team will be informed by an Advisory Board and Technical Working Group as well by working closely with Abriendo Puertas, the largest U.S. parenting education program for low-income Latino parents. Child Trends will partner with Ivanhoe Broadcast News to produce and distribute the materials. Group I&I Consultancy will evaluate the project. In year-two, Child Trends will produce a research brief on lessons learned and research outcome measures. The proposed research and development will be conducted over a two-year period; findings will inform ongoing service and additional research.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
In collaboration with the libraries of Oklahoma State University (OSU) and Mount Holyoke College, the American Library Association proposes a traveling exhibit and public programs for 40 libraries examining the history and legacy of the Dust Bowl. The project spotlights Ken Burns' film "The Dust Bowl," and brings to public view two little known Dust Bowl archives: online oral history interviews of Dust Bowl survivors at OSU, and letters and essays of Caroline Henderson, a Mount Holyoke alumna who farmed in Oklahoma throughout the Dust Bowl. Libraries will display the exhibit for 6 weeks and present at least 3 public humanities programs from a list provided. The project humanities themes include the interaction between humans and nature; the different ways human beings respond to adversity; and how people living in the Dust Bowl tried to understand their social, economic, and ecological environment.
The National Girls Collaborative Project (NGCP) seeks to maximize access to shared resources within projects and with public and private sector organizations and institutions interested in expanding girls’ participation in science, technology, engineering, and mathematics (STEM). Funded primarily by the National Science Foundation, the NGCP is a robust national network of more than 3,000 girl-serving STEM organizations. Currently, 31 Collaboratives, serving 40 states, facilitate collaboration between more than 12,800 organizations who serve more than 7.7 million girls and 4.4 million boys. The NGCP occupies a unique role in the STEM community because it facilitates collaboration with all stakeholders who benefit from increasing diversity and engagement of women in STEM. These stakeholders form Regional Collaboratives, who are connected to local girl-serving STEM programs. Regional Collaboratives are led by leadership teams and advisory boards with representatives from K-12 education, higher education, community-based organizations, professional organizations, and industry. NGCP strengthens the capacity of girl-serving STEM projects by facilitating collaboration among programs and organizations and by sharing promising practice research, program models, and products through webinars, collaboration training, and institutes. This is accomplished through a tested comprehensive program of change that uses collaboration to expand and strengthen STEM-related opportunities for girls and women. In each replication state, the NGCP model creates a network of professionals, researchers, and practitioners, facilitating collaboration within this network, and delivering high-quality research-based professional development. Participating programs can also receive mini-grant funding to develop collaborative STEM-focused projects. To date, over 27,000 participants have been served in 241 mini-grant projects, and over 17,000 practitioners have been served through in-person events and webinars. The NGCP’s collaborative model changes the way practitioners and educators work to advance girls’ participation in STEM. It facilitates the development of practitioners in their knowledge of good gender equitable educational practices, awareness of the role of K-12 education in STEM workforce development, and mutual support of peers locally and across the United States.
The National Federation of the Blind (NFB), with six science centers across the U.S., will develop, implement, and evaluate the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through partnerships and companion research, the NCBYS will lead to greater capacity to engage the blind in informal STEM learning. The NCBYS confronts a critical area of need in STEM education, and a priority for the AISL program: the underrepresentation of people with disabilities in STEM. Educators are often unaware of methods to deliver STEM concepts to blind students, and students do not have the experience with which to advocate for accommodations. Many parents of blind students are ill-equipped to provide support or request accessible STEM adaptations. The NCBYS will expose blind youth to non-visual methods that facilitate their involvement in STEM; introduce science centers to additional non-visual methods that facilitate the involvement of the blind in their exhibits; educate parents as to their students' ability to be independent both inside and outside the STEM classroom; provide preservice teachers of blind students with hands-on experience with blind students in STEM; and conduct research to inform a field that is lacking in published material. The NCBYS will a) conduct six regional, two-day science programs for a total of 180 blind youth, one day taking place at a local science center; b) conduct concurrent onsite parent training sessions; c) incorporate preservice teachers of blind students in hands-on activities; and d) perform separate, week-long, advanced-study residential programs for 60 blind high school juniors and seniors focused on the design process and preparation for post-secondary STEM education. The NCBYS will advance knowledge and understanding in informal settings, particularly as they pertain to the underrepresented disability demographic; but it is also expected that benefits realized from the program will translate to formal arenas. The proposed team represents the varied fields that the project seeks to inform, and holds expertise in blindness education, STEM education, museum education, parent outreach, teacher training, disability research, and project management. The initiative is a unique opportunity for science centers and the disability population to collaborate for mutual benefit, with lasting implications in informal STEM delivery, parent engagement, and teacher training. It is also an innovative approach to inspiring problem-solving skills in blind high school students through the design process. A panel of experts in various STEM fields will inform content development. NCBYS advances the discovery and understanding of STEM learning for blind students by integrating significant research alongside interactive programs. The audience includes students and those responsible for delivering STEM content and educational services to blind students. For students, the program will demonstrate their ability to interface with science center activities. Students will also gain mentoring experience through activities paired with younger blind students. Parents and teachers of blind students, as well as science center personnel, will gain understanding in the experiences of the blind in STEM, and steps to facilitate their complete involvement. Older students will pursue design inquiries into STEM at a more advanced level, processes that would be explored in post-secondary pursuits. By engaging these groups, the NCBYS will build infrastructure in the informal and formal arenas. Society benefits from the inclusion of new scientific minds, resulting in a diverse workforce. The possibility for advanced study and eventual employment for blind students also reduces the possibility that they would be dependent upon society for daily care in the future. The results of the proposed project will be disseminated and published broadly through Web sites; e-mail lists; social media; student-developed e-portfolios of the design program; an audio-described video; and presentations at workshops for STEM educators, teachers of blind students, blind consumer groups, researchers in disability education, and museum personnel.
The proposed CAREER study uses a comprehensive mixed-methods design to develop measures of motivational beliefs and family supports for Spanish and English speaking Mexican-origin youth in high school physical science. The research examines a three-part model which may provide a deeper understanding of how Mexican families support youth through their general education strategies, beliefs about physical science, and science specific behaviors. This approach incorporates motivation and ecodevelopmental theories while pursuing an innovative line of research that examines how the contributions of older siblings and relatives complement or supplement parental support. The study has four aims which are to (1) to develop reliable, valid measures of Mexican-origin adolescent motivational beliefs and family supports in relation to high school chemistry and physics, (2) to test whether family supports predict motivational beliefs and course enrollment, (3) to test how indicators in Aim 2 vary based on gender, culture, English language skills and relationship quality, and (4) to examine how family supports strengthen or weaken the relationship between school-based interactions (teachers and peer support) and the pursuit of physical science studies. Spanish and English-speaking Mexican-origin youth will participate in focus groups to inform the development of a survey instrument which will be used in a statistical measurement equivalence study of 300 high school students in fulfillment of Aim 1. One hundred and fifty Mexican high school students and their families will participate in a longitudinal study while students progress through grades 9-12 to examine Aims 2- 4. Data to be collected includes information on science coursework, adolescent motivational beliefs, supports by mothers and older youth in the family, and family interactions. All materials will be in English and Spanish. The educational and research integration plan uses a three pronged approach which includes mentoring of doctoral students, teacher outreach, and the evaluation of the ASU Biodesign high school summer internship program using measures resulting from the research. It is anticipated that the study findings will provide research-based solutions to some of the specific behaviors that influence youth motivation in physical sciences. Specifically, the study will identify youth that might be most affected by an intervention and the age of maximum benefit, as well as valid, reliable measures of youths' motivation that can used in interventions to measure outcomes. The study will also identify family behaviors that may be influenced, including education strategies for school preparation, beliefs about physical science, and sciece-specific strategies such as engaging in science activities outside school. The findings will be broadly disseminated to science teachers, scholars, and families of Mexican-origin youth. This multi-tiered approach will advance current scholarship and practice concerning Mexican-origin adolescents' pursuit of physical science.
A recent report by the Association for Computing Machinery estimates that by decade's end, half of all STEM jobs in the United States will be in computing. Yet, the participation of women and underrepresented groups in post-secondary computer science programs remains discouragingly and persistently low. One of the most important findings from research in computer science education is the degree to which informal experiences with computers (at many ages and in many settings) shape young people's trajectories through high school and into undergraduate degree programs. Just as early language and mathematics literacy begins at home and is reinforced throughout childhood through a variety of experiences both in school and out, for reasons of diversity and competency, formal experiences with computational literacy alone are insufficient for developing the next generation of scientists, engineers, and citizens. Thus, this CAREER program of research seeks to contribute to a conceptual and design framework to rethink computational literacy in informal environments in an effort to engage a broad and diverse audience. It builds on the concept of cultural forms to understand existing computational literacy practices across a variety of learning settings and to contribute innovative technology designs. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds new approaches to and evidence-based understanding of the design and development of STEM learning in these settings. This CAREER program of research seeks to understand the role of cultural forms in informal computational learning experiences and to develop a theoretically grounded approach for designing such experiences for youth. This work starts from the premise that new forms of computational literacy will be born from existing cultural forms of literacy and numeracy (i.e., for mathematical literacy there are forms like counting songs -- "10 little ducks went out to play"). Many of these forms play out in homes between parents and children, in schools between teachers and students, and in all sorts of other place between friends and siblings. This program of study is a three-phased design and development effort focused on key research questions that include understanding (1) how cultural forms can help shape audience experiences in informal learning environments; (2) how different cultural forms interact with youth's identity-related needs and motivations; and (3) how new types of computational literacy experiences based on these forms can be created. Each phase includes inductive research that attempts to understand computational literacy as it exists in the world and a design phase guided by concrete learning objectives that address specific aspects of computational literacy. Data collection strategies will include naturalist observation, semi-structured, and in-depth interviews, and learning assessments; outcome measures will center on voluntary engagement, motivation, and persistence around the learning experiences. The contexts for research and design will be museums, homes, and afterschool programs. This research builds on a decade of experience by the PI in designing and studying computational literacy experiences across a range of learning settings including museums, homes, out-of-school programs, and classrooms. Engaging a broad and diverse audience in the future of STEM computing fields is an urgent priority of the US education system, both in schools and beyond. This project would complement substantial existing efforts to promote in-school computational literacy and, if successful, help bring about a more representative, computationally empowered citizenry. The integrated education plan supports the training and mentoring of graduate and undergraduate students in emerging research methods at the intersection of the learning sciences, computer science, and human-computer interaction. This work will also develop publically available learning experiences potentially impacting thousands of youth. These experiences will be available in museums, on the Web, and through App stores.
Despite strong efforts by many people and institutions and a deep, ongoing commitment from the National Science Foundation, progress remains uneven and slower than desired with respect to broadening participation of people from all parts of society in the science, technology, engineering, and mathematics (STEM) fields. The broadening participation challenge will become even more urgent with increasing demographic and socioeconomic changes underway in our nation. Through this conference and workshop grant, the Association of Science-Technology Centers (ASTC) will convene a group of diverse thought leaders from across higher education, profit, non-profit, K-12 and informal STEM education sectors for one day of brainstorming and prioritizing possible ideas, strategies, and actions that could be aggressively pursued by broadening participation initiatives. The findings of this workshop could support ongoing, field-wide discussions about the next generation of projects and efforts to address issues of underrepresentation in STEM. This workshop will build upon a foundation of existing NSF programs and funded projects and will draw upon ongoing efforts by ASTC's Center for Advancement of Informal Science Education (CAISE) to address broadening participation challenges in informal STEM learning environments. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The Inclusion Across the Nation of Communities of Learners that Have Been Underrepresented for Diversity in Engineering and Science (INCLUDES) Leadership Workshop will engage up to 55 local and non-local participants from the higher education, profit, non-profit, K-12 and informal STEM education sectors that have been selected for their extensive but varied experiences with efforts to broaden participation in STEM. Before the workshop, participants will prepare for the plenary talks, panel presentations, and breakout session discussions by reading selected literature about effectively scaling innovations, collective impact strategies, catalytic innovations, and other related theory. Specific goals of this one-day workshop are 1) to consider potential scalable high-impact innovations in STEM education to assure success for all people across the nation; and 2) to generate ideas, strategies, and actions that could substantially alter the current landscape and potentially achieve a transformative change for inclusion. ASTC proposes to disseminate the workshop findings to worksop participants, the broader communities to which participants belong, and even the National Science Foundation. A workshop synthesis report and other content generated at the workshop (speaker slides, presentation video, graphic documentation to name a few) will reside at ASTC's informalscience.org website. ASTC proposes an extensive communications media strategy that will draw stakeholder attention to these resources and support field-wide discussion and action around broadening participation.