The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
In The Nature of Community: SCIENCES, we share the lessons learned from an innovative partnership designed to leverage the strengths of two nonprofit organizations—a large cultural institution and a smaller, deeply-rooted community-based organization, both of which offer informal science education expertise.
You’ll read first-hand reflections of how staff members, community leaders and members, children, and adults experienced this partnership: the expectations, surprises, challenges, successes, and lessons learned. We hope the description of this partnership inspires other organizations to
This is the protocol for a research project to assess the wants and needs of adults in underserved STEM learning communities -- in our case, the Richmond, VA African American community -- towards the goal of using a community-university partnership to staging STS science cafes that respond to these wants and needs.
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. In this project, Science Cafe's have emerged over the years as a useful mechanism for exposure of scientific information to the public. More recently, this forum has been successfully used as a communication mechanism for teens. While this mechanism is successful with urban and suburban youth, it has not been efficacious with rural teens. Thus, this project is designed to ferret out the challenges faced by Teen Science Cafe's(TSCs) in rural settings and find ways to surmount them. The long-term goal is to engage a large number of teens who will enter adulthood as citizens with a sophisticated understanding of the science process and who will follow a myriad of pathways into the U.S. STEM workforce. The research will focus on what works, for whom, and where with respect to the key components and outcomes of teen science cafe's in rural areas.
At the broadest level, the project will strengthen infrastructure and build capacity by producing a national model for bringing OST (out of school time) STEM to rural communities. Over the two project years, approximately 600 unique participants will participate in teen science cafe's that engage their curiosity in STEM, provide leadership opportunities, and make STEM occupations more visible, participatory and approachable for rural teems who often lack access to high quality STEM programs in school.
Specific goals of the project for rural settings are: (1) To test the feasibility and effectiveness of a national model of professional development centered on an in-person and virtual community of practice for informal STEM educators leading teen science cafe's. (2) Form research-practice partnerships involving the PIs and the leaders of cafe's to: i) identify and document existing local conditions, resources, and challenges and their significance for OST STEM education; ii) work collaboratively with peers and the PIs to systematically test new strategies for engaging rural teens in TSCs; (3) Cultivate a mindset among teens that STEM IS EVERYWHERE. Rural teens are often isolated and the STEM careers in their communities are largely invisible to them. To date, 19 geographically and demographically diverse active teen cafe's sites have committed to the project. The PIs will use a multifaceted approach to characterizing rurality, They will use the established Index of Relative Rurality (IRR) which includes four spatial variables (remoteness, overall population size, density, and proportion of built-up land). The impact of the Cafe's series at each site will be determined via multiple methods, including: (1) pre-post-surveys with teens, employing the measure of STEM attitudes and engagement; (2) detailed blog postings by adult leaders describing the challenges/successes of teen and (3) interviews with leaders to uncover their perceptions of the reasons associated with success of the strategy.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Cities are facing new demands as their urban populations rapidly grow. Smart City initiatives are being developed to address issues of mobility, infrastructure, security, and safety, while enhancing the quality of life of citizens. One-size-fits-all solutions are not viable. Instead, the diversity of a city's residents, including life experiences, cultural backgrounds, needs, and behaviors, must be taken into account to achieve transformative, citizen-centered solutions. Engineers, scientists, policy makers, entrepreneurs, and thought leaders must be prepared to tackle future Smart City challenges, and address knowledge barriers in understanding the needs of citizens across age, occupation, financial standing, disability, and technology savviness. This National Science Foundation Research Traineeship (NRT) award to the Arizona State University addresses this need by training the next generation of MS and PhD students for careers in Smart Cities-related fields. The project anticipates training thirty-eight (38) MS and PhD students, including twenty-four (24) funded trainees, from the following degree programs: Human and Social Dimensions of Science and Technology; Public Affairs; Computer Science; Civil, Environmental, and Sustainable Engineering; Mechanical & Aerospace Engineering; and Applied Engineering Programs. In addition to trainees, it is envisioned that over 300 other MS and PhD students in STEM disciplines will participate in opportunities made available through this traineeship. The knowledge and technologies developed from this project will contribute toward improving the quality of life for all of society through interdisciplinary, citizen-centered Smart City solutions.
An integrated education-research-practice model focused on the technological, societal, and environmental research aspects of citizen-centered solutions for Smart Cities will be employed to instill trainees with transdisciplinary skills and knowledge through cross-disciplinary courses; experience with leading collaborative, use-inspired research projects; applied learning through internships with partners and teaching opportunities; research experiences through service learning and leadership; and entrepreneurial education. Trainees will pursue research thrusts in Citizen-Centered Design; Smart City Infrastructure and Dynamics; and Socio-Environmental Practices and Policies. These thrusts are embedded in integrative priority application areas of Transportation and Accessibility; Safety, Security, and Risk Reduction; and Engagement and Education. Research efforts will significantly advance data-enabled citizen engagement; urban informatics; Internet-of-Things technologies; inclusion and accessibility; urban infrastructure; transportation systems; cybersecurity; swarm robotics; urban sustainability; quality of life and equity for citizens; hazards management and risk reduction; and societal concerns and ethics of emerging Smart City technologies. Focused efforts will be made to recruit underrepresented minorities, women, and individuals with disabilities, in order to tap underutilized talent, equip them to address the needs of their communities, and increase involvement of these groups in Smart Cities-related fields.
The NSF Research Traineeship (NRT) Program is designed to encourage the development and implementation of bold, new potentially transformative models for STEM graduate education training. The program is dedicated to effective training of STEM graduate students in high priority interdisciplinary research areas through comprehensive traineeship models that are innovative, evidence-based, and aligned with changing workforce and research needs.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Michael KennedyRam PendyalaCynthia SelinAnn McKennaTroy McDanielGail-Joon AhnSethuraman Panchanathan
Ruff Family Science is a project funded by the National Science Foundation (NSF) that aims to foster joint media engagement and hands-on science exploration among diverse, low-income parents and their 4- to 8-year-old children. Building on the success of the PBS series FETCH! with Ruff Ruffman, the project leverages FETCH’s funny and charismatic animated host, along with its proven approach to teaching science, to inspire educationally disadvantaged families to explore science together. The project is utilizing a research and design process to create resources that meet the needs of families
Since 1992, the WSU Math Corps, a combined mathematics and mentoring program, has worked to make a difference in the lives of Detroit’s children—providing them with the love and support that all kids need in the moment, while empowering them with the kinds of educational opportunities and sense of purpose, that hold the promise of good lives for themselves and a better world for all.
DATE:
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter