Skip to main content

Community Repository Search Results

resource evaluation Afterschool Programs
The Arctic Harvest-Public Participation in Scientific Research (which encompasses the Winterberry Citizen Science program), a four-year citizen science project looking at the effect of climate change on berry availability to consumers has made measurable progress advancing our understanding of key performance indicators of highly effective citizen science programs.
DATE:
TEAM MEMBERS: Angela Larson Kelly Kealy Makaela Dickerson
resource research Public Programs
This guidebook will help you plan your action project. The initial brainstorm pages will help you consider where to start, and the Action Project Framework will navigate you through steps to get to your destination: the completion of your project!
DATE:
TEAM MEMBERS: Kathleen Gray Dana Haine
resource project Public Programs
This project focuses on environmental health literacy and will explore the extent to which diverse rural and urban youth in an out-of-school STEM enrichment program exhibit gains in environmental health literacy while engaged in learning and teaching others about community resilience in the face of changing climates. Science centers and museums provide unique opportunities for youth to learn about resilience, because they bring community members together to examine the ways that current science influences local decisions. In this project, teams of participating youth will progress through four learning modules that explore the impacts of changing climates on local communities, the local vulnerabilities and risks associated with those changes, possible mitigation and adaptation strategies, and building capacities for communities to become climate resilient. After completion of these modules, participating youth will conduct a resilience-focused action project. Participants will be encouraged to engage peers, families, friends, and other community stakeholders in the design and implementation of their projects, and they will gain experience in accessing local climate and weather data, and in sharing their findings through relevant web portals. Participants will also use various sensors and web-based tools to collect their own data.



This study is guided by three research questions: 1) To what extent do youth develop knowledge, skills, and self- efficacy for developing community resilience (taken together, environmental health literacy in the context of resilience) through participation in museum-led, resilience-focused programming? 2) What program features and settings foster these science learning outcomes? And 3) How does environmental health literacy differ among rural and urban youth, and what do any differences imply for project replication? Over a two- year period, the project will proceed in six stages: a) Materials Development during the first year, b) Recruitment and selection of youth participants, c) Summer institute (six days), d) Workshops and field experiences during the school year following the summer institute, e) Locally relevant action projects, and f) End- of-program summit (one day). In pursuing answers to the research questions, a variety of data sources will be used, including transcripts from youth focus groups and educator interviews, brief researcher reflections of each focus group and interview, and a survey of resilience- related knowledge. Quantitative data sources will include a demographic survey and responses to a self-efficacy instrument for adolescents. The project will directly engage 32 youth, together with one parent or guardian per youth. The study will explore the experiences of rural and urban youth of high school age engaged in interactive, parallel programming to enable the project team to compare and contrast changes in environmental health literacy between rural and urban participants. It is anticipated that this research will advance knowledge of how engagement of diverse youth in informal learning environments influences understanding of resilience and development of environmental health literacy, and it will provide insights into the role of partnerships between research universities and informal science centers in focusing on community resilience.
DATE: -
TEAM MEMBERS: Kathleen Gray Dana Haine
resource project Public Programs
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:


EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.


This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.

In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE: -
TEAM MEMBERS: Nichole Pinkard Reed Stevens
resource evaluation Media and Technology
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
DATE:
resource research Media and Technology
Informal STEM education institutions seek to engage broader cross sections of their communities to address inequities in STEM participation and remain relevant in a multicultural society. In this chapter, we advance the role that evaluation can play in helping the field adopt more inclusive practices and achieve greater equity than at present through evaluation that addresses sociopolitical contexts and reflects the perspectives and values of non-dominant communities. To do this for specific projects, we argue that evaluation should privilege the voices and lived experiences of non-dominant
DATE:
resource evaluation Public Programs
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. Techbridge Girls began offering after-school programming at elementary and middle schools in Greater Seattle in 2014, and in Washington, DC in 2015. Education Development Center is conducting the formative and summative evaluation of the project. To assess the
DATE:
TEAM MEMBERS: Ginger Fitzhugh Carrie Liston Sarah Armstrong
resource research Public Programs
The purpose of this study is to thoroughly describe a program designed to strengthen the pipeline of Latino students into post-secondary science, technology, engineering, and mathematics (STEM) education, and present evaluation data to assess multiyear effectiveness. The program includes a suite of interventions aimed at students and families, and was implemented in a low-income school cluster with a high Latino population in metro Atlanta. Our intervention includes a high school and middle school mentoring program, STEM-focused extracurricular activities (summer camps, research and community
DATE:
TEAM MEMBERS: Diley Hernandez Marion Usselman Shaheen Rana Meltem Alemdar Analia Rao
resource research Websites, Mobile Apps, and Online Media
This brief discusses the PLUM LANDING Explore Outdoors Toolkit, a new set of free, public media resources designed to help informal educators and parents infuse science learning into outdoor recreation. Developed by trusted media producer WGBH in partnership with researchers at Education Development Center (EDC), the Toolkit aims to get children (ages 6–9) from low-income, urban communities outside so they can explore the environment around them while debunking the myth that nature is something that only exists beyond city limits.
DATE:
TEAM MEMBERS: Marion Goldstein Elizabeth Pierson Jamie Kynn Lisa Famularo
resource project Public Programs
Northern ecosystems are rapidly changing; so too are the learning and information needs of Arctic and sub-Arctic communities who depend on these ecosystems for wild harvested foods. Public Participation in Scientific Research (PPSR) presents a possible method to increase flow of scientific and local knowledge, enhance STEM-based problem solving skills, and co-create new knowledge about phenology at local and regional or larger scales. However, there remain some key challenges that the field of PPSR research must address to achieve this goal. The proposed research will make substantial contributions to two of these issues by: 1) advancing theory on the interactions between PPSR and resilience in social-ecological systems, and 2) advancing our understanding of strategies to increase the engagement of youth and adults historically underrepresented in STEM, including Alaska Native and indigenous youth and their families who play an essential role in the sustainability of environmental monitoring in the high latitudes and rural locations throughout the globe. In particular, our project results will assist practitioners in choosing and investing in design elements of PPSR projects to better navigate the trade-offs between large-scale scientific outcomes and local cultural relevance. The data collected across the citizen science network will also advance scientific knowledge on the effects of phenological changes on berry availability to people and other animals.

The Arctic Harvest research goals are to 1) critically examine the relationship between PPSR learning outcomes in informal science environments and attributes of social-ecological resilience and 2) assess the impact of two program design elements (level of support and interaction with mentors and scientists, and an innovative story-based delivery method) on the engagement of underserved audiences. In partnership with afterschool clubs in urban and rural Alaska, we will assess the impact of participation in Winterberry, a new PPSR project that investigates the effect of changes in the timing of the seasons on subsistence berry resources. We propose to investigate individual and community-level learning outcomes expected to influence the ability for communities to adapt to climate change impacts, including attributes of engagement, higher-order thinking skills, and their influence on the level of civic action and interest in berry resource stewardship by the youth groups. Using both quantitative and qualitative approaches, we compare these outcomes with the same citizen science program delivered through two alternate methods: 1) a highly supported delivery method with increased in-person interaction with program mentors and scientists, and 2) an innovative method that weaves in storytelling based on elder experiences, youth observations, and citizen science data at all stages of the program learning cycle. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project also has support from the Office of Polar Programs.
DATE: -
TEAM MEMBERS: Katie Spellman Elena Sparrow Christa Mulder Deb Jones
resource project Public Programs
Our Sky is a series of Out-of-School Time and museum educational programs that inspire an appreciation and understanding of Earth and Space Science (ESS) in a diverse population of children ages 3-10 and their parents, caregivers and educators. All resources are developed through a partnership between Boston Children’s Museum and Smithsonian Astrophysical Observatory in Boston and Cambridge, Massachusetts. The vision for Our Sky is that children ages 3-10 and their adult caregivers will gain an appreciation for celestial objects and phenomena as a foundation for understanding of Earth and Space Science. All resources and activities will be designed to realize this vision, and to:

Serve a diverse range of audiences, with an emphasis on urban and low-income children and families;
Increase appreciation among diverse adults and children of the sky as an accessible science learning resource;
Share NASA resources with, and help develop foundational STEM skills in children;
Encourage adults to engage in and guide ESS learning experiences with children;
Inspire practical application of STEM skills by children and adults as they explore celestial objects together; and
Expand the capacity of museum staff and afterschool educators to engage families in learning STEM skills through ESS exploration.
Our Sky activities will result in:

A series of museum-based programs that incorporate NASA resources and ESS activities across a range of content areas; and
A series of new ESS-focused activities for the award-winning “Beyond the Chalkboard” afterschool curriculum that include NASA resources and will reach hundreds of thousands of children around the world.
DATE: -
TEAM MEMBERS: Leslie Swartz Mary Dussault Tim Porter
resource project Public Programs
Through the Scientists for Tomorrow pathways project, The Science Institute at Columbia College in Chicago will test a model for preparing non-science major, pre-service elementary school teachers to deliver three ten-week informal science education modules to youth in after school programs. The initiative will bring engineering concepts, environmental science, and technology to approximately 240 urban Chicago youth (ages 10-14 years old) and their families. The Science Institute will partner with eight minority serving community based organizations and the Museum of Science and Industry, the Field Museum, and the Garfield Park Conservatory Alliance to develop and implement all aspects of the program. The goals of the program are two-fold. First, the project will develop and implement a high-quality STEM based afterschool program for under-represented youth in STEM. Second, the professional development and experience implementing the curriculum with youth in the local communities and within informal science education (ISE) institutions will extend and enrich the pre-service teachers\' STEM content and pedagogical knowledge base and better prepare them to teach science in formal and informal settings. Thirty teachers will receive specialized professional development through a seminar, course, and other support mechanisms in order to best support the implementation of the modules, while building their STEM content expertise, confidence, and pedagogical knowledge. Each module has a different STEM content focus: alternative energy (fall), the physics and mathematics of sound and music (winter), and environmental science (spring). At the end of each module, a culminating youth-led presentation will be held at one of the partnering Chicago museums. Youth will be encouraged to participate in all three modules. The formative evaluation will be conducted by the Co-Principal Investigators. Pre and post assessments, artifact reviews, and interviews will be used for the summative evaluation, which will be conducted by an external evaluator at the Illinois Institute of Technology. The project deliverables include: (a) a teacher training program, (b) an after school curriculum, and (c) media tools - DVDs, website. Over the grant period, the project intends to reach 120 youth each year, over 100 family and community members, and 30 teachers. The larger impact of this project will be the development of a scalable model for bringing relevant STEM content and experiences to youth, their families, and non-science major pre-service teachers. As a result of this project, a cadre of pre-service teachers will have: (a) increased their STEM content knowledge, (b) gained experience presenting STEM content in informal settings, (c) learned effective approaches to deliver hands-on STEM content, and (d) learned to use museum and other ISE resources in their teaching. In fact, after the grant period nearly half of the teachers will continue to work at the centers as part-time instructors, fully supported by the partnering community centers.
DATE: -
TEAM MEMBERS: Constantin Rasinariu Marelo Caplan Virginia Lehmkuhl-Dakhwe