The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
Informal STEM education institutions seek to engage broader cross sections of their communities to address inequities in STEM participation and remain relevant in a multicultural society. In this chapter, we advance the role that evaluation can play in helping the field adopt more inclusive practices and achieve greater equity than at present through evaluation that addresses sociopolitical contexts and reflects the perspectives and values of non-dominant communities. To do this for specific projects, we argue that evaluation should privilege the voices and lived experiences of non-dominant
This third and final report reflects on the entire three-year grant period. It offers the External Review Team’s overall assessment and observations about the accomplishments and challenges experienced by the Child Trends Team while implementing the proof-of-concept study. It further presents several open questions and opportunities for future consideration.
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater program and hands-on group activities. Multimedia Research, an independent evaluation firm, implemented a summative evaluation with low income, inner-city
"Birds in the Hood" or "Aves del Barrio" builds on the Cornell Laboratory of Ornithology's (CLO) successful Project Pigeon Watch, and will result in the creation of a web-based citizen science program for urban residents. The primary target audience is urban youth, with an emphasis on those participating in programs at science centers and educational organizations in Philadelphia, Tampa, Milwaukee, Los Angeles, Chicago and New York. Participants will develop science process skills, improve their understanding of scientific processes and design research projects while collecting, submitting and retrieving data on birds found in urban habitats. The three project options include a.) mapping of pigeon and dove habitats and sightings, b.) identifying and counting gulls and c.) recording habitat and bird count data for birds in the local community. Birds in the Hood will support CLO's Urban Bird Studies initiative by contributing data on population, community and landscape level effects on birds. Support materials are web-based, bilingual and include downloadable instructions, tally sheets, exercises and results. The website will also include a web-based magazine with project results and participant contributions. A training video and full color identification posters will also be produced. The program will be piloted at five sites in year one, and then field-tested at 13 sites in year two. Regional dissemination and training will occur in year three. It is anticipated that 5,000 urban bird study groups will be in place by the end of the funding period, representing nearly 50,000 individuals.
DATE:
-
TEAM MEMBERS:
Rick BonneyJohn FitzpatrickMelinda LaBranche
Capitalizing on the appeal of the PBS KIDS project PLUM LANDING, PLUM RX will research and develop resources to help families and educators infuse environmental science learning into outdoor prescription programs, while ensuring they are appropriate for broad use in other informal settings. The growing outdoor prescription movement is designed to increase the amount of time children spend outside in nature. Programs are structured so that health care providers write "prescriptions" for children to engage in outdoor activity, and informal educators "fill" these prescriptions by facilitating youth and family participation in outdoor activities. There is preliminary evidence that these programs are getting kids outside, but best practices for transitioning "get outside" programs to become "get outside and learn about the environment" programs remain unidentified. PLUM RX is designed to build this knowledge and create resources that are responsive to the needs of both English and Spanish-speaking urban families. The project will work with informal educators and families through multiple cycles of implementation and revision, testing and refining PLUM LANDING resources (animations, videos, games, hands-on science activities, and support materials for informal educators and families), with the goal of designing an effective and accessible PLUM RX Toolkit for national dissemination. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM (Science, Technology, Engineering, Mathematics) learning in informal environments. The proposed research is designed to ensure that the PLUM RX Toolkit--the resources and support materials--will meet the needs of educators working in non-specialized urban settings. Education Development Center (EDC) and WGBH developers will collaborate on design-based research at three urban outdoor prescription programs serving low-income families: Philadelphia Nature Rx in Philadelphia, PA; Outdoors Rx in Boston, MA; and Portland Rx Play in Portland, OR. Moving through cycles of implementation, observation, analysis, and revision, the research team will work closely with educators, families, and developers to determine how the programmatic and structural features of the learning environment, the actions of the educators, and the intervention itself can most effectively support children and families' outdoor exploration in urban contexts. Toolkit materials will include resources for kids and families (including Spanish-speaking families) and informal educators (including those who work with families and directly with children in out-of-school settings). Directors from the three urban outdoor prescription programs will contribute to every phase of the research process, including recruiting families and youth who will participate in a weekly sequence of activities. The overarching focus of the analysis process will be on systematically describing the interaction between two dimensions of implementation: What happened during pilot implementations, and the factors that constrained or supported implementation as planned; and the quality of what happened, which will be defined with reference to the intended impacts. EDC will use a structured descriptive coding process to analyze the qualitative evidence gathered through interviews and observations during design and testing periods. Products of the research activities will include: a series of formative memos to the development team; a report mapping changes made to PLUM RX Toolkit materials in response to formative input and the intended impact of those changes; and findings regarding commonalities and differences across sites in the interaction of local contextual factors and the implementation success of the PLUM RX Toolkit. Concord Evaluation Group (CEG) will provide independent, summative evaluation of the project. Through this process, PLUM RX will build broader knowledge about how to design educational resources, geared for both families and informal educators, which respond to the unique challenges of exploring environmental science in urban environments.