Garibay Group worked with CLO staff to conduct front‐end research with targeted Latino communities. The goal of this research was to gain an in‐depth understanding of partner communities, including both Latino families living in these communities and of organizational partners. Specifically, research focused on understanding Latino families’ cultural values and norms regarding leisure choices, attitudes toward science, use of technology, and responses to and interested in citizen science.
DATE:
TEAM MEMBERS:
Cecilia GarabayCornell Lab of Ornithology
Funded by the National Science Foundation (NSF),The STEM Pathways project focused on exploring strategies through which at-risk and incarcerated Hispanic youth could be engaged around STEM careers, understand the education, training, and skills they would need to attain them, and think that such a path was a future possibility. To this end, the project and evaluation teams collaborated on a literature review, the development of a logic model, and the design, implementation, and evaluation of a diverse set of program activities that included media, art, and flash mentoring with STEM role models
This Pathways project from the Ocean Discovery Institute (ODI) seeks to develop and pilot a program model designed to fill an identified gap in citizen science research and practice literature: how to effectively engage and better understand how to foster participation among people from under-represented groups in citizen science research. The ODI model is designed around six principles: (1) leaders who are reflective of the community, (2) science that is locally relevant, (3) guided, as opposed to self-guided, experiences, (4) direct interactions with scientists, (5) progressively increasing responsibilities for participants who express interest, and (6) removing barriers to participation, such as transportation, language, family involvement and access to technology. The project addresses environmentally degraded, crime-ridden local canyons, a locally relevant STEM-related issue, and leverages the Southern California Coastal Water Research Project's (SCCWRP) regional citizen science effort focused on identifying the sources and pathways of trash through regional watersheds. The scientific research components of the project focus on four canyons in the area, employing sampling methods developed by SCCWRP. Youth who are part of other ODI programs and who have demonstrated leadership and interest in science, work with the project team to scaffold family and youth participation in project activities taking place during afterschool and weekend time. Based on continued participation in the project, community participants can become more involved in the project, starting as "new scientists" and moving through "returning scientists" to "expert scientists" roles. The project evaluation seeks to identify the role and importance of the components of the proposed model with respect to participation, retention, and learning by participants from groups under-represented in STEM. The dissemination products of this Pathways project include a white paper describing the model and lessons learned as well as presentations to community groups and education and citizen science practitioners. Based on insights from the iterative approach to the model during this Pathways study, a subsequent full-scale development project would seek to engage citizen science projects around the nation in adapting the model to increase participation of individuals from groups underrepresented in STEM, including building out ODI's citizen science programming.
DATE:
-
TEAM MEMBERS:
Lindsay GoodwinRoxanne RuzicTheresa Sinicrope Talley
The project is designed to engage Hispanic students in grades K-5 in STEM in afterschool programs within community-based organizations (CBOs). The project builds on the foundation of an NSF-supported afterschool science program--APEX (Afterschool Program Exploring Science). In collaboration with National Council of La Raza (NCLR), and ASPIRA, the project adapts APEX into a bilingual English/Spanish format and, using a train the trainer model, disseminates it nationally, using a train the trainer model. Each of the ten local project sites will build on a partnership between a science museum and a CBO affiliate of NCLR or ASPIRA. The project is designed to: (1) Build the organizational capacity of partner science museums to work with CBOs and the Hispanic community. (2) Strengthen links between science museums and Hispanic serving CBOs in their communities. (3) Engage the expertise, involvement, and collaboration of national Hispanic-serving organizations, NCLR and ASPIRA, in STEM education. (4) Increase the engagement of Hispanic children and families in STEM. The project evaluation will investigate how effectively the project builds the organizational capacity of partner museums and CBOs in engaging Hispanic children and families in STEM; the types and strength of science museum/CBO partnerships; the effectiveness of the project in increasing Hispanic student and family engagement in STEM, and the types of contributions the project makes to the field of informal STEM learning. The evaluation will use qualitative and quantitative methods, including surveys, interviews, case studies, social network and collaboration analysis, observations, activity tracking, embedded assessment, photo elicitation, and focus groups.
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.
In this paper, researchers from University of Michigan discuss a major problem facing zoo administrators in major urban metropolitan areas: the relevance and attraction of urban zoos to inner-city minority residents. They present an overview of the methodology and findings from a study that examined zoo visitation to the Detroit Zoo by white and minority residents of Detroit.
Genetics was developed by The Tech staff in collaboration with Stanford University and was funded by the National Institutes of Health Science Education Partnership Award (SEPA) program. The evaluation documents the impact and effectiveness of the exhibition using timing and tracking observations and exit interviews. It also examines the partnership between The Tech and Stanford University through interviews with graduate students, who conduct programs in the exhibition, and their supervisor (results are not included in this summary).
DATE:
TEAM MEMBERS:
Randi KornThe Tech Museum of Innovation
This report describes a summative evaluation of Secrets of Circles, a 2,600 square foot exhibition created by Children's Discovery Museum of San Jose and funded by the National Science Foundation. The exhibition and related programs were designed to highlight the uses of circles and wheels in everyday life. Circles have properties that make them extremely effective as an engineering tool, and they are ubiquitous in cultures around the world. The appendix of this report inclues interview and observation protocols and questionnaires used in this study.
DATE:
TEAM MEMBERS:
Sue AllenChildren's Discovery Museum of San Jose
In 2012, Concord Evaluation Group (CEG) conducted an evaluation of the impact of Peep and the Big Wide World (Peep) resources on Spanish-speaking families with preschool-aged children. The three-pronged evaluation included a National Family Study in which 112 Spanish-speaking families who used the Peep resources were compared to Spanish-speaking families who did not use the Peep resources. It also included an In-Depth Family Study -- an experiment conducted in the metro Boston area in which 36 Spanish-speaking families who used the Peep resources were compared to Spanish-speaking families who
In spring 2009, the Denver Museum of Nature & Science (Museum) contracted with JVA Consulting, LLC (JVA) to conduct a comprehensive process and outcome evaluation of the Passport to Health (P2H) program. The Museum designed P2H, originally a three-year program funded by the Colorado Health Foundation (the Foundation), to improve health outcomes for fifth-grade students as well as their families and teachers throughout the Denver metro area. Passport to Health has seven components, designed to complement each other and help the Museum achieve its stated program goals. The seven components
DATE:
TEAM MEMBERS:
JVA Consulting, LLCDenver Museum of Nature & Science
Concord Evaluation Group (CEG) conducted an evaluation of the Spyhounds pilot test in October-December 2011. The goal of the evaluation was to assess the online resources for appeal and interest, as well as to provide WGBH with data on how a full-scale year-long project could be structured. CEG recruited a national sample of 5-8 year old children to participate in the pilot test. We conducted a pre-test survey to measure science-related knowledge (kids only), attitudes and interest (parents and kids). We then invited families to use the online resources during the pilot test and surveyed the
Queens Central Library contracted Randi Korn & Associates, Inc. (RK&A) to conduct an evaluation of the newly completed Children's Library and Discovery Center (CLDC), partially funded by the National Science Foundation. In addition to traditional children's library resources, the CLDC includes interactive science exhibits, programming space, and an early childhood area. The evaluation sought to understand 1) how its family customers use the new CLDC (and its exhibits) and what they most value about it, and 2) experiences of CLDC staff who interact with the customers. How did we approach this
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.Queens Central Library