This chapter reviews four projects that reflect the principles of design-based implementation research (DBIR) in an effort to highlight a range of relevant theoretical and methodological perspectives and tools that can inform future work associated with DBIR.The goal of this chapter is to highlight a range of relevant theoretical and methodological perspectives and tools that can inform future work associated with design-based implementation research (DBIR). As Penuel, Fishman, Cheng, and Sabelli (2011) described, DBIR entails engaging “learning scientists, policy researchers, and
DATE:
TEAM MEMBERS:
Jennifer RussellKara JacksonAndrew KrummKenneth Frank
The purpose of this study was to investigate the ways in which environmental education (EE) programs are contributing to environmental quality (EQ) improvement. The research applied the Pressure-State-Response (PSR) environmental indicator framework to the reported outcomes of 103 EE programs in order to 1) determine the extent to which existing EE programs are reporting EQ improvement outcomes; and 2) examine the extent to which these programs are impacting indicators in the three areas of the PSR framework. The study consisted of three research phases: evaluation synthesis, semi-structured
President Obama announced in April 2013 that the Corporation for National and Community Service (CNCS) would launch a STEM AmeriCorps initiative to build student interest in STEM. A RFA is currently being prepared to be released in the late fall of 2013. This project will engage in quick response research to identify an evaluation and research agenda that can begin to inform the program launch. Thus, the timeframe for informing the initial stages of STEM AmeriCorps is relatively short, and the creation of an evaluation and research agenda is very timely. The products from the RAPID proposal are: (1) a review of the evaluation and research literature on the use of volunteers and/or mentors to build students' interest in STEM; (2) to convene a workshop to identify evaluation and research priorities to guide the initiative; and (3) a summary evaluation agenda that identifies promising directions along with the strength of evidence around key issues.
How do informal learning organizations work with schools as part of a broader educational ecology? We examined this question through a comparative case study of two collaborative efforts whereby informal arts education organizations, a children's museum and a community-based organization, worked with an urban school district to redefine the provision of educational services for children and youth. Grounded conceptually in organizational theory, our study identified factors that enable and constrain collaboration across the formal-informal divide. We argue that examining the dynamics of cross
This project supports the development of technological fluency and understanding of STEM concepts through the implementation of design collaboratives that use eCrafting Collabs as the medium within which to work with middle and high school students, parents and the community. The researchers from the University of Pennsylvania and the Franklin Institute combine expertise in learning sciences, digital media design, computer science and informal science education to examine how youth at ages 10-16 and families in schools, clubs, museums and community groups learn together how to create e-textile artifacts that incorporate embedded computers, sensors and actuators. The project investigates the feasibility of implementing these collaboratives using eCrafting via three models of participation, individual, structured group and cross-generational community groups. They are designing a portal through which the collaborative can engage in critique and sharing of their designs as part of their efforts to build a model process by which scientific and engineered product design and analysis can be made available to multiple audiences. The project engages participants through middle and high school elective classes and through the workshops conducted by a number of different organizations including the Franklin Institute, Techgirlz, the Hacktory and schools in Philadelphia. Participants can engage in the eCrafting Collabs through individual, collective and community design challenges that are established by the project. Participants learn about e-textile design and about circuitry and programming using either ModKit or the text-based Arduino. The designs are shared through the eCrafting Collab portal and participants are required to provide feedback and critique. Researchers are collecting data on learner identity in relation to STEM and computing, individual and collective participation in design and student understanding of circuitry and programming. The project is an example of a scalable intervention to engage students, families and communities in developing technological flexibility. This research and development project provides a resource that engages students in middle and high schools in technology rich collaborative environments that are alternatives to other sorts of science fairs and robotic competitions. The resources developed during the project will inform how such an informal/formal blend of student engagement might be scaled to expand the experiences of populations of underserved groups, including girls. The study is conducting an examination of the new types of learning activities that are multiplying across the country with a special focus on cross-generational learning.
The Decapoda - shrimp, lobsters, and crabs - are an economically important, diverse group of animals whose geologic history extends back 400 million years. Living representatives, numbering over 15,000 species, are global in distribution and nearly ubiquitous in oceanic and non-oceanic environments. They exert a major impact on ecosystems; understanding the dynamics of their fossil record will illuminate their historical impact on ecosystems. We will test the hypothesis that decapods are arrayed in a series of discrete evolutionary faunas; remarkably, the vast array of living and fossil decapods in diverse interrelated groups have exploited four basic body plans repeatedly. Other hypotheses to be tested are that the Decapoda have repeatedly adopted a limited number of baupläne, or generalized architectures, throughout their history; that they have experienced explosive evolutionary radiations followed by periods of no determinable change; and that they are generally resistant to mass extinction events. These hypotheses will be tested using a unique dataset compiled and assessed by the Principle Investigators: a compilation of all fossil decapod species, arrayed in a classification scheme including fossil and living taxa, with geologic and geographic ranges of all species, including a phylogeny (i.e. "family tree") for many sub-groups within the Decapoda. The dataset will be expanded to include ecological data for each taxon and will be entered into the Paleobiology Database, an NSF-supported vehicle for analyzing the fossil record. Employing its methodology, patterns of diversity and macroevolution of the decapods will be generated at levels ranging from the entire Order to species level. This will result in a comprehensive analysis of macroevolutionary patterns of this major group for the first time. Available paleoecological data derived from field studies and published records will be used to determine the effects of various environmental factors such as seafloor conditions, reef development, water depth, and temperature on morphology, extinction survivorship, and diversity. Because decapods have a remarkable range of morphological variation preservable in the fossil record, the diversity of the groups of decapods can be assessed in relation to their morphological characteristics. Defining the history of taxa with specialized morphology will permit recognition of body plans that have been exploited by different decapod groups throughout the history of the clade.
Intellectual merit. This study will provide the most comprehensive analysis of macroevolution of the Decapoda yet conducted, all based upon a unique dataset that is internally consistent by virtue of its having been developed entirely by the investigators. It will document the significance of employing a high resolution, species-level database for interpretation of diversity. The hypotheses and conclusions derived here will provide a model and the foundation for future work on Decapoda, Arthropoda, and macroevolution of well-constrained groups. It will provide a test for the efficacy of PBDB data versus a constrained dataset assessed by specialist systematists.
Broader impacts. The work will introduce undergraduate students at Kent State at Stark, an undergraduate campus, and Kent State at Kent, to research that involves paleoecological, paleogeographical, and functional morphological elements which, in turn, will be communicated to other students. Because decapods are known to virtually everyone, they form an excellent group to use to inform the public about ancient patterns of diversity and the relationship between the morphology of organisms, variations in their environmental requirements, and their adaptability to different physical conditions. This will be conveyed in a professionally constructed display which has the potential to be exhibited in museums and universities around the country. Small kits designed for use in elementary and middle schools will be available to allow students to make their own observations about the adaptations of decapods to their environment and its effect on diversity. Published papers and presentations on results of research at meetings will be prepared throughout the course of the research. Because the study of modern biodiversity is a concern of the general public, presentations to broader audiences as well as geology classes will provide a broad historical context for understanding modern patterns of diversity. Data entered into Paleobiology Database and Ohio Data Resource Commons will be openly available to other researchers and the general public. Combined, the databases will assure archival storage and public access, following a proprietary period.
Journey into Space (JIS) is designed to improve student, educator, and general public understanding of earth/space science and its relationship to NASA goals and objectives through the use of a traveling GeoDome (inflatable planetarium) and engaging supporting programming at The Journey Museum. The Museum collaborates with area colleges, school districts, K-12 educators, youth serving organizations, astronomical affiliations, and others. The overall goal of JIS is to improve student, educator, and general public understanding of STEM and its relationship to NASA goals and objectives. JIS objectives are: 1) To increase student and public interest and awareness in STEM areas; 2) To increase student interest in pursuing STEM careers; 3) To improve teacher knowledge of NASA related science; 4) To increase teacher comfort level and confidence in teaching NASA related science in their classrooms; 5) To increase collaboration between informal and formal science educators; 6) To increase student and public understanding of Plains Indians ethno astronomy; and 7) To increase museum visitors’ interest and understanding of NASA related science. The Museum produced 2 films (“Cradle of Life”, “Looney Moons”) that are offered daily, 4 recurring monthly programs (Final Frontier Friday, Amazing Science, SciGirls that became Science Explorer’s Club, and Black Hills Astronomical Society meetings), summer robotics classes and teachers’ workshops, annual Earth Science Day, in addition to the GeoDome programming that has toured the region including presentations in the three poorest counties in the United States. The ethno-astronomy is underway in partnership with Oglala Lakota College and South Dakota Space Grant Consortium.
Science Club is an after school program created in partnership between Northwestern University and the Boys & Girls Clubs of Chicago. Every week throughout the academic year, middle school youth (grades 5-8) work in small groups with their graduate student mentors on challenging, hands-on experiments. The six Science Club curricular modules cover topics ranging from biomedical engineering to food science, all with the goals of helping youth to 1) improve their understanding of the scientific method, 2) develop scientific habits of mind, and 3) increase their interest in STEM fields, particularly health-related careers. Science Club serves 60 youth every quarter with the help of 30 trained scientist mentors. Science Club meets three days a week at the Pedersen-McCormick Boys & Girls Club in Chicago, IL.
Families and school-aged constituents at 30 urban, inner-city neighborhood community-based organizations and teachers and students in earth science classes in 40 middle schools. Intent: This project will prepare neighborhood and community leaders in Philadelphia to use simple but effective observation tools and NASA’s educational web content to help their inner-city Philadelphia neighbors learn about space science and technology – and about their city and themselves – by knowledgably exploring the sky. Project Goals: 1. Create multiple opportunities for inner-city children, adults and families to observe and learn about the solar system through neighborhood and city-wide events. 2. Equip CBO’s with the knowledge, skills and materials they need to make space science-related events and activities a sustained part of programming for their constituents. 3. Stimulate interest and engagement in NASA’s missions and resources among residents of traditionally underserved, inner-city neighborhoods through astronomy experiences and NASA’s websites. 4. Create and strengthen collaborative ties between The Franklin Institute, CBO’s, city residents, and local amateur astronomers. Programs/Products produced: 1. Repeatable ‘Galileoscope’ workshops and activities in 30 CBO’s 2. Solar observing activities for 30 CBO’s and 40 middle schools. 3. School assembly-type audience interactive program about observational astronomy for use in schools and community organizations. 4. Recurring neighborhood star parties facilitated through on-going partnerships with local amateur astronomy clubs. 5. Participation in city-wide star party as part of the annual Philadelphia Science Festival.
Since August of 2011, Project iLASER (Investigations with Light And Sustainable Energy Resources) has engaged children, youth and adults in public science education and hands-on activities across the entire length of the U.S.-Mexico border, from the Pacific Ocean to the Gulf of Mexico. The two main themes of Project iLASER activities focus on sustainable energy and materials science. More than 1,000 children have been engaged in the hands-on activities developed through Project iLASER at 20+ sites, primarily in after-school settings in Boys & Girls Clubs. Sites include Boys & Girls Clubs in California (Chula Vista, Imperial Beach, El Centro and Brawley); Arizona (Nogales); New Mexico (Las Cruces); and Texas (El Paso, Midland-Odessa, Edinburg and Corpus Christi). The project was co-funded between the NSF Division of Chemistry (CHE) and the Division of Research on Learning in Formal and Informal Settings (DRL).
DATE:
-
TEAM MEMBERS:
Southwestern CollegeDavid BrownDavid Hecht
The Community STEM Outreach Project at the Saint Louis Science Center (SLSC) received funding from the United States Office of Naval Research (ONR) from October 2010 through September 2013. Klein Consulting, with support from Tisdal Consulting, conducted the evaluation of the three-year project. The original proposal from the SLSC to ONR laid the foundation for the Community STEM Outreach Project by describing the institution and its youth program, the Youth Exploring Science (YES) Program. Plans were underway to reach out to existing and new national partners to document and disseminate a
Techbridge has proposed a broad implementation project that will scale up a tested multi-faceted model that increases girls' interest in STEM careers. The objectives of this project are to increase girls' engineering, technology, and science skills and career interests; build STEM capacity and sustainability across communities; enhance STEM and career exploration for underrepresented girls and their families; and advance research on the scale-up, sustainability, and impact of the model with career exploration. The Techbridge approach is grounded in Eccles' expectancy value model, and helps bridge critical junctures as girls transition from elementary to middle school and middle school to high school, immersing participants in a network of peers and supportive adults. Techbridge targets girls in grades 5-12 with a model that includes five components: a previously tested and evaluated curriculum, career exploration, professional development for staff and teachers, family engagement, and dissemination. The inquiry-based curriculum introduces electrical engineering and computer science through engaging, hands-on units on Cars and Engines, Green Design, and Electrical Engineering. The Techbridge model will be enhanced to include a central repository for curriculum and support materials, electronic girl-driven career exploration resources, an online learning community and video tools for staff, and customized family guides. Project deliverables include the dissemination of the enhanced model to three cities, 24 school sites and teachers, 2,000 girls, and over 600 role models. A supplementary research component will study the broad implementation of the Techbridge model by examining the fidelity of implementation and the program's impact on girls' STEM engagement and learning. The research questions are as follows: (1) To what extent and how do new program sites demonstrate adherence to the Techbridge program model? (2) Do new sites experience similar or increased participant responsiveness to Techbridge programming with regard to scientific learning outcomes, career awareness, attitude and interest in engineering? (3)How are changes experienced by girls sustained over time, if at all? (4) To what extent and how do new sites balance instilling the Techbridge essentials, those critical components Techbridge identifies as essential for success, with the need for local adaptation and ownership of the program? and (5) Given the potential for customization in local communities, do new sites maintain programmatic quality of delivery experienced at the original site? If so, what are elements essential to success regarding quality delivery? The mixed-methods study will include document analysis, embedded assessments, participant survey scales, and observations. Qualitative data methods include interviews with teachers, role models, staff and focus groups with girls. A project evaluation will also be conducted which investigates project outcomes for participants (girls, teachers, role models, and families) and fidelity of the implementation and enhancements at expansion sites, using a quasi-experimental approach. Career and learning outcomes for girls will be determined using embedded assessments, portfolios, surveys, school data, and previously validated instruments such as the Career Interest Questionnaire and the Modified Attitudes towards Science Inventory. The Managing Complex Change model is used as a framework for the project evaluation for the purpose of examining factors related to the effectiveness of scaling. The dissemination of research and evaluation findings will be achieved through the use of publications, blogs, social media, and conferences. It is anticipated that this project will broaden the participation of Hispanic, African-American, and English language learner girls, build capacity for STEM programming and sustainability at the dissemination sites, and disseminate findings to over 1 million educators, researchers, and community members. Broader impacts include contributing to the field's understanding of how virtual role models and field trips can engage young women, increase corporate advocacy, and engage participants in research and dissemination efforts.