This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?
The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.
The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.
This project will expand the functions and applications of FieldScope, a web-based science information portal currently supported by the National Geographic Society (NGS). The goal is to create a single, powerful infrastructure for Public Participation in Science Research (PPSR) projects that any organization can use to create their own project and support their own community of participants. FieldScope currently provides various tools and applications for use by its existing user base that includes the GLOBE project and the Chesapeake Bay monitoring system. The application enables users to contribute volunteered geographic data collection efforts and sharing information among both professional and amateur users. The project would develop and test an enhanced version of the existing FieldScope application. The project supports major programming development for a fully-functional web-based application that would significantly enhance the usability of the current application. Along with programming new features and capabilities, the project involves extensive evaluation of the new capabilities and involves three citizen-based organizations as testbeds.
The project will increase the capability of the existing system to handle large numbers of users and user groups and also increase the number and variety of tools available to any user; provide customization through the adaption of common APIs; and provide for expansion of computer space through use of virtual servers in a cloud computing environment thereby limiting the need for installed hardware. This approach would maximize storage and computing power by being able to call on resources when necessary and scaling back when demand decreases. The platform would include advanced visualization capabilities as part of a suite of analytic tools available to the user. Social networking applications would also be incorporated as a way of enabling communication among users of a particular site. The operation of the portal would be supported by the NGS and made available free of charge to any group of users applying for space. Nominal fees will be applied to large organizations requiring large computing space or additional features. User groups can request NGS supply custom features for the cost of development and deployment.
The evaluation of this project is extensive and focused on formative evaluation as a means to identify user preferences, from look and feel of the site to types of tools desired and types of uses expected. The formative evaluation would be conducted ahead of any commitment to programming and formatting of the features of the site. The project responds to a need expressed throughout the citizen science community for web-based applications that enable individuals to engage in a topic of interest, interact in various ways on such a site including the submission of data and information, analyze the information in concert with others and with working scientists in the field, and utilize state-of-the-art tools such as visualization as a way of making sense of the data being collected. There have been numerous proposals to create similar types of sites from various groups, each based on its own perceived needs and grounded in its own particular discipline or topic. This activity could serve this community more broadly and save similar groups the trouble and expense of creating sites from scratch.