The Computational Thinking in Ecosystems (CT-E) project is funded by the STEM+Computing Partnership (STEM+C) program, which seeks to advance new approaches to, and evidence-based understanding of, the integration of computing in STEM teaching and learning. The project is a collaboration between the New York Hall of Science (NYSCI), Columbia University's Center for International Earth Science Information Network, and Design I/O. It will address the need for improved data, modeling and computational literacy in young people through development and testing of a portable, computer-based simulation of interactions that occur within ecosystems and between coupled natural and human systems; computational thinking skills are required to advance farther in the simulation. On a tablet computer at NYSCI, each participant will receive a set of virtual "cards" that require them to enter a computer command, routine or algorithm to control the behavior of animals within a simulated ecosystem. As participants explore the animals' simulated habitat, they will learn increasingly more complex strategies needed for the animal's survival, will use similar computational ideas and skills that ecologists use to model complex, dynamic ecological systems, and will respond to the effects of the ecosystem changes that they and other participants elicit through interaction with the simulated environment. Research on this approach to understanding interactions among species within biological systems through integration of computing has potential to advance knowledge. Researchers will study how simulations that are similar to popular collectable card game formats can improve computational thinking and better prepare STEM learners to take an interest in, and advance knowledge in, the field of environmental science as their academic and career aspirations evolve. The project will also design and develop a practical approach to programing complex models, and develop skills in communities of young people to exercise agency in learning about modeling and acting within complex systems; deepening learning in young people about how to work toward sustainable solutions, solve complex engineering problems and be better prepared to address the challenges of a complex, global society.
Computational Thinking in the Ecosystems (CT-E) will use a design-based study to prototype and test this novel, tablet-based collectable card game-like intervention to develop innovative practices in middle school science. Through this approach, some of the most significant challenges to teaching practice in the Next Generation Science Standards will be addressed, through infusing computational thinking into life science learning. CT-E will develop a tablet-based simulation representing six dynamic, interconnected ecosystems in which students control the behaviors of creatures to intervene in habitats to accomplish goals and respond to changes in the health of their habitat and the ecosystems of which they are a part. Behaviors of creatures in the simulation are controlled through the virtual collectable "cards", with each representing a computational process (such as sequences, loops, variables, conditionals and events). Gameplay involves individual players choosing a creature and habitat, formulating strategies and programming that creature with tactics in that habitat (such as finding food, digging in the ground, diverting water, or removing or planting vegetation) to navigate that habitat and survive. Habitats chosen by the participant are part of particular kinds of biomes (such as desert, rain forest, marshlands and plains) that have their own characteristic flora, fauna, and climate. Because the environments represent complex dynamic interconnected environmental models, participants are challenged to explore how these models work, and test hypotheses about how the environment will respond to their creature's interventions; but also to the creatures of other players, since multiple participants can collaborate or compete similar to commercially available collectable card games (e.g., Magic and Yu-Go-Oh!). NYSCI will conduct participatory design based research to determine impacts on structured and unstructured learning settings and whether it overcomes barriers to learning complex environmental science.
The Discovery Research K-12 program (DR-K12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. This project scales up the PBS NewsHour Student Reporting Labs (SRL), a model that trains teens to produce video reports on important STEM issues from a youth perspective. Participating schools receive a SRL journalism and digital media literacy curriculum, a mentor for students from a local PBS affiliate, professional development for educators, and support from the PBS NewsHour team. The production of news stories and student-oriented instruction in the classroom are designed to increase student learning of STEM content through student-centered inquiry and reflections on metacognition. Students will develop a deep understanding of the material to choose the best strategy to teach or tell the STEM story to others through digital media. Over the 4 years of the project, the model will be expanded from the current 70 schools to 150 in 40 states targeting schools with high populations of underrepresented youth. New components will be added to the model including STEM professional mentors and a social media and media analytics component. Project partners include local PBS stations, Project Lead the Way, and Share My Lesson educators.
The research study conducted by New Knowledge, LLC will add new knowledge about the growing field of youth science journalism and digital media. Front-end evaluation will assess students' understanding of contemporary STEM issues by deploying a web-based survey to crowd-source youth reactions, interest, questions, and thoughts about current science issues. A subset of questions will explore students' tendencies to pass newly-acquired information to members of the larger social networks. Formative evaluation will include qualitative and quantitative studies of multiple stakeholders at the Student Reporting Labs to refine the implementation of the program. Summative evaluation will track learning outcomes/changes such as: How does student reporting on STEM news increase their STEM literacy competencies? How does it affect their interest in STEM careers? Which strategies are most effective with underrepresented students? How do youth communicate with each other about science content, informing news media best practices? The research team will use data from pre/post and post-delayed surveys taken by 1700 students in the STEM Student Reporting Labs and 1700 from control groups. In addition, interviews with teachers will assess the curriculum and impressions of student engagement.
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. In the fall of 2014, Techbridge Girls began offering after-school programming at five elementary and two middle schools in the Highline Public School district, located near Seattle, WA.
Education Development Center is conducting the formative and summative evaluation of the
The historical under-representation of diverse youth in environmental science education is inextricably connected to access and identity-related issues. Many diverse youth with limited previous experience to the outdoors as a source for learning and/or leisure may consider environmental science as ‘unthinkable’. This is an ethnographic study of 16 diverse high school youths’ participation, none of who initially fashioned themselves as ‘outdoorsy’ or ‘animal people’, in a four-week summer enrichment program focused on herpetology (study of reptiles and amphibians). To function as ‘good’
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
The evaluation study supports the project Distance Learning Education Programs at the Saint Louis Zoo. To better understand what teachers want and need, and the characteristics of the settings in which their students learn, the Zoo conducted an online survey of the teachers of students with special needs in May 2014. The purpose of this evaluation was to clarify and expand the survey findings to support the design, development, and implementation of the Zoo distance learning curriculum so that it works effectively across a variety of school settings for K12 students with special needs and
This report presents findings from a formative evaluation of Science Education for New Civic Engagements and Responsibilities-Informal Science Education (SENCER-ISE), a National Science Foundation and Noyce Foundation funded initiative to support partnerships between informal science and higher education institutions. This evaluation looked primarily at the collaborative infrastructure of SENCER-ISE, which included the web site, SENCER Summer Institute, and communications with project staff and/or the advisory board. This evaluation is the third evaluation that Randi Korn & Associates, Inc
DATE:
TEAM MEMBERS:
RK&A, Inc.
resourceevaluationProfessional Development, Conferences, and Networks
The National Center for Science and Civic Engagement (NCSCE) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of its SENCER-ISE project partnerships. SENCER-ISE is an initiative that brings partners from higher education (HE) together with partners from informal science education (ISE) to create projects that engage audiences in science using the lens of civic engagement. SENCER funded 10 partnerships over three years—six through the National Science Foundation (DRL #1001795) and four through the Noyce Foundation. Previously, RK&A conducted a formative
The Cyberlearning and Future Learning Technologies Program funds efforts that will help envision the next generation of learning technologies and advance what we know about how people learn in technology-rich environments. Cyberlearning Exploration (EXP) Projects explore the viability of new kinds of learning technologies by designing and building new kinds of learning technologies and studying their possibilities for fostering learning and challenges to using them effectively. This project brings together two approaches to help K-12 students learn programming and computer science: open-ended learning environments, and computer-based learning analytics, to help create a setting where youth can get help and scaffolding tailored to what they know about programming without having to take tests or participate in rigid textbook exercises for the system to know what they know.
The project proposes to use techniques from educational data mining and learning analytics to process student data in the Alice programming environment. Building on the assessment design model of Evidence-Centered Design, student log data will be used to construct a model of individual students' computational thinking practices, aligned with emerging standards including NGSS and research on assessment of computational thinking. Initially, the system will be developed based on an existing corpus of pair-programming log data from approximately 600 students, triangulating with manually-coded performance assessments of programming through game design exercises. In the second phase of the work, curricula and professional development will be created to allow the system to be tested with underrepresented girls at Stanford's CS summer workshops and with students from diverse high schools implementing the Exploring Computer Science curriculum. Direct observation and interviews will be used to improve the model. Research will address how learners enact computational thinking practices in building computational artifacts, what patters of behavior serve as evidence of learning CT practices, and how to better design constructionist programming environments so that personalized learner scaffolding can be provided. By aligning with a popular programming environment (Alice) and a widely-used computer science curriculum (Exploring Computer Science), the project can have broad impact on computer science education; software developed will be released under a BSD-style license so others can build on it.
DATE:
-
TEAM MEMBERS:
Shuchi GroverMarie BienkowskiJohn Stamper
Education stakeholders from advocates to developers are increasingly recognizing the potential of science games in advancing student academic motivation for and interest in science and science careers. To maximize this potential, the project will use science games (e.g. Land Science, River City, and EcoMUVE), shown to be enjoyable to students and proven to promote student learning in science at the middle school level. Through a two-phase process, games will be used as vehicles for learning about ways to change how students think about science and potentially STEM careers. The goal of the intervention is to explore which processes and design features of science games will actually help students move beyond a temporary identity of being a scientist or engineer (as portrayed while playing the game) to one where students began to see themselves in real STEM careers. Students' participation will be guided by teams of teachers, faculty members, and graduate students from Drexel University and a local school. All science students attending the local inner city middle school in Philadelphia, PA, will participate in the intervention.
Using an exploratory mixed-method design, the first two years of the project will focus on exploring, characterizing, coding, and analyzing data sets from three large games designed to help students think about possible careers in science. During year 3, the project will integrate lessons learned from the first two years into the existing middle school science curriculum to engage students in a one-year intervention using PCaRD (Play Curricular activity Reflection Discussion). During the intervention, the PI will work with experts from Drexel University and a local school to collect data on the design features of Land Science to capture identity change in the science identity of the participating students. Throughout the course of year 3, the PI will observe, video, interview, survey, and use written tasks to uncover if the Land Science game is influencing students' identity in any way (from a temporary to a long-term perspective about being a scientist or engineer). Data collected during three specified waves during the intervention will be compared to analyses of existing logged data through collaborations with researchers at Harvard University and the University of Wisconsin-Madison. These comparisons will focus on similar middle-aged science students who used the same gaming environments as the students involved in this study. However, the researcher will intentionally look for characteristics related to motivation, science knowledge, and science identity change.
This project will integrate research and education to investigate learning as a process of change in student science identity within situated environmental contexts of digital science gameplay around curricular and learning activities. This integrated approach will allow the researcher to explore how gaming is inextricably linked to the student as an individual while involved in the learning of domain specific content in science. The collaboration among major university and school partners; the expertise of the researcher in educational psychology, educational technology, and science games; and the project's advisory board makes this a real-life opportunity for the researcher to use information that naturally exists in games to advance knowledge in the field about the value of gaming to changing students' science identities. It also responds to reports by the National Research Council committee on science learning and computer games, which identifies games as having the potential to catalyze new approaches to science learning.
This report is part of a four-year evaluation assessing the impact that the Working with a Scientist Program at the University of Texas at El Paso (UTEP) had on its first cohort of participants. Participants were students from a regional high school that were selected to take part in research activities every other Saturday during the Spring semester and on weekdays during the summer. The evaluation components included in this report focus on assessing students’ academic performance and the gains the students made while in the program. It also focused on an assessment of students’ perceptions
DATE:
TEAM MEMBERS:
Guadalupe CorralJacqueline LowereeJoseph Negron