The Council for Opportunity in Education, in collaboration with TERC, seeks to advance the understanding of social and cultural factors that increase retention of women of color in computing; and implement and evaluate a mentoring and networking intervention for undergraduate women of color based on the project's research findings. Computing is unique because it ranks as one of the STEM fields that are least populated by women of color, and because while representation of women of color is increasing in nearly every other STEM field, it is currently decreasing in computing - even as national job prospects in technology fields increase. The project staff will conduct an extensive study of programs that have successfully served women of color in the computing fields and will conduct formal interviews with 15 professional women of color who have thrived in computing to learn about their educational strategies. Based on those findings, the project staff will develop and assess a small-scale intervention that will be modeled on the practices of mentoring and networking which have been established as effective among women of color who are students of STEM disciplines. By partnering with Broadening Participation in Computing Alliances and local and national organizations dedicated to diversifying computing, project staff will identify both women of color undergraduates to participate in the intervention and professionals who can serve as mentors to the undergraduates in the intervention phase of the project. Assisting the researchers will be a distinguished Advisory Board that provides expertise in broadening the representation of women of color in STEM education. The external evaluator will provide formative and summative assessments of the project's case study data and narratives data using methods of study analysis and narrative inquiry and will lead the formative and summative evaluation of the intervention using a mixed methods approach. The intervention evaluation will focus on three variables: 1) students' attitudes toward computer science, 2) their persistence in computer science and 3) their participant attitudes toward, and experiences in, the intervention.
This project extends the PIs' previous NSF-funded work on factors that impact the success of women of color in STEM. The project will contribute an improved understanding of the complex challenges that women of color encounter in computing. It will also illuminate individual and programmatic strategies that enable them to participate more fully and in greater numbers. The ultimate broader impact of the project should be a proven, scalable model for reversing the downward trend in the rates at which women of color earn bachelor's degrees in computer science.
The goal of the project is to advance understanding of basic questions about learning and teaching through the development of a theory of embodied mathematical cognition that can apply to a broad range of people, settings and activities. The investigative team brings together expertise from a range of quantitative and qualitative research methodologies. A theory of embodied mathematical cognition empirically rooted in classroom learning and workplace practices will broaden the range of activities and emerging technologies that count as mathematical, and help educators to envision alternative forms of bodily engagement with mathematical problems.
DATE:
-
TEAM MEMBERS:
Ricardo NemirovskyRogers HallMartha AlibaliMitchell NathanKevin Leander
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
resourceprojectProfessional Development, Conferences, and Networks
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
Education stakeholders from advocates to developers are increasingly recognizing the potential of science games in advancing student academic motivation for and interest in science and science careers. To maximize this potential, the project will use science games (e.g. Land Science, River City, and EcoMUVE), shown to be enjoyable to students and proven to promote student learning in science at the middle school level. Through a two-phase process, games will be used as vehicles for learning about ways to change how students think about science and potentially STEM careers. The goal of the intervention is to explore which processes and design features of science games will actually help students move beyond a temporary identity of being a scientist or engineer (as portrayed while playing the game) to one where students began to see themselves in real STEM careers. Students' participation will be guided by teams of teachers, faculty members, and graduate students from Drexel University and a local school. All science students attending the local inner city middle school in Philadelphia, PA, will participate in the intervention.
Using an exploratory mixed-method design, the first two years of the project will focus on exploring, characterizing, coding, and analyzing data sets from three large games designed to help students think about possible careers in science. During year 3, the project will integrate lessons learned from the first two years into the existing middle school science curriculum to engage students in a one-year intervention using PCaRD (Play Curricular activity Reflection Discussion). During the intervention, the PI will work with experts from Drexel University and a local school to collect data on the design features of Land Science to capture identity change in the science identity of the participating students. Throughout the course of year 3, the PI will observe, video, interview, survey, and use written tasks to uncover if the Land Science game is influencing students' identity in any way (from a temporary to a long-term perspective about being a scientist or engineer). Data collected during three specified waves during the intervention will be compared to analyses of existing logged data through collaborations with researchers at Harvard University and the University of Wisconsin-Madison. These comparisons will focus on similar middle-aged science students who used the same gaming environments as the students involved in this study. However, the researcher will intentionally look for characteristics related to motivation, science knowledge, and science identity change.
This project will integrate research and education to investigate learning as a process of change in student science identity within situated environmental contexts of digital science gameplay around curricular and learning activities. This integrated approach will allow the researcher to explore how gaming is inextricably linked to the student as an individual while involved in the learning of domain specific content in science. The collaboration among major university and school partners; the expertise of the researcher in educational psychology, educational technology, and science games; and the project's advisory board makes this a real-life opportunity for the researcher to use information that naturally exists in games to advance knowledge in the field about the value of gaming to changing students' science identities. It also responds to reports by the National Research Council committee on science learning and computer games, which identifies games as having the potential to catalyze new approaches to science learning.
This project, conducted by the University of Pittsburgh and the University of California, Berkeley, seeks to discover what makes middle school students engaged in science, technology, engineering, and mathematics (STEM). The researchers have developed a concept known as science learning activation, including dispositions, practices, and knowledge leading to successful STEM learning and engagement. The project is intended to develop and validate a method of measuring science learning activation.
The first stage of the project involves developing the questions to measure science activation, with up to 300 8th graders participating. The second stage is a 16-month longitudinal study of approximately 500 6th and 8th graders, examining how science learning activation changes over time. The key question is what are the influencers on science activation, e.g., student background, classroom activities, and outside activities.
This project addresses important past research showing that middle school interest in STEM is predictive of actually completing a STEM degree, suggesting that experiences in middle school and even earlier may be crucial to developing interest in STEM. This research goes beyond past work to find out what are the factors leading to STEM interest in middle school.
This work helps the Education and Human Resources directorate, and the Division of Research on Learning, pursue the mission of supporting STEM education research. In particular, this project focuses on improving STEM learning, as well as broadening participation in STEM education and ultimately the STEM workforce.
Purpose: The United States (U.S.) has traditionally produced the world’s top research scientists and engineers, leading to breakthrough advances in science and technology. Despite the importance of STEM careers, many U.S. students are not graduating with strong STEM knowledge, skills or interests, and the percentage of students prepared for or pursuing STEM degrees or careers is declining. Research shows that the decreased interest in STEM typically begins in the middle school years, pose significant academic and social challenges for students. This project will develop a web-based game teach 6th to 8th students key scientific inquiry skills, along with the academic mindsets and learning strategies to facilitate engagement and effective science learning.
Project Activities: The researchers will create a prototype by mapping key Next Generation Science Standards and learning goals with concepts and content, and producing a game design document. Following completion of the prototype, the researchers will finalize the server architecture, create the core code systems, concept art, and develop a prototype in order to simulate the final user experience. Iterative refinements will be conducted as needed at major production milestones until the game is fully functional. Once development is complete, the research team will assess the usability and feasibility, fidelity of implementation, and the promise of the game to improve outcomes in a pilot study. In this study, 200 students in 10 classes will participate, with 5 of the classrooms randomly assigned to use the game and 5 who will proceed as normal. All students will complete pre- and post- program surveys assessing their academic mindsets, learning strategies, and science skills.
Product: This project will develop SciSkillQuest, a web-based multiplayer game intended to teach middle school students scientific inquiry skills and to foster academic growth mindsets in science. Students will pursue quests, employing inquiry skills to navigate and succeed in the game, including Questioning, Modeling, Investigating, Analyzing, Computing, Explaining, Arguing, and Informing. The game will include different paths to a solution, role playing elements, immersive narratives, challenge-based progressions, and peer collaboration to engage players. The growth mindset message — that ability and skill are developed through effort and learning — will be introduced and reinforced through feedback by embedded in-game characters. The games will be supplemental to the curriculum but will also be designed to be integrated within instructional practice. The game will be available for mobile devices as well as web browsers.
Purpose: An estimated 5 to 8% of elementary school students have some form of memory or cognitive deficit that inhibits learning basic math. Researchers have identified several areas where children with math learning difficulties struggle. These include a strong sense of number facts to quickly and accurately perform operations on single digit numbers, the use of strategies to solve problems which have not yet been memorized, a sense to figure out whether or not an answer is reasonable, and self-monitoring to assess one's own efficacy and understanding. To support students with math learning difficulties in grades 1 to 4, this project team will develop a series of apps for touch-screen tablets that encourage single digit operational fluency, conceptual understanding, strategy awareness, and self-understanding.
Project Activities: During Phase I project in 2012, the research team developed a prototype of the single digit addition game, following an iterative process incorporating feedback from teachers and students having difficulty with math. Nineteen students participated in a pilot study, and the researchers found that the prototype functioned well and that users were engaged by the game. In Phase II, the team will build and refine the back end system, design and develop the teacher website, and create content for games in subtraction, multiplication, and division. Researchers will carry out a pilot test of the usability and feasibility, fidelity of implementation, and promise of the game to improve learning. Students in first to fourth grade identified by teachers as having the greatest difficulty with math will participate in the pilot study. Half of the 120 students participating in the pilot study will be randomly selected to play the game as a supplement to classroom learning whereas the other half will not have access. Students in the control group will be provided the games at the end of the study. Analyses will compare pre- and post-test math scores.
Product: The web-based game, MathFacts, will include a series of apps for touch-screen tablet computers to support math learning for 1st to 4th grade students with major or sometimes intractable learning difficulties. In the game, students will learn content through mini-lessons, engage with problems in practice and speed rounds, and then receive formative feedback on their performance. Students will use and manipulate blocks, linker tubes, number lines, and interact with engaging pedagogical agents such as parrots and sloths. Students will set goals, advance to more challenging levels, and engage in competition. The game will be self-paced and will provide individualized formative assessment scaffolding when students do not know the answer to a question. A teacher management system will support professional development and will produce reports to guide instruction. The intended outcomes from gameplay will include increased fluency, conceptual understanding, strategy awareness, self-assessment, and motivation of basic math.
In late 2012, Providence Children’s Museum began a major three-year research project in collaboration with The Causality and Mind Lab at Brown University, funded by a grant from the National Science Foundation (1223777). Researchers at Brown examined how children develop scientific thinking skills and understand their own learning processes. The Museum examined what caregivers and informal educators understand about learning through play in its exhibits and how to support children’s metacognition – the ability to notice and reflect on their own thinking – and adults’ awareness and appreciation of kids’ thinking and learning through play. Drawing from fields like developmental psychology, informal education and museum visitor studies, the Museum’s exhibits team looked for indicators of children’s learning through play and interviewed parents and caregivers about what they noticed children doing in the exhibits, asking them to reflect on their children’s thinking. Based on the findings, the research team developed and tested new tools and activities to encourage caregivers to notice and appreciate the learning that takes place through play.
With funding from the U.S. Institute of Museum and Library Services, the Association of Children’s Museums and the University of Washington’s Museology Graduate Program are leading a two phased project focused on developing a collective, evidence-based body of knowledge in order to better define the learning value of children’s museums. The first phase of the project titled, Building a Field-Wide Research Agenda, began in the fall of 2012. The goal was to generate a field-wide research agenda for children’s museums. In the fall of 2013 researchers, evaluators, educators, administrators, academics, contractors, and other affiliate professionals from the children’s museum field gathered in Washington D.C. for a two-day symposium which was followed by a series of webinars intended to invite broader participation from the whole children’s museum field. As a result the Learning Value of Children’s Museums Research Agenda was developed. The second phase of the project titled, Building a Practicing Research Network in the Children’s Museum Field, started in October 2014. The goal is to develop a sustainable infrastructure for cross-institutional research activities guided by the recently developed Learning Value of Children’s Museums Research Agenda. In the winter of 2015 a cohort of ten children’s museums was selected to form a network working to identify collaborative research projects that respond to the priorities in the research agenda, conduct research projects across multiple institutions in the research network, and aggregate data to share with the broader children's museum field. The work of the network is ongoing and new information will be made available to the field as we progress.
This project takes an ethnographic and design-based approach to understanding how and what people learn from participation in makerspaces and explores the features of those environments that can be leveraged to better promote learning. Makerspaces are physical locations where people (often families) get together to make things. Some participants learn substantial amounts of STEM content and practices as they design, build, and iteratively refine working devices. Others, however, simply take a trial and error approach. Research explores the affordances are of these spaces for promoting learning and how to integrate technology into these spaces so that they are transformed from being makerspaces where learning happens, but inconsistently, into environments where learning is a consistent outcome of participation. One aim is to learn how to effectively design such spaces so that participants are encouraged and helped to become intentional, reflective makers rather than simply tinkerers. Research will also advance what is known about effective studio teaching and learning and advance understanding of how to support youth to help them become competent, creative, and reflective producers with technology(s). The project builds on the Studio Thinking Framework and what is known about development of meta-representational competence. The foundations of these frameworks are in Lave and Wengers communities of practice and Rogoff's, Stevens et al.'s, and Jenkins et al.'s further work on participatory cultures for social networks that revolve around production. A sociocultural approach is taken that seeks to understand the relationships between space, participants, and technologies as participants set and work toward achieving goals. Engaging more of our young population in scientific and technological thinking and learning and broadening participation in the STEM workplace are national imperatives. One way to address these imperatives is to engage the passions of young people, helping them recognize the roles STEM content and practices play in achieving their own personal goals. Maker spaces are neighborhood spaces that are arising in many urban areas that allow and promote tinkering, designing, and construction using real materials, sometimes quite sophisticated ones. Participating in designing and successfully building working devices in such spaces can promote STEM learning, confidence and competence in one's ability to solve problems, and positive attitudes towards engineering, science, and math (among other things). The goal in this project is to learn how to design these spaces and integrate learning technologies so that learning happens more consistently (along with tinkering and making) and especially so that they are accessible and inviting to those who might not normally participate in these spaces. The work of this project is happening in an urban setting and with at-risk children, and a special effort is being made to accommodate making and learning with peers. As with Computer Clubhouses, maker spaces hold potential for their participants to identify what is interesting to them at the same time their participation gives them the opportunity to express themselves, learn STEM content, and put it to use.
This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?
The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.
The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.