This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
This proposal was submitted in response to EHR Core Research (ECR) program announcement NSF 15-509. The ECR program of fundamental research in STEM education provides funding in critical research areas that are essential, broad and enduring. EHR seeks proposals that will help synthesize, build and/or expand research foundations in the following focal areas: STEM learning, STEM learning environments, STEM workforce development, and broadening participation in STEM. The ECR program is distinguished by its emphasis on the accumulation of robust evidence to inform efforts to (a) understand, (b) build theory to explain, and (c) suggest interventions (and innovations) to address persistent challenges in STEM interest, education, learning, and participation.
The study will investigate the processes that connect gestures and mathematics learning. Gestures are an important yet under-investigated aspect of mathematics teaching. They can influence students' memory and understanding of mathematical representations. The series of studies will examine students' learning of the concept of mathematical equivalence by testing instruction that incorporates commonly used verbal explanations and gestures. Mathematical equivalence includes understanding the meaning of the equal sign and determining if two expressions are equal. Second and third grade children will be participants. Of particular interest in the studies is the influence of gestures on preexisting knowledge of procedures, how gestures support learning beyond emphasizing information and direct learners' attention, and the creation of procedural knowledge.
The series of experimental studies will examine the mechanisms that connect gestures and procedural understanding of mathematical equivalence. The studies begin in the first phase with examining how gesture is connected to procedural knowledge of mathematical equivalence. Subsequent studies investigate how gesture functions as a mechanism for learning beyond emphasizing or directing attention to relevant information. Data collected will students' responses to equivalence problems and eye tracking data to follow whether students are looking from one side of the equal sign to the other. In the second phase of the work, the studies will examine how gesture has beneficial effects on learning more generally in mathematics. Working memory will be assessed in order to examine the role of gesture across different individuals. Fraction tasks will be used to examine the generalization of the previous results regarding gestures to other mathematics concepts.
Purpose: Purpose: This project team will fully develop and test Teachley Connect, a platform that syncs a variety of third-party math games to give elementary schools formative assessment data and intervention support. Mobile math games provide opportunities for students to access educationally-meaningful content in and out of the classroom and to supplement instruction. There are a number of examples of math apps that show promise for supporting and assessing student learning in different areas of mathematics, yet few apps in the marketplace provide meaningful data that teachers can use. Many games provide an overall score at the end of the session, but do not help teachers know what skills students are struggling with or how to provide additional support.
Project Activities: During Phase I, (completed in 2015), the team developed a prototype of Teachley Connect, which enables the secure transfer of game and learning data between third-party math games and the Teachley servers. At the end of Phase I, researchers completed a pilot study with 20 students and two teachers and demonstrated that the prototype operated as intended with important trends indicating that the system promotes student engagement and less time spent seeking help. In Phase II, the team will add additional third party math apps to the platform, strengthen the backend management system to tag user game-play data, and build out the teacher reporting dashboard to inform instruction and identify apps to address particular student and class needs. After development is complete, the research team will conduct a larger pilot study to assess the feasibility and usability, fidelity of implementation, and the promise of the Teachley Connect for teachers to use formative assessment data to inform classroom practice, select apps to address individual student needs, and support student math learning. The study will include 12 (grade K to 3) classrooms and randomly assign them into one of three groups: 1) apps only, 2) Teachley-enabled apps, or 3) Teachley-enabled apps + data. Researchers will compare pre-and-post scores of student's math learning, classroom observations, and teacher surveys/interviews.
Product: Teachley Connect will be a mobile tablet-based platform that uses games to give elementary schools rich formative assessment data and intervention support. Teachley Connect will permit students to continue playing exactly where they left off on any tablet. The platform will also connect apps into a single teacher dashboard, providing teachers detailed reports on student performance across games, with insights for informing individual or whole group instruction. The platform will include teacher resources to support the alignment of game play with learning goals and to support implementation.
Purpose: The team will fully develop and test three puzzle-based math games that adaptively assess and support student learning in middle school classrooms. A principle objective of middle school math is to prepare students for more complicated and advanced STEM topics, providing the foundation for a wide variety of college majors and careers. Students who struggle in math in grade 5 and 6 are more likely to show deficits as coursework turns to topics in algebra. However, in many classrooms, commonly used progress monitoring instruments often do not adjust in ease or difficulty based on student performance, and do not provide data teachers can use to tailor instruction to meet the needs of students.
Project Activities: During Phase I (completed in 2015), the team developed a prototype of an adaptive engine for Wuzzit Trouble, a previously developed app where players rotate a virtual wheel to solve puzzles by applying number sense mathematical strategies. The engine tailors gameplay to the skill level of individual students in real time, providing tips and support to students having difficultly or by making challenges more difficult for those who master puzzles. The research team conducted a pilot study at the end of Phase I in order to test the prototype. A little more than 200 grade 5 and 6 students and six teachers participated over two weeks. Researchers found that the prototype functioned as intended and that teachers successfully used the game before, during, and after class as a supplement to instruction. They learned that 65% of students enjoyed using the prototype and 46% indicated that the game adjusted to the right level of difficulty during gameplay. In Phase II, the team will develop two new games on topics including algebraic thinking and problem solving, will strengthen and validate the adaptive engine, and will build out the dashboard to report formative and summative assessment results. After development is complete, the researchers will carry out a larger pilot study to assess the usability and feasibility, fidelity of implementation, and promise of the three games to improve student learning over a 9-week period. Thirty-two grade 5 and 6 math classrooms from 16 schools will participate. One classroom from each school will be randomly assigned to use the games and half will continue with business-as-usual procedures. The researchers will compare pre-and-post scores for student learning on standardized measures of pre-algebra topics. They will also track teacher implementation.
Product: The final product will include a suite of three app-based puzzle games aligned to national math standards for number sense, algebraic thinking, and problem solving. The games will be designed for use in grade 5 and 6 classrooms where students develop and apply content expertise to solving challenges. The games will include an adaptive engine that assesses and adjusts content based on student level of performance, a back-end system to organize data, and a reporting dashboard to present measures of student performance, persistence, and creativity. The project team will also develop teacher resources for suggesting how to incorporate games and activities into classroom instructional practice to reinforce lesson plans and learning.
In prior research and development, the project team and partners developed Cyberchase, a multimedia story-based series for students to practice and learn math. Researchers will develop and test a prototype of a mobile app-based fractions game to be integrated within the multimedia series. The prototype will adjust to students of different skill levels, and will present fractions in different representations (pictures, numbers, and words) to support different modes of learning. In the Phase I pilot, researchers will work with two grade 3 classrooms, and will examine whether the prototype functions as planned, if teachers are able to integrate the game into classroom practice, and whether the prototype shows promise for improving student learning of fractions.
Front-line staff are an integral part of the visitor experience at museums and science centers across the country, facilitating activities and programs, leading classes, and more. But do these staff make a difference for visitor learning? And what are the most effective facilitation strategies and approaches? In 2013, the Oregon Museum of Science and Industry (OMSI) received funding from the National Science Foundation for a three-year study, Researching the Value of Educator Actions for Learning (REVEAL), to begin to address these questions. Building on the Design Zone exhibition, REVEAL
PEEP and the Big Wide World/El Mundo Divertido de PEEP is a bilingual, NSF- funded public media project that uses animation, live-action videos, games, mobile apps, hands-on science activities to motivate preschool-age children to investigate the world around them. Online, PEEP extends children’s science and math learning with a mobile-friendly website that offers games, videos, and hands-on activities, as well as a collection of 15 apps. PEEP is also reaching children in preschool classrooms and family/home childcare settings via the PEEP Science Curriculum, which provides resources for a
This project was submitted in response to EHR Core Research (ECR) program announcement NSF 15-509. The ECR program of fundamental research in STEM education provides funding in critical research areas that are essential, broad and enduring. EHR seeks proposals that will help synthesize, build and/or expand research foundations in the following focal areas: STEM learning, STEM learning environments, STEM workforce development, and broadening participation in STEM. The ECR program is distinguished by its emphasis on the accumulation of robust evidence to inform efforts to (a) understand, (b) build theory to explain, and (c) suggest interventions (and innovations) to address persistent challenges in STEM interest, education, learning, and participation.
In 2015, average mathematics scores on the National Assessment of Educational Progress (NAEP) declined in fourth and eighth grades, the first declines in mathematics at these grade levels since 1990. Declines in U.S. mathematics performance has important implications for overall STEM education as well as STEM workforce and international competitiveness. Researchers at Rutgers University will conduct an analysis to isolate the cause of the mathematics decline by investigating the dimensionality of the NAEP assessment, state-level outcomes, and demographic trends.
The team will use multilevel item response theory modeling techniques to investigate the declines by examining the factor structures to determine dimensionality across years. Researchers will examine subscores corresponding to each dimension of the factor structure at the state and national levels. In addition, subscores will be examined for trends in individual states and jurisdictions. Potentially, the analyses will allow for examination of factors related to state standards adoptions, demographic shifts, and participation rates.
DATE:
-
TEAM MEMBERS:
Gregory Camilli
resourceprojectProfessional Development, Conferences, and Networks
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. The National Association of Math Circles (NAMC) will convene the Math Circle-Mentor and Partnership (MC-MAP) Workshop in late 2016. The proposed MC-MAP workshop will build the field's understanding of the training content and mechanisms that enhance the knowledge and skill development of participants in Math Circles. The workshop will bring mentors from experienced Math Circle leaders together with novice Math Circle leaders to develop the expertise of the notice leaders and their group to develop their expertise in facilitating math circle activities and in organizing related events. The approximately 180 Math Circles currently operating across the nation enlist mathematics professionals to share their passion for mathematics with K-12 students, teachers, and the general public in contexts that emphasize exploration, problem solving and discovery. This initial conference and Math Circle trainings informed by this conference will help build a community of practice around Math Circles through which novice and existing leaders are connected, encouraged and inspired.
The MC-MAP workshop will include structured planning as well as guided observation and structured debriefing of a demonstration Math Circle sessions. The workshop design will be grounded in research related to effective adult learning and to discovery-based mathematics. The workshop will serve as a training prototype that will assist the National Association of Math Circles to identify effective training formats and materials for both experienced and novice Math Circle leaders. Pre- and post- conference surveys of Math Circle leaders will produce data to be used in planning and designing future trainings. The NAMC will share key findings from the workshop evaluation and workshop resources not only with its membership, but also with other mathematics K-12 outreach programs. Workshop materials will address recruiting and serving diverse participants in Math Circles, including girls and women, persons with disabilities, students from varied socioeconomic backgrounds and underrepresented minorities in STEM.
The Wayne State University Math Corps is a mathematics enrichment and mentoring program that operates during summers and on Saturdays. The curriculum and the teach pedagogies in this informal learning program have documented success of supporting youths' mathematics learning as well as raising achievement levels in school. Through rigorous research and evaluation, this project seeks to analyze and understand the nature, extent, and reasons for Math Corps' success with youth learning in Detroit as well as the processes of program replication in three sites: Cleveland, OH; Utica, NY; and Philadelphia, PA. As such, this project will deepen understandings of program replication and of addressing the needs of youth in economically-challenged communities in order to promote mathematics learning.
The project's research studies will assess the multiple factors that make Math Corps successful with youth in Detroit and document the implementation of the program to the three replication sites. Research methods include discourse analyses, surveys, interviews, and pre/post-tests. The project will also conduct a retrospective evaluation of Math Corps based on quantitative datasets regarding both near-term and long-term youth outcomes.
This projects is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Steve KahnStephen ChrisomalisTodd KubicaCarol Philips-BeyFrancisca Richter
resourceprojectProfessional Development, Conferences, and Networks
The purpose of this proposal is to convene scholars at a two-day conference to closely examine validity-related measurement issues, create a guidelines for the field of mathematics education research that addresses key ideas (e.g., validity, validity arguments, evidence for validity and measurement at-scale), and set a clear pathway for scholars to discuss quantitative measurement within mathematics education. Invitees will include a mix of young, older and diverse scholars in mathematics education research. Products include refereed journal articles along with a website.
The workshop will engage the Mathematics Education, Policy, Statistical, Psychometrics and other education research communities in examining and critiquing measurement validity evidence of mathematics education research with the long-term goal of increasing the quality of quantitative inference in mathematics education research (to include improvements in the training of doctoral students).
DATE:
-
TEAM MEMBERS:
Jonathan BosticMichele Carney
resourceevaluationProfessional Development, Conferences, and Networks
The NISE Network Professional Impacts Summative Evaluation is a longitudinal examination of individual professionals over the final three years of NISE Net funding. This investigation is based on the NISE Network goals for professionals and explores how involvement with NISE Net impacts an individual professional’s sense of community, learning about nano, and use of nano educational products and practices. This evaluation primarily included professional partners who were: (1) Informal Science Educators (ISE): Professionals from science museums and children’s museums implementing informal