We present results of an experimental study of an urban, museum-based science teacher PD programme. A total of 125 teachers and 1676 of their students in grades 4–8 were tested at the beginning and end of the school year in which the PD programme took place. Teachers and students were assessed on subject content knowledge and attitudes towards science, along with teacher classroom behaviour. Subject content questions were mostly taken from standardised state tests and literature, with an ‘Explain:’ prompt added to some items. Teachers in the treatment group showed a 7% gain in subject content
"PLUM RX: Researching a new pathway for bringing active science exploration to urban families" is a project that makes use of public media resources to create innovative opportunities to bring environmental science learning to the hard-to-reach audience of urban families. As part of this project, media producers at WGBH and researchers at EDC worked together to: (1) develop a new pathway for bringing active environmental science exploration to urban families with children ages 6-9; (2) expand PLUM LANDING’s media assets to support urban families and informal educators when engaging in
This report looks across multiple phases of work to discuss the PLUM Rx project’s contribution to broader knowledge about supporting children’s active, outdoor science exploration in informal, urban settings. The PLUM LANDING Explore Outdoors Toolkit that resulted from this work is designed for use by outdoor prescription programs and a broad range of informal education programs serving urban children and families. This report describes (1) the rationale for the design principles that guided Toolkit development, (2) the Toolkit components developed in accordance with the design principles; and
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Informal STEM educational activities have proliferated widely in the US over the last 20 years. Additional research will further validate the long-term benefits of this mode of learning. Thus, elaborating the multitude of variables in informal learning and how those variables can be used for individual learning is yet to be defined for the circumstances of the learners. Thus, the primary objective of this work is to produce robust and detailed evidence to help shape both practice and policy for informal STEM learning in a broad array of common circumstances such as rural, urban, varying economic situations, and unique characteristics and cultures of citizen groups. Rather than pursuing a universal model of informal learning, the principal investigator will develop a series of comprehensive models that will support learning in informal environments for various demographic groups. The research will undertake a longitudinal mixed-methods approach of Out of School Time/informal STEM experiences over a five-year time span of data collection for youth ages 9-19 in urban, suburban, town, and rural communities. The evidence base will include data on youth experiences of informal STEM, factors that exert an influence on participation in informal STEM, the impact of participation on choices about educational pathways and careers, and preferences for particular types of learning activities. The quantitative data will include youth surveys, program details (e.g. duration of program, length of each program session, youth/facilitator ratio, etc.), and demographics. The qualitative data will include on-site informal interviews with youth and facilitators, and program documentation. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This third and final report reflects on the entire three-year grant period. It offers the External Review Team’s overall assessment and observations about the accomplishments and challenges experienced by the Child Trends Team while implementing the proof-of-concept study. It further presents several open questions and opportunities for future consideration.
This Research in Service to Practice project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
The project will research the educational impact of social robots in informal learning environments, with applications to how social robots can improve participation and engagement of middle-school girls in out-of-school computer science programs in under-resourced rural and urban areas. The use of robots to improve STEM outcomes has focused on having learners program robots as tools to accomplish tasks (e.g., play soccer). An alternate approach views robots as social actors that can respond intelligently to users. By designing a programmable robot with social characteristics, the project aims to create a culturally-responsive curriculum for Latina, African American, and Native American girls who have been excluded by approaches that separate technical skill and social interaction. The knowledge produced by this project related to the use and benefits of social programmable robots has the potential to impact the many after-school and weekend programs that attempt to engage learners in STEM ideas using programmable robot curricula.
The project robot, named Cozmo, will be programmed using a visual programming language and will convey emotion with facial expressions, sounds, and movements. Middle school girls will engage in programming activities, collaborative reflection, and interact with college women mentors trained to facilitate the course. The project will investigate whether the socially expressive Cozmo improves computer science outcomes such as attitudes, self-efficacy, and knowledge among the middle school female participants differently than the non-social version. The project will also investigate whether adding rapport-building dialogue to Cozmo enhances these outcomes (e.g., when a learner succeeds in getting Cozmo to move, Cozmo can celebrate, saying "I can move! You're amazing!"). These questions will be examined research conducted with participants in multi-session after-school courses facilitated by Girl Scout troops in Arizona. The project will disseminate project research and resources widely by sharing research findings in educational and learning science journals; creating a website with open source code for programming social robots; and making project curriculum and related guidelines available to Girl Scouts and other educational programs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Supported by the National Science Foundation, the Global Soundscapes! Big Data, Big Screens, Open Ears project employs a variety of informal learning experiences to present the physics of sound and the new science of soundscape ecology. The interdisciplinary science of soundscape ecology analyzes sounds over time in different ecosystems around the world. The major components of the Global Soundscapes project are an educator-led interactive giant-screen theater show, group activities, and websites. All components are designed with both sighted and visually impaired students in mind. Multimedia
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
DATE:
-
TEAM MEMBERS:
Maritza MacdonaldMeryle WeinsteinRosamond KinzlerMordecai-Mark Mac LowEdmond MathezDavid Silvernail
Many urban universities offer precollege STEM programs aimed at broadening participation in STEM. These programs are designed to increase students' scientific content knowledge and skills, promote STEM engagement, increase self-efficacy, and prepare underserved and underrepresented minority high school students for success in undergraduate programs. However, even after demonstrating significant knowledge gains and success in these programs, students are often unable to authenticate their knowledge gains to receive favorable consideration on college applications. In fact, there is currently no systematic credentialing mechanism to assess and validate the scientific rigor of and competency gains within STEM precollege programs for college admissions purposes. This NSF INCLUDES Design and Development Launch Pilot seeks to address this gap by developing and testing credentialing and badging processes for four STEM precollege programs. Working with College Admissions Officers and project partners, the University of Pittsburgh endeavors to employ a collaborative impact approach to build and document the collaborative infrastructure needed to support STEM precollege program authentication processes. This will seed the development of a networked improvement community that supports all aspects of the work from participant support to the collaborative impact to the greater network of urban education university ecosystems involved in the pilot.
Over a two-year period, this pilot will examine a mechanism to strengthen the STEM pathway for disadvantaged and underrepresented minority students to enter postsecondary STEM programs and eventually STEM careers. Building on two social innovation theories, the technical approach will focus on four specific aims: (1) create a community engagement framework to recruit underserved and underrepresented high school students to STEM precollege programs, (2) develop a STEM Success Matrix that identifies student competencies acquired in precollege programs that prepare students for collegiate success in STEM, (3) credential precollege programs using the STEM Success Matrix, and (4) develop a student badging system for precollege program participants using the STEM Success Matrix. Four University of Pittsburgh STEM precollege programs will serve as the context for development and testing with support from a range of partners representing the broader Pittsburgh STEM ecosystem. Approximately 300 high school students are expected to participate in the pilot, across the four precollege programs. Data will be collected via participant surveys and interviews. Formative and summative evaluations will be conducted by an experienced, external evaluator. Shareable metrics, tools, and processes will be developed and disseminated using various platforms and mechanisms. If successful, this pilot could be transformative - changing admissions considerations by credentialing STEM precollege programs and increasing student interest and motivation in STEM through student badging. It would also transform the STEM ecosystem of underserved and underrepresented minority students by creating an important STEM pathway from precollege to undergraduate admissions and ultimately, STEM Careers. This pilot could serve as a baseline for a more expansive alliance with other urban education ecosystems or assisting others interested in establishing their own collaborative infrastructure and networked improvement community model to achieve similar results.
DATE:
-
TEAM MEMBERS:
Alison Slinskey LeggJennifer IritiDavid BooneAlaine AllenLori Delale-O'Connor
resourceprojectProfessional Development, Conferences, and Networks
Aligning for Impact: Computer Science Pathways Across Contexts [CS-PAC] is an NSF INCLUDES Design and Development Launch Pilot. It broadens participation of students who are underrepresented in computer science by using the convening and policy-making power of the Georgia State Department of Education to coalesce school district leaders to implement K-12 computer science education. The project provides a national model for how to work toward systemic change. With the State Department of Education's coordination, several school districts will collaboratively seek improvements in their own student participation rates. The coordination of data reporting and analysis, resources, communications, and policy promote more equitable participation in computer science education. Research emerging from this project informs other states about how to collaboratively shape computer science education policy and policy implementation.
Using a Collective Impact approach to systemic change, the project creates sustainable institutional change at the community, state, and national levels. Qualitative and quantitative data provide descriptions about how to utilize alignment strategies within Collective Impact in three different contexts: rural, suburban, and urban. Outcomes utilize a regression discontinuity analysis to justify successful implementation as well as qualitative analysis of implementation efforts that were deemed most effective by all stakeholders. The project outputs directly affect over 88,000 students across five districts and indirectly affect over 1.7 million in Georgia alone. The culminating project goal is the development of a coherent framework for aligning K-12 computer science education pathways.
DATE:
-
TEAM MEMBERS:
Caitlin DooleyBryan CoxShawn Utley
resourceresearchWebsites, Mobile Apps, and Online Media
This brief discusses the PLUM LANDING Explore Outdoors Toolkit, a new set of free, public media resources designed to help informal educators and parents infuse science learning into outdoor recreation. Developed by trusted media producer WGBH in partnership with researchers at Education Development Center (EDC), the Toolkit aims to get children (ages 6–9) from low-income, urban communities outside so they can explore the environment around them while debunking the myth that nature is something that only exists beyond city limits.
DATE:
TEAM MEMBERS:
Marion GoldsteinElizabeth PiersonJamie KynnLisa Famularo