The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
This project is a Smart and Connected Communities award. The community is part of Evanston, Illinois and is composed of the lead partners described below:
EvanSTEM which is a in-school/out of school time (OST) program to improve access and engagement for students in Evanston who have underperformed or been underrepresented in STEM.
McGaw YMCA which consists of 12,000 families serving 20,000 individuals and supporting technology and makerspace activities (MetaMedia) in a safe community atmosphere.
Office of Community Education Partnerships (OCEP) at Northwestern University which provides support for the university and community to collaborate on research, teaching, and service initiatives.
This partnership will develop a new approach to learning enagement through the STEAM (Science, Technology, Engineering, Arts, and Mathematics) interests of all young people in Evanston. This project is entitled Interests for All (I4All) and builds upon existing research results of the two Principal Investigators (PIs) and previous partnerships between the lead partners (EvanSTEM and MetaMedia had OCEP as a founding partner). I4All also brings together Evanston school districts, OST prividers, the city, and Evanston's Northwestern University as participants.
In particular the project builds on PI Pinkard's Cities of Learning project and co-PI Stevens' FUSE Studios project. Both of these projects have explicit goals to broaden participation in STEAM pursuits, a goal that is significantly advanced through I4All. In this project, I4All infrastructure will be evaluated using quantitative metrics that will tell the researchers whether and to what degree Evanston youth are finding and developing their STEAM interests and whether the I4All infrastructure supports a significantly more equitable distribution of opportunities to youth. The researchers will also conduct in depth qualitative case studies of youth interest development. These longitudinal studies will complement the quantitative metrics of participation and give measures that will be used in informing changes in I4All as part of the PIs Design Based Implementation Research approach. The artifacts produced in I4All include FUSE studio projects, software infrastructure to guide the students through OST and in-school activities and to provide to the students actionable information as to logistics for participation in I4All activities, and data that will be available to all stakeholders to evaluate the effectiveness of I4All. Additionally, this research has the potential to provide for scaling this model to different communities, leveraging the OST network in one community to begin to offer professional development more widely throughout the school districts and as an exemplar for other districts. These research results could also affect strategies and policies created by local school officials and community organizations regarding how to work together to create local learning environments to create an ecosystem where formal and informal learning spaces support and reinforce STEAM knowledge.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This CAREER proposal focuses on the development of teachers' identities, which are operationalized as beliefs and practices, behaviors, and pedagogical knowledge. The PI uses a qualitative approach, occurring over two phases, to investigate the impact of formal-informal collaborations on identity development over time. The study is grounded in an ecological theoretical approach that incorporates a view of informal learning settings as learner-driven and unique in providing opportunities for interaction with objects during meaning-making experiences among groups of learners. The longitudinal research design includes collection of an array of data, including observations of teaching and learning activities, interviews, survey responses, and archival documents such as student work and videos of classroom experiences. The PI uses a narrative analysis and a grounded theoretical approach to generate themes about beliefs and practices around behaviors and pedagogical knowledge informed by informal science education experiences.
Research findings and related educational activities inform the field's understanding of best practices of integrating informal science activities into science teacher education, including determining appropriate kinds of support for STEM teachers who learn to teach in informal learning environments (ILE). The PI is integrating research findings in the revision of existing courses and the development of new courses and experiences for both new and experienced teachers. The project addresses the need for empirical evidence of impacts of ILE experiences on professional development, and will build capacity of informal science institution and university professionals to provide effective teacher education experiences and new teacher support.
Given the growth of technology in the 21st century and the growing demands for computer science skills, computational thinking has been increasingly included in K-12 STEM (Science, Technology, Engineering and Mathematics) education. Computational thinking (CT) is relevant to integrated STEM and has many common practices with other STEM disciplines. Previous studies have shown synergies between CT and engineering learning. In addition, many researchers believe that the more children are exposed to CT learning experiences, the stronger their programming abilities will be. As programming is a
Computational Thinking (CT) is a relatively new educational focus and a clear need for learners as a 21st century skill. This proposal tackles this challenging new area for young learners, an area greatly in need of research and learning materials. The Principal Investigators will develop and implement integrated STEM+C museum exhibits and integrate CT in their existing engineering design based PictureSTEM curriculum for K-2 students. They will also pilot assessments of the CT components of the PictureSTEM curriculum. This work will make a unique contribution to the available STEM+C learning materials and assessments. There are few such materials for the kindergarten to second grade (K-2) population they will work with. They will research the effects of the curriculum and the exhibits with a mixed methods approach. First, they will collect observational data and conduct case studies to discover the important elements of an integrated STEM+C experience in both the formal in-school setting with the curriculum and in the informal out-of-school setting with families interacting with the museum exhibits. This work will provide a novel way to understand the important question of how in- and out-of-school experiences contribute to the development of STEM and CT thinking and learning. Finally, they will collect data from all participants to discover the ways that their activities lead to increases in STEM+C knowledge and interest.
The Principal Investigators will build on an integrated STEM curriculum by integrating CT and develop integrated museum exhibits. They base both activities on engineering design implemented through challenge based programming activities. They will research and/or develop assessments of both STEM+C integrated thinking and CT. Their research strategy combines Design Based Research and quantitative assessment of the effectiveness of the materials for learning CT. In the first two years of their study, they will engage in iterations on the design of the curriculum and the exhibits based on observation and case-study data. There will be 16 cases that draw from each grade level and involve data collection for the case student in both schools and museums. They will also use this work to illuminate what integrated STEM+C thinking and learning looks like across formal and informal learning environments. Based in some part on what they discover in this first phase, they will conduct the quantitative assessments with all (or at least most) students participating in the study
The goal of our research is to identify strengths and weaknesses of high school level science fair and improvements that might enhance learning outcomes based on empirical assessment of student experiences. We use the web-based data collection program REDCap to implement anonymous and voluntary surveys about science fair experiences with two independent groups -- high school students who recently competed in the Dallas Regional Science and Engineering Fair and post high school students (undergraduates, 1st year medical students, and 1st year biomedical graduate students) on STEM education
This Conference Paper was presented at the International Soceity for the Learning Sciences Confernece in June 2018. We summarize interviews with youth ages 9-15 about their failure mindsets, and if those midsets cross boundaries between learning environments.
Previous research on youth’s perceptions and reactions to failure established a view of failure as a negative, debilitating experience for youth, yet STEM and in particular making programs increasingly promote a pedagogy of failures as productive learning experiences. Looking to unpack perceptions of failure across contexts and
Making is a recent educational phenomenon that is increasingly occurring in schools and informal learning spaces around the world. In this paper we explore data from maker educators about their experiences with failure. We surveyed maker educators about how they view failure happening with youth in their formal and informal programs and how they respond. The results reveal some concrete strategies that seem to show promise for helping educators increase the likelihood that failure experiences for youth can lead to gains in learning and persistence.
This article summarizes a survey of formal
This exploratory learning research and design project will study how to use emerging technologies to help document practices in maker-based learning experiences. Despite its established potential for consolidating learning and sense-making, project documentation is often overlooked, not prioritized or seen as burdensome and therefore not integrated into the learning experiences. The project team seeks to understand and address with practice partners the barriers to documentation by systematically exploring how to physically embed and incorporate smart tools and documentation practices into learning environments, specifically creative hands-on learning spaces, like makerspaces. The goal is to understand how to scaffold learners to become more aware, reflective and attentive to their progress towards learning outcomes by embedding supportive tools physically in space as the actions unfold. Making and maker-based learning experiences offer tremendous opportunities to more fully engage diverse learners in STEM education and build a workforce prepared for innovation. Documentation of these learning experiences, both as an authentic practice that professionals engage in as well as an assessment practice for instruction, is often not supported. The project will create open source documentation for solutions and develop supporting case studies, web resources and guides to facilitate easy uptake and adoption of promising approaches.
This proposal will make significant research contributions in three ways: (1) develop and iteratively test a suite of embedded "smart" tools designed to scaffold, manage and trace process documentation practices; (2) study the integration of these tools in formal and informal activities and programs settings and characterize their influence on instruction and the assessment of learning outcomes; (3) establish a set of rubrics based on learner data streams to aid instruction and mark learner progress. Improving documentation practices and the assessment of learning outcomes will advance making as a core STEM educational activity. Through a better understanding of why and how to place networked documentation tools sensitive to space, time and context cues, the threshold for enactment and scaffolded usage can be lowered in a broader range of settings. Ultimately, this exploratory project will not only develop an integrated set of situated documentation tools, but also help us develop hypotheses for how documentation as a mediating process productively supports learning.
The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. The Multimedia Immersion (MI) project is will develop, pilot, and evaluate a nine-week STEM-rich multimedia production course for high school students. MI will make important contributions to the field through its efforts to design and evaluate the promises and challenges of a nine-week multimedia curriculum in multiple urban high schools. The MI course will engage teams of students to develop a personally and socially relevant storyline that guides their use of accessible audio and video technologies to create a five-minute animated video. To develop student STEM experience and provide technical support, the project will provide guidance and learning experiences in engineering (e.g., criteria, constraints, optimization, tradeoffs), science (e.g. sound, light, energy, mechanics) and multimedia technologies (e.g., computer based audio production, video editing and visualizations through animatics (i.e., shooting a succession of storyboards with a soundtrack). animatics).
Because the curriculum situates engineering and science learning in the context of multimedia production, there are natural synergies with several existing high school courses including engineering design, audio/video media production, and multimedia technology. Although these courses are typically electives in high school, developing a 5-minute animated short on a topic of interest may encourage girls and students from underrepresented groups to select this course over other electives. MI will impact 10 teachers and approximately 250 high school students per year. The project will result in the following resources: nine-week curricular unit (multimedia, science, engineering); assessments to monitor student learning of science, engineering and technology (design logs); and research on changes in student knowledge, interest, and a nine-week curricular unit (multimedia, science, engineering). Project resources will be disseminated to teachers, researchers, and curriculum and professional development providers via conference presentations, publications, and online webinars.
The MI project builds on student familiarity and interest in music, video and technology to promote an: (1) understanding of engineering design and physics and an (2) an appreciation of the fundamental role of STEM in popular culture. Project evaluation will be conducted using student surveys and an examination of work products in conjunction with implementation challenges and successes to generate evidence for the feasibility and utility of a high school multimedia course that explicitly addresses science and engineering learning. Project evaluation will use student design logs as a window into student design processes and conceptual understanding. Student design logs are an essential feature of MI curriculum design. With an appropriate structure, these design logs can inform teaching, afford an opportunity for students to reflect on their own work, and provide evidence of student thinking and learning for assessment purposes. Using student design logs as a window into students? design process and conceptual understanding is an important contribution to the engineering education community which has few options for measuring student knowledge in ways that are consistent with the hands-on, iterative nature of the design process.
The goals of the project were to build an understanding about the perception of career and technical education (CTE) as an option for middle school students in pursuing skill-based STEM-related careers, and to use that information to develop an innovative suite of digital tools designed to improve mentors’ and school counselors’ communication with middle school–aged students.
Informal STEM education needs high quality program evaluation. Research is particularly needed on the relationship between STEM outcomes and positive youth development (PYD) / socio-emotional learning (SEL). This pilot and feasibility project involves a collaboration between experts in STEM education, out-of-school time programs (OST), PYD, SEL, evaluation, and program development. STEM Scouts helps youth grow in character and develop skills using experiential activities and interaction with STEM professionals. This project expands the implementation of the Systems Evaluation Protocol (SEP), an evidence-based approach to evaluation planning.
The goals are to: 1) develop a theory of change for STEM Scouts highlighting the relationship between STEM outcomes and PYD/SEL outcomes; 2) pilot enhancements to the SEP (System Mapping, Ecosystem Modeling, and Model Validation); and, 3) determine the feasibility of conducting a national STEM Scouts study. STEM Scouts leadership and project researchers will work through the SEP to generate a stakeholder map, logic model, and pathway model (PM). Five STEM Scouts Labs across the country will participate in focus groups where they will complete SM to identify the system in which the Lab exists (e.g., stakeholders and decision-makers), review and revise their system maps, identify key outcomes and connections in the PM, and discuss how the PM reflects their STEM Scouts experiences. It is hypothesized the enhanced SEP will enable the working group to better understand factors hindering or enabling program and evaluation feasibility and success. Findings will be disseminated to the evaluation/research community, OST program providers/developers and the public.
This project is funded by the National Science Foundation's Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Many urban New Yorkers believe that the Hudson River is so polluted that nothing could possibly live there. In reality, the estuary is thriving, and The River Project (TRP), a marine science field station in lower Manhattan, exists to showcase its vast biodiversity through place-based education. In 2014, TRP began collaborating on a city-wide initiative with New York Harbor Foundation and eight other partner organizations to integrate restoration science into Title I middle school curricula through the Curriculum and Community Enterprise for Restoration Science (CCERS). Teachers in the
DATE:
TEAM MEMBERS:
Elisa CarefMelissa RexAnnie LederbergGaylen Moore