The Massachusetts Audubon Society will develop, pilot, and implement an evaluation framework for nature-based STEM programming that serves K-12 students visiting its network of nature centers and museums. Working with an external consultant, the society will develop the framework comprised of a logic model and theory of change for fieldtrips, and develop a toolkit of evaluation data collection methodology suitable to various child development stages. The project team will design and conduct three professional development training seminars to help Massachusetts Audubon school educators develop a working understanding of the new evaluation framework for school programs and gain the skills necessary to support protocol implementation. This project will result in the development and adoption of a universal protocol to guide the collection, management, and reporting of education program evaluation data across the 19 nature centers and museums in the Massachusetts Audubon system.
This workshop is funded through the "Dear Colleague Letter: Principles for the Design of Digital Science, Technology, Engineering, and Mathematics (STEM) Learning Environments (NSF 18-017)." In today's educational climate, organizations are creating physical learning spaces for hands-on STEM activities, often called makerspaces, co-working spaces, innovation labs, or fablabs. These spaces have evolved to be interdisciplinary centers that personalize learning for individual, diverse learners in collaborative settings. When designed well, these physical spaces create communities that contextualize learning around participants' goals and thus address STEM learning in a dynamic and integrated way. Participation in these learning environments encourages the cultivation of STEM identities for young people and can positively direct their career trajectories into STEM fields. This workshop will bring together a community of collaborators from multiple stakeholder groups including academia, public libraries, museums, community based organizations, non-profits, media makers and distribution channels, and educators within and beyond K-12 schools. Led by the University of Arizona, and held at Biosphere 2, an international research facility, participants will engage in activities that invite experimentation with distributed learning technologies to examine ways to adapt learning to the changing technological landscape and create robust, dynamic online learning environments. The workshop will culminate in a synthesis of design principles, assessment approaches, and tools that will be shared widely. Partnerships arising from the workshop will pave the way for sustained efforts in this area that span research and practice communities. Outcomes will address research and development of the next generation of digitally distributed learning environments.
The three day workshop convening will provide a unique forum to (1) exchange innovative ideas and share challenges and opportunities, (2) connect practical and research-based expertise and (3) form cross-institutional and cross-community partnerships that envision, propose, and implement opportunities for collecting and analyzing data to systematically inform the collective understanding. Participation-based activities will include design-based experiences, participatory activities, demonstrations of works in progress, prototyping, creative pitching, practitioner lightning talks, small group breakouts, hands-on design activities, and an 'unconference' style synthesis of bold ideas. Participants will be invited to experiment with distributed learning technologies. Five focus areas for the workshop include (1) inclusivity of learning spaces that invite multiple perspectives and full participation, (2) documenting learning in ways that are linked to outcomes and impacts for all learners, (3) implementing the use of new technologies in diverse settings, such as the workforce, (4) interpersonal interactions and peer-to-peer learning that may encourage a STEM career-path, and, (5) methods for collecting and analyzing data at the intersection of people, the learning environment, and new technologies at multiple levels. Outcomes of the workshop will serve to advance knowledge regarding critical gaps and opportunities and identify and characterize models of collaboration, networking, and innovation that operate within and across studio-based STEM learning environments.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
How can we begin to chart a course toward a future for science museums in which we maintain our status as sources of trusted information, while also fulfilling our potential as sites of genuine participation and social interaction? In 2019, with funding from the National Science Foundation, the New York Hall of Science hosted a three day conference to discuss new and equitable approaches to exhibit design. With leading exhibit designers, educators, researchers, and community engagement specialists, we began to rethink the exhibit design process, toward a goal of helping our museums become more
The National Science Foundation (NSF) funded the Research+Practice Collaboratory in 2012 to develop strategies for (1) making educational research more usable for educators, and (2) helping educators and researchers productively collaborate to advance research on educational effectiveness.
The Collaboratory comprised four partnering teams. Three of these teams were researchpractice partnerships (RPPs) that functioned as demonstration sites or “local labs.” Together, they pursued a shared commitment to improving quality and equity in STEM education while respectively, they selected different
DATE:
TEAM MEMBERS:
Kea AndersonTim PodkulCorinne SingletonCynthia D'Angelo
resourceprojectProfessional Development, Conferences, and Networks
The University of Washington, the Exploratorium, the Education Development Center, Inverness Research, and the University of Colorado - Boulder have come together to form a Research+Practice (R+P) Collaboratory. The Collaboratory seeks to address and reframe the gap between research and practice in K-12 STEM education. This gap persists despite decades of work by many leading organizations, associations, and individuals. Attempts to close the gap have generally focused on creating resources and mechanisms that first explain or illustrate "what research says" and then invite educators to access and integrate findings into practice. Recently, however, attention has turned to the ways in which the medical sciences are addressing the gap between research and clinical practice through the developing field of "translational research." In medicine, the strategy has been to shift the focus from adoption to adaptation of research into practice. Implicit in the notion of adaptation is a bi-directional process of cultural exchange in which both researchers and practitioners come to understand how the knowledge products of each field can strengthen the professional activities in the other. Along these lines, the R+P Collaboratory is working with leading professional associations and STEM improvement efforts to leverage their existing knowledge and experience and to build sustainable strategies for closing the gap. Activities include:
Collecting, creating and synthesizing translational research resources to expand STEM educators' and educational leaders' access and awareness to current relevant research.
Supporting multiple opportunities for cross-sector (research and practice; education and social sciences; formal and informal) meetings to foster critical engagement and cultural exchange.
Testing, documenting and innovating new resources and mechanisms at Adaptation Sites and disseminating both products and results through the R+P Resource Center.
The R+P Collaboratory is developing an online 'Go-To' Resource Center website that houses the resources collected, created, and curated by the Collaboratory. The Resource Center also has significant 'Take-Out' features, with all materials meta-tagged so that they can be automatically uploaded, reformatted, and integrated into the existing communication and professional development mechanisms (e.g., newsletters, digests, conferences, and websites) of a dozen leading professional associations within a Professional Association Partner Network.
In light of new and emerging standards in the STEM disciplines, the Collaboratory is focusing its work on four salient and timely bodies of research: (a) STEM Practices, (b) Formative Assessment, (c) Cyberlearning, and (d) Learning as a Cross-Setting Phenomenon. Special emphasis is being placed on research and practice that focuses on the learning of children and youth from communities historically underrepresented in STEM fields.
The work of the R+P Collaboratory includes research and evaluation of its own efforts through studies aimed at answering the following questions:
How are Collaboratory resources and engagement activities accessed, experienced and leveraged by participants?
What resources, mechanisms and learning contexts support cultural exchange among STEM education researchers and practitioners?
What new kinds of practices result when research-based evidence is adapted into evidence-based practices, and how does it change learning opportunities for K-12 aged children?
How can effective strategies, mechanisms and resources of the Collaboratory be scaled and adapted to new contexts?
This CAREER proposal focuses on the development of teachers' identities, which are operationalized as beliefs and practices, behaviors, and pedagogical knowledge. The PI uses a qualitative approach, occurring over two phases, to investigate the impact of formal-informal collaborations on identity development over time. The study is grounded in an ecological theoretical approach that incorporates a view of informal learning settings as learner-driven and unique in providing opportunities for interaction with objects during meaning-making experiences among groups of learners. The longitudinal research design includes collection of an array of data, including observations of teaching and learning activities, interviews, survey responses, and archival documents such as student work and videos of classroom experiences. The PI uses a narrative analysis and a grounded theoretical approach to generate themes about beliefs and practices around behaviors and pedagogical knowledge informed by informal science education experiences.
Research findings and related educational activities inform the field's understanding of best practices of integrating informal science activities into science teacher education, including determining appropriate kinds of support for STEM teachers who learn to teach in informal learning environments (ILE). The PI is integrating research findings in the revision of existing courses and the development of new courses and experiences for both new and experienced teachers. The project addresses the need for empirical evidence of impacts of ILE experiences on professional development, and will build capacity of informal science institution and university professionals to provide effective teacher education experiences and new teacher support.
Participants in this study reported a variety of resources used in the past to learn to code in Apex, including online tutorials, one-day classes sponsored by Salesforce, and meet-up groups focused on learning. They reported various difficulties in learning through these resources, including what they viewed as the gendered nature of classes where the men already seemed to know how to code—which set a fast pace for the class, difficulty in knowing “where to start” in their learning, and a lack of time to practice learning due to work and family responsibilities. The Coaching and Learning Group
Participants in this study reported a variety of resources used in the past to learn to code in Apex, including online tutorials, one-day classes sponsored by Salesforce, and meet-up groups focused on learning. They reported various difficulties in learning through these resources, including what they viewed as the gendered nature of classes where the men already seemed to know how to code—which set a fast pace for the class, difficulty in knowing “where to start” in their learning, and a lack of time to practice learning due to work and family responsibilities. The Coaching and Learning Group
Grassroots women's learn-to-code groups are springing up in many places. This infographic a study of one such group, in which more-knowledgeable "coaches" lead novice "learners" in learning software programming on the Salesforce platform. This study found that women create such groups to have supportive, non-threatening environments that nuture their learning to build confidence before entering male-dominated software development communities.
In this final chapter, we reflect on four themes that cut across the preceding chapters on evaluating outcomes in informal STEM education (ISE): validity, context, technology, and evaluation capacity building. We also note several topics that we hope will be addressed more extensively in future conversations about evaluation in ISE. These include the ethical responsibilities of evaluators, theory‐based approaches to evaluation, formal training and professional development pathways for evaluators, and funding opportunities and the structural landscape of the field.
This report summarizes the evaluation outcomes of the Collaborative Project Management (CoPM) Institute project, a two-day convening centered on bringing proven project management skills and approaches in the for-profit world to the informal science education (ISE) community to support effective collaborations and successful outcomes. The CoPM Institute was conceptualized as a pilot effort to test the effectiveness of porting of tools and frameworks for collaborative project management from the business/for-profit environment to advance the following project goals:
Build the capacity of