Skip to main content

Community Repository Search Results

resource evaluation Public Programs
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12. During the third regional workshop in Columbus, Ohio, the NFB operated two different programs simultaneously: one program for youth, and a second program for their parents/caregivers. A third program, for COSI (science center) staff, was conducted earlier to prepare the museum staff to assist with the youth program. A separate report will discuss
DATE:
TEAM MEMBERS: National Federation for the Blind Mary Ann Wojton Joe E Heimlich
resource project Public Programs
A partnership between Carthage College and the Appalachian Mountain Club has delivered a successful public education and outreach program that merges natural environment topics and astronomy. Over the four years of activity, over 25,000 people have received programming. The effort has trained nature educators, permanent and seasonal AMC staff, and undergraduate physics and astronomy students to integrate diverse topical material and deliver high quality programming to the lay public. Unique to the program is the holistic nature of the material delivered - an 'atypical' astronomy program. Linking observable characteristics of the natural world with astronomical history and phenomena, and emphasizing the unique sequence of events that have led to human life on Earth, the program has changed attitudes and behaviors among the public participants. Successful interventions have included hands-on observing programs (day and night) that link nature content to the observed objects; table-talk presentations on nature/astronomy topics; dark skies preservation workshops; and hands-on activities developed for younger audiences, including schools, camps, and family groups. An extensive evaluation and assessment effort managed by a leading sociologist has demonstrated the effectiveness of the approach, and contributed to continuous improvement in the program content and methods.
DATE: -
TEAM MEMBERS: Douglas Arion
resource project Professional Development, Conferences, and Networks
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
DATE: -
resource project Media and Technology
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
DATE: -
TEAM MEMBERS: Beth McGinnis-Cavanaugh Glenn Ellis Alan Rudnitsky Isabel Huff
resource evaluation Exhibitions
The Robert R. McCormick Foundation contracted RK&A to conduct a formative evaluation of the Freedom Express mobile museum program to assess the degree to which the program supports students toward the achievement of stated civic engagement-related outcomes. How did we approach this study? The evaluation was designed to explore the extent to which students demonstrate desired outcomes after experiencing the Freedom Express program and to identify the extent to which teachers value and recognize the benefits of the program. To capture diverse perspectives and produce reliable data, RK&A utilized
DATE:
TEAM MEMBERS: Randi Korn & Associates, Inc. Randi Korn
resource research Public Programs
A Framework for K-12 Science Education and Next Generation Science Standards (NGSS) describe a new vision for science learning and teaching that is catalyzing improvements in science classrooms across the United States. Achieving this new vision will require time, resources, and ongoing commitment from state, district, and school leaders, as well as classroom teachers. Successful implementation of the NGSS will ensure that all K-12 students have high-quality opportunities to learn science. Guide to Implementing the Next Generation Science Standards provides guidance to district and school
DATE:
TEAM MEMBERS: National Research Council
resource project Media and Technology
Young people's participation in informal STEM learning activities can contribute to their academic and career achievements, but these connections are infrequently explicitly recognized or cultivated. More systemic approaches to STEM education could allow for students' experiences of formal and informal STEM learning to be aligned, coordinated, and supported across learning contexts. This Science Learning+ planning project brings together stakeholders in two digital badge systems--one in the US and one in the UK--to plan for a study to identify the specific structural features of the systems that may allow for the alignment of learning objectives across institutions. Digital badge systems may offer an inventive solution to the challenge of connecting and building on youth's STEM-related experiences in multiple learning contexts. When part of a defined system, badges could be used to represent and communicate evidence of individual learning, as well as provide youth and educators with evidence-supported indicators for other activities in the system that might be interesting or valuable. Properly designed and supported badge systems could transmit critical information within a network of informal STEM programs and schools that (1) recognize context-dependent, interest-driven learning and (2) provide opportunities to explore those interests across multiple settings. This project advances the field of informal STEM learning in two ways. First, the project documents and analyzes the processes by which two small groups of informal science education organizations and schools negotiate the meaning and value of badges, as proxies for learning objectives, and how they decide to recognize badges awarded by other institutions. This process builds capacity within the target systems while also beginning to identify the institutional, cultural, and material capacity issues that facilitate or constrain the alignment process. Second, the project conducts a pilot study with a small number of youth in the US and UK to investigate factors associated with an individual youth's likelihood of: a) identifying badges of interest; b) connecting the activities of various badge systems to each other and to non-badging institutions, such as school or industry; c) determining which badges to pursue; and d) persisting in a particular badge pathway. Findings from this pilot study will help identify institution- and individual-level factors that might be associated with advancing student interest and progression in STEM fields. Deepening and validating the understanding of those factors and their relative impact on student experiences and outcomes will be the focus of investigations in future studies.
DATE: -
TEAM MEMBERS: James Diamond New York City Hive Learning Network MOUSE DigitalMe Katherine McMillan
resource project Public Programs
Relatively little is known about how Natural History Museums (NHMs) and schools can complement one another to maximize learning among school-age learners. Nor do we fully understand the long-term benefits to learning and engagement with science that NHMs have. In this Science Learning+ project researchers in UK and US universities will work with practitioners in NHMs and school teachers in the UK and the US to address these questions. The project will (a) undertake a critical review of the published and grey literature to examine the contributions to learning and engagement that NHMs have made; (b) develop improved instruments that are common across schools, NHMs and other out-of-school settings to determine the efficacy of learning experiences; devise protocols to explore the possibility of data obtained from museum evaluations being matched with national databases, thus improving our understanding of the consequences of such experiences; (c) map the areas of science curricula (using the latest version of the science National Curriculum in England and the Common Core Standards in the US) that NHMs might most valuably address; d) through researcher-practitioner collaboration review current pedagogical approaches employed by schools and NHMs, with a view to developing and studying new practice models in Phase 2. The project will devise validated instruments (of the sort that are increasingly used in large-scale social psychology studies) and explore whether data obtained from museum visitors can be matched, both in the UK and in the US, onto external datasets (e.g. the National Pupil Database in the UK; Elementary/Secondary Information System in the US).
DATE:
TEAM MEMBERS: Michael Reiss Berry Bilingsley E. Margaret Evans Richard Kissel Menaka Munro Martin Lawrence Mary Oliver Jane Pickering Chia Shen Janet Stott Dean Veall
resource project Public Programs
President Obama announced in April 2013 that the Corporation for National and Community Service (CNCS) would launch a STEM AmeriCorps initiative to build student interest in STEM. A RFA is currently being prepared to be released in the late fall of 2013. This project will engage in quick response research to identify an evaluation and research agenda that can begin to inform the program launch. Thus, the timeframe for informing the initial stages of STEM AmeriCorps is relatively short, and the creation of an evaluation and research agenda is very timely. The products from the RAPID proposal are: (1) a review of the evaluation and research literature on the use of volunteers and/or mentors to build students' interest in STEM; (2) to convene a workshop to identify evaluation and research priorities to guide the initiative; and (3) a summary evaluation agenda that identifies promising directions along with the strength of evidence around key issues.
DATE: -
TEAM MEMBERS: Beth Gamse Alina Martinez
resource project Public Programs
For over 60 years annual Science Fairs and Engineering competitions have been held in schools and communities throughout the country, engaging large numbers of middle school students and culminating in national and international events. Science fairs are at the intersection of formal learning in school and informal science learning in other settings including science centers, after-school programs, and clubs. However, in spite of their wide implementation and long history, there are few empirical studies that have examined the relationship between student participation in these fairs and their learning and interest in science. Additionally, there have been no studies to understand the real cost of these programs relative to the student benefits. This educational research project will fill that gap in understanding. It will systematically document and describe science fair models; measure their impact on learning; and provide evidence about the costs of various models and related benefits. The findings from this study will inform a wide range of stakeholders (including teachers, science fair leaders, volunteers, parents, and businesses) about these models and how they impact students' mastery of science and engineering practices. This four-year study in all regions of the country will be conducted in two phases: Phase 1 will be a survey of 3800 middle school science teachers will define the characteristics of science fair models; Phase 2 will use those understandings to conduct case studies in 20 schools. Deliverables include handbooks for teachers and the science fair community, articles in journals summarizing findings, the Science and Engineering Practice and Interest Inventory, and a suite of data collection instruments for scoring rubrics to describe science fairs and measure their impact. Research questions will include: (1) What are the basic models of middle school science fairs? (2) To what extent does participation in a particular model enhance students' mastery of science and engineering practices and/or their interest in science? (3) What student-teacher and school-level factors contribute to or inhibit students' mastery? (4) What resources, human and financial, are required to implement an effective middle school science fair? and (5) What are the most cost-effective aspects of the science fair experience, and how can they be applied or adapted by science fair leaders and teachers to strengthen students' mastery of science and engineering practices? Findings from this study will have the potential to improve current practices in the design and implementation of science fairs and their impact on student learning; they will be widely disseminated to the various stakeholders through publications, conference presentations, and educational association channels.
DATE: -
TEAM MEMBERS: Abigail Levy Marian Pasquale Jacqueline DeLisi Tracy McMahon Leana Nordstrom Janna Kook Erica Fields Lukas Winfield
resource project Media and Technology
This project supports the development of technological fluency and understanding of STEM concepts through the implementation of design collaboratives that use eCrafting Collabs as the medium within which to work with middle and high school students, parents and the community. The researchers from the University of Pennsylvania and the Franklin Institute combine expertise in learning sciences, digital media design, computer science and informal science education to examine how youth at ages 10-16 and families in schools, clubs, museums and community groups learn together how to create e-textile artifacts that incorporate embedded computers, sensors and actuators. The project investigates the feasibility of implementing these collaboratives using eCrafting via three models of participation, individual, structured group and cross-generational community groups. They are designing a portal through which the collaborative can engage in critique and sharing of their designs as part of their efforts to build a model process by which scientific and engineered product design and analysis can be made available to multiple audiences. The project engages participants through middle and high school elective classes and through the workshops conducted by a number of different organizations including the Franklin Institute, Techgirlz, the Hacktory and schools in Philadelphia. Participants can engage in the eCrafting Collabs through individual, collective and community design challenges that are established by the project. Participants learn about e-textile design and about circuitry and programming using either ModKit or the text-based Arduino. The designs are shared through the eCrafting Collab portal and participants are required to provide feedback and critique. Researchers are collecting data on learner identity in relation to STEM and computing, individual and collective participation in design and student understanding of circuitry and programming. The project is an example of a scalable intervention to engage students, families and communities in developing technological flexibility. This research and development project provides a resource that engages students in middle and high schools in technology rich collaborative environments that are alternatives to other sorts of science fairs and robotic competitions. The resources developed during the project will inform how such an informal/formal blend of student engagement might be scaled to expand the experiences of populations of underserved groups, including girls. The study is conducting an examination of the new types of learning activities that are multiplying across the country with a special focus on cross-generational learning.
DATE: -
TEAM MEMBERS: Yasmin Kafai Karen Elinich Orkan Telhan
resource project Public Programs
This CRPA award addresses the issue of multidisciplinary science and the public's awareness of the ideas. The PIs believe that the prevalence of multidisciplinary science is high and growing fast. Thus, the public and particularly the younger generations need to understand these concepts and to begin thinking in those terms. Thus, they will derive hands-on modules for three age groups that are age appropriate. The project team includes 7 NSF funded researchers who do multidiscipline-based research in biology, mathematics and engineering. These modules will be tested at the Boy and Girls Club of Dane County prior to being exhibited at the Madison Children's Museum and the Aldo Leopold Nature Center. Further, the local PBS TV station (WPT) will air some of the demonstrations giving the project more visibility and impact. Each set of modules designed for the three age groups shall be evaluated separately using age specific goals and objectives. The project is a collaboration between 7 scientists and engineers, the Boys and Girls Club of Dane County, the Aldo Leopold Nature Center, the Madison Children's Museum, and the Wisconsin Institutes of Discovery of the University of Wisconsin.
DATE: -
TEAM MEMBERS: Douglas Weibel