This report grew out of a workshop and follow-up session sponsored by the National Science Foundation (NSF), Directorate for Education and Human Resources (EHR). The two-day workshop and subsequent meeting sought to develop and validate evaluation practices to assess the value of NSF's investment in broadening participation across all directorates and programs. Invited participants included NSF grantees, professional evaluators, and the policy community (which included representatives from Congress, the Office of Management and Budget (OMB), NSF staff, and staff from other federal agencies).
DATE:
TEAM MEMBERS:
Fitzgerald BramwellPatricia CampbellBeatriz Chu ClewellDarnella DavisNorman FortenberryAntonio GarciaDonna NelsonAdam StollVeronica Thomas
In January this year, the US saw the publication of the preview of an impressive review work on the practices and the studies concerning learning science outside schools and universities, i.e. what is referred to as informal education. The document, promoted by the National Science Council of scientific academies (National Academy of Science, National Academy of Engineering and Institute of Medicine), is the result of the work by a committee comprising 14 specialists who collected, discussed and then organized hundreds of documents on pedagogical premises, places, practices and pursuits
DATE:
TEAM MEMBERS:
Paola Rodari
resourceresearchProfessional Development, Conferences, and Networks
Key challenges and opportunities are outlined in the ERA perspective and the role of evaluation as an instrument in the socialisation of science and technology is explored. Only an integrated and highly socialised science and technology, deeply embedded in society and involving all the relevant stakeholders, can address the complex problems Europe faces today and thus improve its research position and competitiveness worldwide.
The purpose of the summative evaluation is to two-fold: 1) provide documentation to NSF about the extent to which the project met its goals and objectives, and 2) give the Lab of Ornithology information about how well the Web application and the ecosystem within which it resides is engaging the intended audiences. The main evaluation questions the study needed to answer related to who is participating in YardMap, how much participation affects participants’ knowledge, attitudes and behaviors around birding, gardening, and citizen science.
A true experimental design was used, where
In Spring 2006, the Missouri Botanical Garden received a National Science Foundation grant to fund the LIONS program. LIONS trained educators from the St. Louis region, through professional development about place-based education, to deliver after school and summer programming to students grades 5 through 8. Since its inception, the LIONS program has included evaluation of program implementation and outcomes. There were dramatic changes in the scope of the program, which expanded beyond the originally targeted University City school district by adding additional schools recruited by LIONS
This report presents findings from Goodman Research Group's evaluation of the following: (1) The NOVA scienceNOW series, including viewer feedback on Season Three and the knowledge gained from viewing the six new episodes, (2) The NOVA scienceNOW website, and (3) Focus groups conducted at the Science Café conference in June 2008. Includes survey.
In this article we examine educational assessment in the 21st century. Digital learning environments emphasize learning in action. In such environments, assessments need to focus on performance in context rather than on tests of abstracted and isolated skills and knowledge. Digital learning environments also provide the potential to assess performance in context, because digital tools make it possible to record rich streams of data about learning in progress. But what assessment methods will use this data to measure mastery of complex problem solving -- the kind of thinking in action that
DATE:
TEAM MEMBERS:
David Williamson ShafferDavid HatfieldGina Navoa SvarovskyPadraig NashAran NultyElizabeth BagleyKen FrankAndre RuppRobert Mislevy
resourceresearchProfessional Development, Conferences, and Networks
Designed learning environments like museums have the potential to change the way that families think and talk about scientific topics together in everyday contexts like the home. The current study examines the affect of a visit to a museum exhibit highlighting the processes of manufacturing on the ability of parents and children to talk about how familiar objects are made. A model for family knowledge building is also presented as a means of assessing whether parents and children improved their understanding of manufacturing processes after their museum visit. A simulated home activity
This is a report of the NSF Advisory Committee for Environmental Research. It contains a call to action, research priorities, and sections on environmental research and citizen science.
DATE:
TEAM MEMBERS:
NSF Advisory Committee for Environmental Research and Education
Afterschool programs that strive to be inclusive should remember to welcome participants with disabilities. A new instrument can help afterschool programs determine how well they are doing at including kids with disabilities and assess whether those providing the services—leaders and staff—overestimate their organization’s inclusiveness as compared to those who use the services.
A review of studies on what constitutes high-quality afterschool programming concludes that the field is reaching consensus on its definitions of quality— which means that funders, policymakers, and providers increasingly have a sound basis on which to make informed decisions.
DATE:
TEAM MEMBERS:
Kristi PalmerStephen AndersonRonald Sabatelli
In this study, the instructional effectiveness of the planetarium in astronomy education was explored through a meta-analysis of 19 studies. This analysis resulted in a heterogeneous distribution of 24 effect sizes with a mean of +0.28, p<.05. The variability in this distribution was not fully explained under a fixed effect model. As a result, a random effects model was applied. However, a large random effect variance component indicated that study differences were indeed systematic. The findings of this meta-analysis showed that the planetarium has been an effective astronomical teaching tool