This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by developing a suite of digital tools designed to support positive messaging around skill-based education and careers and to improve mentors' communication with middle school-aged youth mentees. Maintaining U.S. economic advantage requires attracting talent to high-growth, high-demand skill-based, STEM-related careers that are traditionally attained through Career and Technical Education (CTE). Replacing old negative perceptions with new, more accurate messages about CTE and then reaching youth with these messages before high school is essential. Career-focused mentoring is a vehicle for delivering these messages and supporting youth exploration of CTE as a possible path for their own lives. Investigators will explore the hypothesis that through strong connections between those best positioned to articulate industry needs (mentors) and those most receptive to filling that need (mentees), this project will improve youth awareness and interest in CTE and the rewarding careers that are available to them. Research and development activities will be carried out collaboratively in informal learning environments in Boston and New York City that serve middle school-aged youth from underrepresented communities, through career-focused mentoring programs. The project team, led by media producers of the WGBH Education Foundation, includes market researchers and communications strategists at Global Strategy Group, learning scientists at Education Development Center, and mentorship program partners at SkillsUSA, Learning for Life's Middle School Explorer Clubs, and Boy Scouts of America's Scoutreach. If promising, the career-focused mentoring programs of SkillsUSA, Learning for Life, and Boy Scouts of America will incorporate the messaging roadmap and digital tools to support their mentoring curricula, which impact greater than one million youth in each year.
In the first phase of research, investigators will study perceptions of STEM-focused CTE from a nationwide sample of 800 middle school-aged youth and 30 mentors from skill-based STEM industries. In the second phase, investigators will work with six program leaders and 30 mentors from SkillsUSA, Explorer Clubs, Scoutreach, and other mentoring programs to document the needs of mentors for support as they enter into the mentoring process. The third phase will engage mentorship program leaders and 36 mentors in the iterative development of a suite of digital tools that would support positive messaging around skill-based education and careers and that would improve mentors' communication with youth mentees. In addition, a pre-post mentorship program pilot study will explore the promise of the digital tools for effectively supporting mentor-mentee communications that improve youth awareness and interest in STEM-focused CTE and skill-based, STEM-related careers. Thirty six mentors and 288 of their youth mentees will participate in the pilot study. Data sources for research include interviews and surveys of program leaders, mentors, and mentees, as well as tracking mentor activity within the online digital tool environment. This research would advance knowledge of how mentors influence disadvantaged youth perceptions of and interest in CTE and skill-based, STEM career pathways, in which there is currently little evidence as to how mentor preparation shapes ability to positively impact youth outcomes. Major outcomes will include a) deeper understandings of youth and mentor perceptions of CTE and mentors' needs for supporting their work with mentees, b) a messaging roadmap and digital tools that prepare mentors for their work with middle school youth, and c) empirical findings regarding the potential of the digital tools for effectively supporting mentor-mentee communications that improve youth's awareness and interest in CTE and skill-based, STEM-related careers. Outcomes will be shared widely to research, education, and industry communities, locally and nationally, through social media, partner networks, conference presentations, and research publications. An advisory board will provide independent review on the project activities.
The Museum of Science will launch the "Collaboration for Ongoing Visitor Experience Studies" (COVES) project to construct an infrastructure for collaboration, which will unite science centers across the country in the systematic collection, analysis, and reporting of visitor experience data. The COVES program will develop common instruments for studying visitors in science museums and provide staff training on how to use these instruments and how to make sense of findings. The collaborative effort will enable participating science centers to become data-driven organizations focused on their audiences and will allow museums to learn from one another.
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. In the fall of 2014, Techbridge Girls began offering after-school programming at five elementary and two middle schools in the Highline Public School district, located near Seattle, WA.
Education Development Center is conducting the formative and summative evaluation of the
This issue of Legacy—which had a record number of submissions from interpreters wanting to write on the subject—deals with the challenges of making science accessible, engaging, and relevant to visitors to interpretive sites. How do we take information and ideas that can be highly technical or specicialized to a certain field of study and make it pertinent to visitors whose expertise lies elsewhere? The articles that follow tackle that subject.
DATE:
TEAM MEMBERS:
Alyssa Parker-GeismanTim WatkinsPatrick Kark
This paper examines STEM-based informal learning environments for underrepresented students and reports on the aspects of these programs that are beneficial to students. This qualitative study provides a nuanced look into informal learning environments and determines what is unique about these experiences and makes them beneficial for students. We provide results of a qualitative research study conducted with the Mathematics, Engineering, Science Achievement (MESA) program, an informal learning environment that has proven to be effective in recruiting, retaining and encouraging
DATE:
TEAM MEMBERS:
Cameron DensonChandra Austin StallworthChristine HaileyDaniel Householder
resourceevaluationMuseum and Science Center Programs
The 5-year longitudinal study on Iridescent's Family Science Learning model was conducted with 2,173 participants from 9 schools and museum sites in Los Angeles and New York City. Participants were underserved elementary school students and their parents. Families met once a week for 5 weeks in a row. Five families (~20 participants) came for all 5 years.
Each program implementation was coordinated by Iridescent team members. The goal of this study was to:
* To identify scalable methods of engaging underserved audiences in STEM.
* To identify sustainable methods of supporting long-term
A PowerPoint slide presentation given by John Kania, Global Managing Director from FSG on collective impact at the June 3, 2015 National Science Foundation INCLUDES Achieving Scale for Inclusion in STEM Director's Workshop.
The evaluation study supports the project Distance Learning Education Programs at the Saint Louis Zoo. To better understand what teachers want and need, and the characteristics of the settings in which their students learn, the Zoo conducted an online survey of the teachers of students with special needs in May 2014. The purpose of this evaluation was to clarify and expand the survey findings to support the design, development, and implementation of the Zoo distance learning curriculum so that it works effectively across a variety of school settings for K12 students with special needs and
This report presents findings from a formative evaluation of Science Education for New Civic Engagements and Responsibilities-Informal Science Education (SENCER-ISE), a National Science Foundation and Noyce Foundation funded initiative to support partnerships between informal science and higher education institutions. This evaluation looked primarily at the collaborative infrastructure of SENCER-ISE, which included the web site, SENCER Summer Institute, and communications with project staff and/or the advisory board. This evaluation is the third evaluation that Randi Korn & Associates, Inc
DATE:
TEAM MEMBERS:
RK&A, Inc.
resourceevaluationProfessional Development, Conferences, and Networks
The National Center for Science and Civic Engagement (NCSCE) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of its SENCER-ISE project partnerships. SENCER-ISE is an initiative that brings partners from higher education (HE) together with partners from informal science education (ISE) to create projects that engage audiences in science using the lens of civic engagement. SENCER funded 10 partnerships over three years—six through the National Science Foundation (DRL #1001795) and four through the Noyce Foundation. Previously, RK&A conducted a formative
King et al. [2015] argue that ‘emphasis on impact is obfuscating the valuable role of evaluation’ in informal science learning and public engagement (p. 1). The article touches on a number of important issues pertaining to the role of evaluation, informal learning, science communication and public engagement practice. In this critical response essay, I highlight the article’s tendency to construct a straw man version of ‘impact evaluation’ that is impossible to achieve, while exaggerating the value of simple forms of feedback-based evaluation exemplified in the article. I also identify a
This article addresses some of the challenges faced when attempting to evaluate the long-term impact of informal science learning interventions. To contribute to the methodological development of informal science learning research, we critically examine (Falk and Needham (2011) Journal of Research in Science Teaching, 48: 1–12.) study of the California Science Center's long-term impact on the Los Angeles population's understanding, attitude and interest in science. This study has been put forward as a good model of long-term impact evaluation for other researchers and informal science learning