This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by engaging in hands-on field experience, laboratory/project-based entrepreneurship tasks and mentorship experiences.
Twin Cities Public Television project on Gender Equitable Teaching Practices in Career and Technical Education Pathways for High School Girls is designed to help career and technical education educators and guidance counselors recruit and retain more high school girls from diverse backgrounds in science, technology, engineering and math (STEM) pathways, specifically in technology and engineering. The project's goals are: 1) To increase the number of high school girls, including ethnic minorities, recruited and retained in traditionally male -STEM pathways; 2) To enhance the teaching and coaching practices of Career and Technical Education educators, counselors and role models with gender equitable and culturally responsive strategies; 3) To research the impacts of strategies and role model experiences on girls' interest in STEM careers; 4) To evaluate the effectiveness of training in these strategies for educators, counselors and role models; and 5) To develop training that can easily be scaled up to reach a much larger audience. The research hypothesis is that girls will develop more positive STEM identities and interests when their educators employ research-based, gender-equitable and culturally responsive teaching practices enhanced with female STEM role models. Instructional modules and media-based online resources for Minnesota high school Career and Technical Education programs will be developed in the Twin Cities of Minneapolis and St. Paul and piloted in districts with strong community college and industry partnerships. Twin Cities Public Television will partner with STEM and gender equity researchers from St. Catherine University in St. Paul, the National Girls Collaborative, the University of Colorado-Boulder (CU-Boulder), the Minnesota Department of Education and the Minnesota State Colleges and Universities System.
The project will examine girls' personal experiences with equitable strategies embedded into classroom STEM content and complementary mentoring experiences, both live and video-based. It will explore how these experiences contribute to girls' STEM-related identity construction against gender-based stereotypes. It will also determine the extent girls' exposure to female STEM role models impact their Career and Technical Education studies and STEM career aspirations. The study will employ and examine short-form autobiographical videos created and shared by participating girls to gain insight into their STEM classroom and role model experiences. Empowering girls to respond to the ways their Career and Technical Education educators and guidance counselors guide them toward technology and engineering careers will provide a valuable perspective on educational practice and advance the STEM education field.
The Discovery Research K-12 program (DR-K12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects. This project scales up the PBS NewsHour Student Reporting Labs (SRL), a model that trains teens to produce video reports on important STEM issues from a youth perspective. Participating schools receive a SRL journalism and digital media literacy curriculum, a mentor for students from a local PBS affiliate, professional development for educators, and support from the PBS NewsHour team. The production of news stories and student-oriented instruction in the classroom are designed to increase student learning of STEM content through student-centered inquiry and reflections on metacognition. Students will develop a deep understanding of the material to choose the best strategy to teach or tell the STEM story to others through digital media. Over the 4 years of the project, the model will be expanded from the current 70 schools to 150 in 40 states targeting schools with high populations of underrepresented youth. New components will be added to the model including STEM professional mentors and a social media and media analytics component. Project partners include local PBS stations, Project Lead the Way, and Share My Lesson educators.
The research study conducted by New Knowledge, LLC will add new knowledge about the growing field of youth science journalism and digital media. Front-end evaluation will assess students' understanding of contemporary STEM issues by deploying a web-based survey to crowd-source youth reactions, interest, questions, and thoughts about current science issues. A subset of questions will explore students' tendencies to pass newly-acquired information to members of the larger social networks. Formative evaluation will include qualitative and quantitative studies of multiple stakeholders at the Student Reporting Labs to refine the implementation of the program. Summative evaluation will track learning outcomes/changes such as: How does student reporting on STEM news increase their STEM literacy competencies? How does it affect their interest in STEM careers? Which strategies are most effective with underrepresented students? How do youth communicate with each other about science content, informing news media best practices? The research team will use data from pre/post and post-delayed surveys taken by 1700 students in the STEM Student Reporting Labs and 1700 from control groups. In addition, interviews with teachers will assess the curriculum and impressions of student engagement.
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by developing a suite of digital tools designed to support positive messaging around skill-based education and careers and to improve mentors' communication with middle school-aged youth mentees. Maintaining U.S. economic advantage requires attracting talent to high-growth, high-demand skill-based, STEM-related careers that are traditionally attained through Career and Technical Education (CTE). Replacing old negative perceptions with new, more accurate messages about CTE and then reaching youth with these messages before high school is essential. Career-focused mentoring is a vehicle for delivering these messages and supporting youth exploration of CTE as a possible path for their own lives. Investigators will explore the hypothesis that through strong connections between those best positioned to articulate industry needs (mentors) and those most receptive to filling that need (mentees), this project will improve youth awareness and interest in CTE and the rewarding careers that are available to them. Research and development activities will be carried out collaboratively in informal learning environments in Boston and New York City that serve middle school-aged youth from underrepresented communities, through career-focused mentoring programs. The project team, led by media producers of the WGBH Education Foundation, includes market researchers and communications strategists at Global Strategy Group, learning scientists at Education Development Center, and mentorship program partners at SkillsUSA, Learning for Life's Middle School Explorer Clubs, and Boy Scouts of America's Scoutreach. If promising, the career-focused mentoring programs of SkillsUSA, Learning for Life, and Boy Scouts of America will incorporate the messaging roadmap and digital tools to support their mentoring curricula, which impact greater than one million youth in each year.
In the first phase of research, investigators will study perceptions of STEM-focused CTE from a nationwide sample of 800 middle school-aged youth and 30 mentors from skill-based STEM industries. In the second phase, investigators will work with six program leaders and 30 mentors from SkillsUSA, Explorer Clubs, Scoutreach, and other mentoring programs to document the needs of mentors for support as they enter into the mentoring process. The third phase will engage mentorship program leaders and 36 mentors in the iterative development of a suite of digital tools that would support positive messaging around skill-based education and careers and that would improve mentors' communication with youth mentees. In addition, a pre-post mentorship program pilot study will explore the promise of the digital tools for effectively supporting mentor-mentee communications that improve youth awareness and interest in STEM-focused CTE and skill-based, STEM-related careers. Thirty six mentors and 288 of their youth mentees will participate in the pilot study. Data sources for research include interviews and surveys of program leaders, mentors, and mentees, as well as tracking mentor activity within the online digital tool environment. This research would advance knowledge of how mentors influence disadvantaged youth perceptions of and interest in CTE and skill-based, STEM career pathways, in which there is currently little evidence as to how mentor preparation shapes ability to positively impact youth outcomes. Major outcomes will include a) deeper understandings of youth and mentor perceptions of CTE and mentors' needs for supporting their work with mentees, b) a messaging roadmap and digital tools that prepare mentors for their work with middle school youth, and c) empirical findings regarding the potential of the digital tools for effectively supporting mentor-mentee communications that improve youth's awareness and interest in CTE and skill-based, STEM-related careers. Outcomes will be shared widely to research, education, and industry communities, locally and nationally, through social media, partner networks, conference presentations, and research publications. An advisory board will provide independent review on the project activities.
Techbridge Girls’ mission is to help girls discover a passion for science, engineering, and technology (SET). In August 2013, Techbridge Girls was awarded a five-year National Science Foundation grant to scale up its after-school program from the San Francisco Bay Area to multiple new locations around the United States. In the fall of 2014, Techbridge Girls began offering after-school programming at five elementary and two middle schools in the Highline Public School district, located near Seattle, WA.
Education Development Center is conducting the formative and summative evaluation of the
This paper examines STEM-based informal learning environments for underrepresented students and reports on the aspects of these programs that are beneficial to students. This qualitative study provides a nuanced look into informal learning environments and determines what is unique about these experiences and makes them beneficial for students. We provide results of a qualitative research study conducted with the Mathematics, Engineering, Science Achievement (MESA) program, an informal learning environment that has proven to be effective in recruiting, retaining and encouraging
DATE:
TEAM MEMBERS:
Cameron DensonChandra Austin StallworthChristine HaileyDaniel Householder
resourceevaluationMuseum and Science Center Programs
The 5-year longitudinal study on Iridescent's Family Science Learning model was conducted with 2,173 participants from 9 schools and museum sites in Los Angeles and New York City. Participants were underserved elementary school students and their parents. Families met once a week for 5 weeks in a row. Five families (~20 participants) came for all 5 years.
Each program implementation was coordinated by Iridescent team members. The goal of this study was to:
* To identify scalable methods of engaging underserved audiences in STEM.
* To identify sustainable methods of supporting long-term
The evaluation study supports the project Distance Learning Education Programs at the Saint Louis Zoo. To better understand what teachers want and need, and the characteristics of the settings in which their students learn, the Zoo conducted an online survey of the teachers of students with special needs in May 2014. The purpose of this evaluation was to clarify and expand the survey findings to support the design, development, and implementation of the Zoo distance learning curriculum so that it works effectively across a variety of school settings for K12 students with special needs and
This report presents findings from a formative evaluation of Science Education for New Civic Engagements and Responsibilities-Informal Science Education (SENCER-ISE), a National Science Foundation and Noyce Foundation funded initiative to support partnerships between informal science and higher education institutions. This evaluation looked primarily at the collaborative infrastructure of SENCER-ISE, which included the web site, SENCER Summer Institute, and communications with project staff and/or the advisory board. This evaluation is the third evaluation that Randi Korn & Associates, Inc
DATE:
TEAM MEMBERS:
RK&A, Inc.
resourceevaluationProfessional Development, Conferences, and Networks
The National Center for Science and Civic Engagement (NCSCE) contracted Randi Korn & Associates, Inc. (RK&A) to conduct a summative evaluation of its SENCER-ISE project partnerships. SENCER-ISE is an initiative that brings partners from higher education (HE) together with partners from informal science education (ISE) to create projects that engage audiences in science using the lens of civic engagement. SENCER funded 10 partnerships over three years—six through the National Science Foundation (DRL #1001795) and four through the Noyce Foundation. Previously, RK&A conducted a formative
King et al. [2015] argue that ‘emphasis on impact is obfuscating the valuable role of evaluation’ in informal science learning and public engagement (p. 1). The article touches on a number of important issues pertaining to the role of evaluation, informal learning, science communication and public engagement practice. In this critical response essay, I highlight the article’s tendency to construct a straw man version of ‘impact evaluation’ that is impossible to achieve, while exaggerating the value of simple forms of feedback-based evaluation exemplified in the article. I also identify a
Education stakeholders from advocates to developers are increasingly recognizing the potential of science games in advancing student academic motivation for and interest in science and science careers. To maximize this potential, the project will use science games (e.g. Land Science, River City, and EcoMUVE), shown to be enjoyable to students and proven to promote student learning in science at the middle school level. Through a two-phase process, games will be used as vehicles for learning about ways to change how students think about science and potentially STEM careers. The goal of the intervention is to explore which processes and design features of science games will actually help students move beyond a temporary identity of being a scientist or engineer (as portrayed while playing the game) to one where students began to see themselves in real STEM careers. Students' participation will be guided by teams of teachers, faculty members, and graduate students from Drexel University and a local school. All science students attending the local inner city middle school in Philadelphia, PA, will participate in the intervention.
Using an exploratory mixed-method design, the first two years of the project will focus on exploring, characterizing, coding, and analyzing data sets from three large games designed to help students think about possible careers in science. During year 3, the project will integrate lessons learned from the first two years into the existing middle school science curriculum to engage students in a one-year intervention using PCaRD (Play Curricular activity Reflection Discussion). During the intervention, the PI will work with experts from Drexel University and a local school to collect data on the design features of Land Science to capture identity change in the science identity of the participating students. Throughout the course of year 3, the PI will observe, video, interview, survey, and use written tasks to uncover if the Land Science game is influencing students' identity in any way (from a temporary to a long-term perspective about being a scientist or engineer). Data collected during three specified waves during the intervention will be compared to analyses of existing logged data through collaborations with researchers at Harvard University and the University of Wisconsin-Madison. These comparisons will focus on similar middle-aged science students who used the same gaming environments as the students involved in this study. However, the researcher will intentionally look for characteristics related to motivation, science knowledge, and science identity change.
This project will integrate research and education to investigate learning as a process of change in student science identity within situated environmental contexts of digital science gameplay around curricular and learning activities. This integrated approach will allow the researcher to explore how gaming is inextricably linked to the student as an individual while involved in the learning of domain specific content in science. The collaboration among major university and school partners; the expertise of the researcher in educational psychology, educational technology, and science games; and the project's advisory board makes this a real-life opportunity for the researcher to use information that naturally exists in games to advance knowledge in the field about the value of gaming to changing students' science identities. It also responds to reports by the National Research Council committee on science learning and computer games, which identifies games as having the potential to catalyze new approaches to science learning.
Purpose: The United States (U.S.) has traditionally produced the world’s top research scientists and engineers, leading to breakthrough advances in science and technology. Despite the importance of STEM careers, many U.S. students are not graduating with strong STEM knowledge, skills or interests, and the percentage of students prepared for or pursuing STEM degrees or careers is declining. Research shows that the decreased interest in STEM typically begins in the middle school years, pose significant academic and social challenges for students. This project will develop a web-based game teach 6th to 8th students key scientific inquiry skills, along with the academic mindsets and learning strategies to facilitate engagement and effective science learning.
Project Activities: The researchers will create a prototype by mapping key Next Generation Science Standards and learning goals with concepts and content, and producing a game design document. Following completion of the prototype, the researchers will finalize the server architecture, create the core code systems, concept art, and develop a prototype in order to simulate the final user experience. Iterative refinements will be conducted as needed at major production milestones until the game is fully functional. Once development is complete, the research team will assess the usability and feasibility, fidelity of implementation, and the promise of the game to improve outcomes in a pilot study. In this study, 200 students in 10 classes will participate, with 5 of the classrooms randomly assigned to use the game and 5 who will proceed as normal. All students will complete pre- and post- program surveys assessing their academic mindsets, learning strategies, and science skills.
Product: This project will develop SciSkillQuest, a web-based multiplayer game intended to teach middle school students scientific inquiry skills and to foster academic growth mindsets in science. Students will pursue quests, employing inquiry skills to navigate and succeed in the game, including Questioning, Modeling, Investigating, Analyzing, Computing, Explaining, Arguing, and Informing. The game will include different paths to a solution, role playing elements, immersive narratives, challenge-based progressions, and peer collaboration to engage players. The growth mindset message — that ability and skill are developed through effort and learning — will be introduced and reinforced through feedback by embedded in-game characters. The games will be supplemental to the curriculum but will also be designed to be integrated within instructional practice. The game will be available for mobile devices as well as web browsers.