EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
This full scale research and development collaborative project between Smith College and Springfield Technical Community College improves technical literacy for children in the area of engineering education through the Through My Window learning environment. The instructional design of the learning environment results from the application of innovative educational approaches based on research in the learning sciences—Egan's Imaginative Education (IE) and Knowledge Building (KB). The project provides idea-centered engineering curriculum that facilitates deep learning of engineering concepts through the use of developmentally appropriate narrative and interactive multimedia via interactive forums and blogs, young adult novels (audio and text with English and Spanish versions), eight extensive tie-in activities, an offline teachers’ curriculum guide, and social network connections and electronic portfolios. Targeting traditionally underrepresented groups in engineering—especially girls—the overarching goals of the project are improving attitudes toward engineering; providing a deeper understanding of what engineering is about; supporting the development of specific engineering skills; and increasing interest in engineering careers. The project will address the following research questions: What is the quality of the knowledge building discourse? Does it get better over time? Will students, given the opportunity, extend the discourse to new areas? What scaffolding does the learning environment need to support novice participants in this discourse? Does the use of narrative influence participation in knowledge building? Are certain types of narratives more effective in influencing participation in knowledge building? Evaluative feedback for usability, value effectiveness, and ease of implementation from informal educators and leaders from the Connecticut After School Network CTASN) will be included. The evaluation will include documentation on the impact of narrative and multimedia tools in the area of engineering education. Currently, there is very little research regarding children and young teen engagement in engineering education activities using narrative as a structure to facilitate learning engineering concepts and principles. The research and activities developed from this proposed project contributes to the field of Informal Science and Engineering Education. The results from this project could impact upper elementary and middle-school aged children and members from underrepresented communities and girls in a positive way.
This pathways project will design, develop and test Do-It-Yourself, (DIY), hands-on workshops to introduce and teach middle school females in underserved Latino communities computing and design by customizing and repurposing e-waste media technology, such as old cell phones or appliances -- items found in the students homes or neighborhoods. The major outcome of the project will be the creation of a workshop kit that covers the processes of DIY electronics learning taking place in the workshops for distribution of the curriculum to after school programs and other informal science venues. The PIs have implemented three pilot projects over the last three years that demonstrate the ability of hands-on DIY electronics curricula to motivate and encourage students and to enable them to acquire a deeper understanding of core engineering, mathematics and science concepts. This project would extend the approach to underserved Latino youth, particular girls of middle school age. This audience was identified because of the historically low rate of participation in STEM fields by people in this group and the particular challenges that females have in acquiring knowledge in technical STEM areas. The proposal suggests that the approach of using hands-on workshops that rely on low technical requirements -- essentially obsolete or discarded electronic equipment, primarily from homes of participants -- will encourage the target audience to experiment with items they are familiar with and that are culturally relevant. The hypothesis of the project is that this approach will lower barriers to experimenting with "circuit bending" - the hand-modifying of battery-powered children's toys to build custom electronic instruments and lead to greater participation and success of females in the target group. The project will provide free workshops in two neighborhood locations and be supported by undergraduate student mentors and volunteers and staff of two community groups that are part of the project, Machine Project and Girls, Inc. Participants will demonstrate the finished projects to the workshop group, mentors and parents. Each participant will receive a copy of the workshop handbook in both English and Spanish to take home so that parents, members of the community and caregivers can supervise and participate in future projects.
DATE:
-
TEAM MEMBERS:
Garnet HertzGillian HayesRebecca Black
Many communities across the country are developing "maker spaces," environments that combine physical fabrication equipment, social communities of people working together, and educational activities for learning how to design and create objects. Increasingly, maker spaces and maker technologies are being designed to provide extended learning opportunities for school-aged young people. Unfortunately few youth from under-represented populations have had the opportunity to participate in these maker spaces. This proof-of-concept project, a collaboration of faculty from Michigan State University and the University of North Carolina, Greensboro with staff of the Boys and Girls Clubs in Lansing and Greensboro, will address two challenges faced by middle school youth from backgrounds underrepresented in engineering professions: 1) a lack of opportunities to learn engineering meaningfully and to apply it to understanding and solving real-world problems (i.e. learning), and 2) few experiences that foster the ability to see oneself as an important, contributing producer and consumer of engineering (i.e. identity). The team will develop and study an informal (out-of-school) STEM learning model to engage middle school youth from underrepresented backgrounds in experiences related to engineering-for-sustainable-communities. The model engages youth both in maker spaces and in conducting community ethnography studies to identify local problems and then to design potential solutions for them. The participants will also be connected into a broader social network of experts. Using a design-based research approach and applying social practice theory and systems theory, the work will identify how critical aspects of the learning environment shape identity work. This will yield information on the value and affect of the instructional tools that will be produced. The team hypothesizes that, by alternating over time between maker spaces activities and community ethnography studies, youth will a) reflect upon what they know and need to know to define problems and design solutions, b) develop stronger engineering identities, and c) realize the potential they have to make change in their community. Professionals in education and engineering will benefit from additional empirical evidence for how identity unfolds over time, across learning contexts, and how it promotes opportunities to learn in engineering.
The Exploratorium, in collaboration with the Boys and Girls Club Columbia Park (BGC) in the Mission District of San Francisco, is implementing a two-year exploratory project designed to support informal education in science, technology, engineering, and mathematics (STEM) within underserved Latino communities. Building off of and expanding on non-STEM-related efforts in a few major U.S. cities and Europe, the Exploratorium, BGC, and residents of the District will engage in a STEM exhibit and program co-development process that will physically convert metered parking spaces in front of the Club into transformative public places called "parklets." The BGC parklet will feature interactive, bilingual science and technology exhibits, programs and events targeting audiences including youth ages 8 - 17 and intergenerational families and groups primarily in the Mission District and users of the BGC. Parklet exhibits and programs will focus on STEM content related to "Observing the Urban Environment," with a focus on community sustainability. The project explores one approach to working with and engaging the public in their everyday environment with relevant STEM learning experiences. The development and evaluation processes are being positioned as a model for possible expansion throughout the city and to other cities.
The Designing Our World (DOW) project centers on science, technology, engineering, and mathematics (STEM) equity and addresses the need for more youth, especially girls, to pursue engineering and fill vital workforce gaps. DOW will integrate tested informal science education (ISE) programs and exhibits with current knowledge of engaging diverse youth through activities embedded in a social context. Led by teams of diverse community stakeholders and in partnership with several local girl-serving organizations, DOW will leverage existing exhibits, girls’ groups, and social media to impact girls’
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryAnne Sinkey
Poster presented at the 2014 AISL PI Meeting in Washington, DC. It describes a project that is designed to engage Hispanic students in grades K-5 in STEM in afterschool programs within community-based organizations (CBOs).
DATE:
TEAM MEMBERS:
Patricial and Phillip Frost Museum of ScienceCheryl Juarez
ResearchLink: Spotlight on Solar Technologies was a Collaborative Research Connecting Researchers and Public Audiences (CRPA) Project led by the Oregon Museum of Science and Industry and Portland State University, funded by the NSF AISL program from 2012-2014. This poster was presented at the 2014 AISL PI Meeting in Washington, DC.
DATE:
TEAM MEMBERS:
Portland State University and Oregon Museum of Science and IndustryLauren (Russell) MorenoCarl Wamser
This CRPA award will address the science behind solar energy, its capture, measurements, and uses. It is a collaborative effort between scientists at Portland State University (PSU) and the Oregon Museum of Science and Industry (OMSI). Materials for the OMSI staff will be prepared by the scientists and the OMSI staff will work with the scientists on making presentations to the public. OMSI will translate information from the exhibits, displays, and presentations into Spanish to engage the Hispanic population. Scientific café?s will be part of this engagement. The PI and OMSI museum have had a working relationship for some time adding to the potential success of the project. The PI and his colleagues at PSU have a major effort going in research on photonic science suggesting that this engagement can continue to be updated as the time goes on. The project will be evaluated by the well established evaluation group at OMSI. Further, Spanish speaking public will be embraced with this material as will rural residents from traveling exhibits and displays.
The Challenger Reach 2 U program will reach over 6,500 fourth-grade students in 261 missions from underserved communities throughout southwest Colorado and northwestern New Mexico, including primarily rural, lower socio-economic status, Hispanic and Native American districts that seldom have such STEM educational opportunities. The Colorado Consortium for Earth and Space Science Education (CCESSE) will show that increasing the quality of science, technology, engineering, and mathematics (STEM) education is not only a NASA goal set at the national level and a state and local priority, but is the underlying core competency of our organization as well. As an integral part of our Challenger Reach 2 U proposal to motivate interest in STEM curriculum and to strengthen the Nation's future workforce, we will thoroughly train teachers of these students to be more comfortable with technology and more prepared to deliver motivational STEM lessons, leaving an educational legacy that will greatly outlive the life of this grant. We will provide these students with cross-curricular preparatory lessons which will culminate with an exciting simulated space mission delivered in their own classrooms and moderated by a "NASA" mission director at our Center. With the help of the NASA grant, all of these services will be provided at no cost to the schools.
The University of Texas at El Paso will conduct a research project that implements and documents the impact of co-generative dialogues on youth learning and youth-scientist interactions as part of a STEM research program (i.e., Work with A Scientist Program). Co-generative dialogues seek to specifically assist with communication and understanding among collaborators. Over four years, 108 11th grade youth from a predominantly (90%) Hispanic high school will conduct STEM research with twelve scientists/engineers (e.g., chemist, civil engineer, geologist, biologist) and undergraduate/graduate students as part of 7 month-long after school program, including bi-weekly Saturday activities for 5 months followed by an intensive month-long, self-directed research project in the summer. Youth will be randomly assigned to experimental groups that include the co-generative dialogue treatment and control groups without the intervention. The scientists and their STEM undergraduate/graduate students will participate in both experimental and control groups, with different youth. Youth will receive high school credit to encourage participation and retention. The PI team hypothesizes that co-generative dialogues will result in improved learning, communication, and research experiences for both youth and scientists. Educational researchers will conduct co-generative dialogues, observations, interviews, and surveys using validated instruments to address the following research goals: (1) To investigate the impact of the treatment (co-generative dialogues) on youth knowledge, attitudes, perceptions of their experience, and their relationships with the scientists; (2) To investigate the impact of the treatment on scientists and graduate students; and (3) To identify critical components of the treatment that affect youth-scientist interactions. It is anticipated that, in addition to providing in-depth STEM research experiences for 108 youth from underrepresented groups at a critical time in their lives, the project will result in widely applicable understandings of how pedagogical approaches affect both youth learning and scientist experiences. The project also seeks to bridge learning environments: informal, formal, university and digital.
This full-scale project addresses the need for more youth, especially girls, to pursue an interest in engineering and eventually fill a critical workforce need. The project leverages museum-based exhibits, girls' activity groups, and social media to enhance participants' engineering-related interests and identities. The project includes the following bilingual deliverables: (1) Creative Solutions programming will engage girls in group oriented engineering activities at partner community-based organizations, where the activities highlight altruistic, personally relevant, and social aspects of engineering. Existing community groups will use the activities in their regular meeting structure. Visits to the museum exhibits, titled Design Your World will reinforce messages; (2) Design Your World Exhibits will serve as a community hub at two ISE institutions (Oregon Museum of Science and Industry and the Hatfield Marine Science Center). They will leverage existing NSF-funded Engineer It! (DRL-9803989) exhibits redesigned to attract, engage, and mobilize a more diverse population by showcasing altruistic, personally relevant, and social aspects of engineering; (3) Digital engagement through targeted use of social media will complement program and exhibit content and be an online portal for groups engaged in the project; (4) A community action group (CAG) will provide professional development opportunities to stakeholders interested in girls' STEM identity (e.g. parents, STEM-based business professionals) to promote effective engineering messaging throughout the community and engage them in supporting project participants; and (5) Longitudinal research will explore how girls construct and negotiate engineering-related identities through discourse across the project activities and over time.