RMC Research designed evaluation activities to provide formative and summative feedback to the Hubbard Brook Research Foundation (HBRF) on their NSF Pathways project, Forest Science Dialogues (FSD). FSD consists of a plan to engage with scientists at the Hubbard Brook Ecosystem Study and with the surrounding community using the Hubbard Brook Roundtable dialogue process in order to facilitate mutual learning. The purpose of this engagement was to increase public knowledge, understanding, and awareness of ecosystem science in the Northern Forest in order to enrich local dialogue surrounding
The NSF INCLUDES program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The Algebra Project, in partnership with the Young People's Project, will convene a conference on inclusion in science, technology, engineering and mathematics(STEM) higher education in support of the National Science Foundation's Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) initiative. The conference will examine a critical question: What roles and structures are needed for a mini-backbone organization in order to scale a "bottom up" model of social change into an organized, full scale collective impact model? Additionally, the conference will develop participants' capacity to link action on the various design challenges, and backbone structures, to future actions that meet the needs of a potential Alliance on this Broadening Participation Challenge and others facing similar challenges.
Five pre-conference design teams will focus on key components to improve education of students from underrepresented and disadvantaged populations over a four-month period prior to the convening of the stakeholders in St. Louis, Missouri in 2017.
DATE:
-
TEAM MEMBERS:
Robert MosesBeverly Walker
resourceprojectProfessional Development and Workshops
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
Community colleges play a vital role in educating undergraduate students. These higher education institutions educate nearly half of the nation's undergraduate students, particularly among low-income and first-generation students and students of color. Because of the rich diversity that currently exists at these institutional-types, there are immense opportunities to broadening participation throughout the engineering enterprise. To this end, the investigator outlines a joint collaboration with five community colleges, three school systems, two college career academies, and a state partner in Georgia - referred as the Georgia Science, Technology, and Engineering Partnerships for Success (GA STEPS) - to provide dual enrollment classes in career pathways for Georgia high school students in grades 9-12, thereby allowing secondary students to earn college credit. The Georgia STEPS program proposes to leverage mechatronics engineering as a means for broadening engineering participation for community colleges and underserved, underrepresented populations in 48 rural counties to increase engineering awareness, skills training and college and career readiness. The project builds on an existing collaboration that has developed successful engineering opportunities at the community college level, by including a wider regional network of rural Georgia counties and high schools. Further, this project has immense potential to transform engineering education and course-taking for students at the secondary and postsecondary level in Georgia and beyond. It has potential great potential to be scaled and replicated at other placed around the United States.
The project's intellectual merit and innovation is that it leverages a successful mechatronics engineering curriculum that supports engineering skills that support local industry as well as supporting innovations in the mechatronics field. The project includes a collective impact framework, involving various stakeholders and aligning quantitative and qualitative metrics and measurable objectives. The broader impacts of this project is that it increases the engineering knowledge and skills of underserved, underrepresented students that are enrolled in community colleges. Also, the impact to rural communities in Georgia support the fact that this project would meet broader groups that can be positively impacted by this type of collaborative. The ability to provide different parts of this engineering discipline across broad audiences in community colleges - that support underrepresented groups understanding of mechatronics engineering - is broadly useful to the field of engineering.
DATE:
-
TEAM MEMBERS:
Shawn Utley
resourceprojectProfessional Development, Conferences, and Networks
The goal of Women in Cognitive Science is to improve the visibility of women scientists by fostering an environment that welcomes and nurtures young women scholars, to contribute to the professional development of scholars throughout their career, and to facilitate creation of a network that will provide contacts and connections to other women in science. Several workshops are designed for women in cognitive science, especially women in the early stages of their academic career. The workshops focus on negotiation techniques to create opportunities and optimize mechanisms to sustain research visibility and productivity. A second focus is on grant application writing for predoctoral, postdoctoral, and early career scientists. Workshops will take place at meetings of the Psychonomic Society, the Cognitive Science Society, and the Association for Psychological Sciences. The workshops will take the form of a public forum with invited speaker-panelists to initiate discussion about best practices for the professional advancement of women in cognitive science at the individual and institutional level. By partnering with these established societies, the workshops will maximize the outreach potential to a group that continues to be underrepresented in senior academic positions in the cognitive sciences.
DATE:
-
TEAM MEMBERS:
Mary PetersonDiane BeckKaren Schloss
resourceprojectProfessional Development, Conferences, and Networks
The American Association for the Advancement of Science (AAAS) and the National Science Foundation (NSF) will continue its collaboration in providing to early- and mid-career scientists and engineers experiential professional development and public service fellowships via the AAAS Science and Technology Fellowship Program. Consistent with the immersion model adopted by AAAS, Fellows at NSF will be selected annually through a competitive process and placed in organizations throughout the Foundation. Fellows will work with NSF staff on a broad range of activities in order to gain insight into how national science and technology policy goals are translated into and reflected by NSF's mission and strategic goals and how and by whom national science and technology policy is driven, shaped and prioritized. NSF fellowship assignments are designed to: educate and expose Fellows to NSF programmatic planning, development and oversight activities in all fields of fundamental research via hands-on engagement; utilize the Fellows' expertise on projects that apprise NSF officials in areas of mutual interest to the Fellow and the host organization; and provide developmental opportunities to inform future career decisions. The program includes an orientation on executive branch and congressional operations, as well as a year-long suite of knowledge- and skill-building seminars involving science, technology and public policy within the federal as well as NSF contexts.
In the long-term, the AAAS Fellowship program seeks to build leadership capacity for a strong national science and engineering enterprise. Upon completion of the Fellowship, Fellows will have gained: a broader understanding and increased insights about the development and execution of federal-level science, technology, engineering and mathematics policies and initiatives as well as how policy and science intersect; enhanced skills in communicating science to support policy development; and a greater capacity to serve more effectively in future leadership roles in diverse environments, including public and policy arenas, academia and the private sector. The ultimate outcome of the Fellowship program experience -- policy savvy science and engineer leaders who understand government and policymaking and are well-trained to develop and execute solutions to address the nation's challenges.
There is a growing need for citizens to be able to work with data and consider how data is represented. This work employs a design, make, play framework to create data modeling learning experiences for young children and their caregivers in an informal setting. The project develops and tests a curriculum for a workshop series for 5-8 year old children to engage them in playful exploration of data modeling. Children engage in data collection, data representation, and data analysis by drawing on their own experiences of museum exhibitions. The curriculum supports developing children's interest and engagement with data science and data literacy, which are foundational knowledge for a range of STEM careers and disciplines. This project advances efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM).
The project is grounded in a theoretical framework for young children's learning that focus on playful exploration, design, and building on children's own experiences and questions. The research examines how the curriculum needs to be designed to support families in data modeling, foster engagement in data modeling by both younger (ages 5-6) and older (ages 7-8) children, and provide evidence of active approaches to learning about STEM. The design and development project tests and investigates the materials using a design-based research framework. Children who participate in the workshop series should increase their confidence in solving problems, taking initiative, and drawing on available resources to pursue their own questions and respond to novel challenges. Data collected includes interviews with participants, artifacts of children's work throughout the series, and an observational instrument to document families' problem solving, persistence, and engagement with data science concepts.
Designing Our World (DOW) was a four-year NSF-funded initiative in which the Oregon Museum of Science and Industry (OMSI) sought to promote girls’ pursuit of engineering careers through community-based programming, exhibition development, and identity research. The overarching aim of DOW was to engage girls ages 9–14 with experiences that illuminate the social, personally relevant, and altruistic nature of engineering. In addition to programming for girls, the project also included workshops for parents/caregivers, professional development for staff from community partners; and an exhibition
MobiLLab is a mobile science education program designed to awaken young people’s interest in science and technology (S&T). Perceived novelty, or unfamiliarity, has been shown to affect pupils’ educational outcomes at similar out-of-school learning places (OSLePs) such as museums and science centers. A study involved 215 mobiLLab pupils who responded to three surveys: a pre-preparation, at-visit, and post-visit survey. Results provide evidence for four dimensions of pupils’ at-visit novelty: curiosity, exploratory behavior, oriented feeling, and cognitive load. Findings also show that classroom
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.