This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by bringing together youth (grades 2-5), their families, librarians, and professional engineers in an informal environment centered on engaging youth with age-appropriate, technology-rich STEM learning experiences fundamental to the engineering design process. The overarching aim is to better understand how youth's learning preferences or dispositions relate to their STEM learning experiences. It also seeks to build community members' capacity to inspire and educate youth about STEM careers. The project team includes the Space Science Institute's (SSI) National Center for Interactive Learning (NCIL), the University of Virginia (UVA) and the American Society of Civil Engineers (ASCE). This team builds on the scope and reach of a prior NSF-funded project called the STAR Library Education Network (STAR_Net). As an extension of this prior work, Project BUILD will collaborate with 6 public libraries (3 urban and 3 rural) and their local ASCE Branches. Two libraries have been selected to serve as pilots: High Plains Public Library in Colorado and the African-American Research Library and Cultural Center in Florida. All partner libraries will develop a plan for recruiting participants from groups currently underrepresented in STEM professions. Project BUILD's specific aims are to 1) Engage underserved audiences, 2) Build the capacity of participating librarians and ASCE volunteers, 3) Increase interest and engagement in STEM activities for youth in grades 2-5 and their families, and 4) Conduct a comprehensive education research project. Program components include the following: 1) Community Dialogue Events, 2) a Professional Development Program for partner librarians and ASCE volunteers, and 3) Development of a Technology-rich Programming Kit and Circulating STEM Kit program. Two research questions will be addressed: 1) What common factors might identify youth who engage in project activities and what factors might differentiate between youth who continue with program engagement and those who do not? and 2) What programmatic factors (i.e. design and composition of program activities, library recruitment, librarian engagement, professional engineer engagement, etc.) might influence youth's initial and continued engagement in project activities as well as youth's reported future career interests? An external evaluation will investigate the quality of the project's process as well as its impact and effectiveness. Benefits to the participating libraries' communities, library and engineering professionals, and the education community will be achieved through 1) Community Dialogue events; 2) Library and Librarian Outreach; 3) ASCE Outreach; and 4) Publication of Research and Evaluation results.
Most researchers are keenly interested in disseminating their work beyond traditional publication routes. With an eye to increasing broader impacts, scientists can benefit from partnerships with informal educators who interact daily with the public and see their role as translating science to increase the public’s intellectual and emotional connections with the natural world. Typically, researchers give a one-time lunch hour talk, generally a modified version of a presentation aimed at scientific peers. Talks during which scientists show slides and interpreters mainly listen are a missed
With stories of struggle and dramatic breakthroughs, science has incredible potential to interest the public. However, as the rhetoric of outrage surrounds controversies over science policy there is an urgent need for credible, trusted voices that frame science issues in a way that resonates with a diverse public. A network of informal educators, park rangers, museum docents and designers, and zoo and aquarium interpreters are prepared to do so during millions of visits a year; just where science stories are most meaningfully told—in the places where members of the public are open to learning
In May, 2017, the University of Michigan School of Information hosted an NSF-funded workshop on the promise and pitfalls of using digital micro-credentials, also known as digital badges, in the college admission process. Micro-credentials are digital artifacts that can be used to recognize, display, and transmit information about an individual student’s skills, abilities, and knowledge. Modeled on the physical badges used by organizations such as the Boy/Girl Scouts of America, and websites such as Stack Overflow, micro-credentials offer learners a mechanism for displaying and sharing a wider
DATE:
TEAM MEMBERS:
Barry FishmanStephanie TeasleySteven Cederquist
Since the late 2000s, interest in the development and use of shared measures in the informal science, technology, engineering, and mathematics (STEM) education (ISE) field has increased. The intent is to build the capacity of evaluators to measure common outcomes of ISE experiences. We begin this chapter with a definition of shared measures, a description of related technical qualities of these measures, and a discussion of benefits and concerns around the use of shared measures. We then review recent conversations and developments around shared measures, including examples of observational
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. Informal STEM educational activities have proliferated widely in the US over the last 20 years. Additional research will further validate the long-term benefits of this mode of learning. Thus, elaborating the multitude of variables in informal learning and how those variables can be used for individual learning is yet to be defined for the circumstances of the learners. Thus, the primary objective of this work is to produce robust and detailed evidence to help shape both practice and policy for informal STEM learning in a broad array of common circumstances such as rural, urban, varying economic situations, and unique characteristics and cultures of citizen groups. Rather than pursuing a universal model of informal learning, the principal investigator will develop a series of comprehensive models that will support learning in informal environments for various demographic groups. The research will undertake a longitudinal mixed-methods approach of Out of School Time/informal STEM experiences over a five-year time span of data collection for youth ages 9-19 in urban, suburban, town, and rural communities. The evidence base will include data on youth experiences of informal STEM, factors that exert an influence on participation in informal STEM, the impact of participation on choices about educational pathways and careers, and preferences for particular types of learning activities. The quantitative data will include youth surveys, program details (e.g. duration of program, length of each program session, youth/facilitator ratio, etc.), and demographics. The qualitative data will include on-site informal interviews with youth and facilitators, and program documentation. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This summative evaluation report presents findings and lessons learned on the STEM Ambassadors project. The STEM Ambassadors project, funded by the National Science Foundation’s (NSF) Advancing Informal STEM Learning (AISL) program, combines elements of existing programs designed to engage STEM professionals with the public around their scientific research to create a new model for public engagement of science. This new model recruits, provides training for, and assists STEM professionals in drawing on their own interests, hobbies and backgrounds to connect with audiences that may not have
This workshop is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The project will conduct a two-day workshop that will gather citizen science project leaders to address barriers in citizen science research and infrastructure: The inability to holistically study the movement, engagement, persistence and learning outcomes among volunteers engaged in multiple projects. The past few years have been a time of tremendous growth in awareness of and interest in citizen science projects. The project will address an increasing gap preventing projects in three now-popular categories (apps, projects hosted on government websites, and event-based projects) from adopting the digital tools created and available through SciStarter.com. The workshop will bring citizen science project leaders together to deepen an understanding of their needs regarding the adoption of digital tools, developed by Scistarter, which will result in more comprehensive data in support of research in informal science learning outcomes of volunteers engaged in citizen science across projects and platforms. The in-person and online contributions from participants will guide the development of resources and tutorials to scale adoption.
SciStarter is a repository of hundreds of citizen science projects. Through previous NSF support, SciStarter developed digital affiliate tools which project leaders use on their own websites to enable analytics (statistics gathered from user activity online) to help projects more easily recruit and coordinator volunteers, help volunteers track their contributions across projects and platforms, and help researchers holistically study the movement and learning outcomes across projects and platforms. The proposed workshop will facilitate iteration and adoption of the tools among three classes of projects, not originally accounted for, which have dramatically increased in numbers during the past year: 1) app-based projects, 2) projects hosted on government websites, and 3) event-based projects.. By co-designing and implementing iterative versions of the tools among these projects, the project will address important gaps in research, enable a richer, more comprehensive understanding of volunteer engagement patterns, and discover opportunities to build a stronger community of citizen science practitioners who collaborate to enhance volunteer learning communities. The project will culminate in improved research in this field and improved management of citizen science projects for appropriate recruitment and retention that fosters STEM learning.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. The theme of this conference project by the New York Hall of Science will be exploring how to better design exhibits to promote "public engagement with science." Here, "public engagement with science" refers to opportunities that go beyond traditional approaches to the public understanding of science. The event will invite professionals to consider how to shift exhibit designs toward engaging visitors with STEM in ways that emphasize the intersection of STEM innovation with visitors' daily lives, their personal agency, and their interdependence with their personal social networks and the institutions that advance STEM knowledge and innovation. The conference and its pre- and post-conference activities will bring together curators, exhibition developers, community outreach professionals, museum administrators, and learning scientists from the United States and Canada. They will work together to identify design principles and key obstacles to designing exhibits that can better help science museums achieve two goals: 1) making visitors' diverse and personal questions, concerns, and perspectives central to their experience of the exhibits; and 2) engaging visitors as contributors to the exhibit experience in ways that make their contributions visible and consequential. During this two-day event attendees will consider how exhibits can support broader and more diverse public participation in critical debates about the roles of STEM discovery and innovation in society. The effort is grounded in recent work on public engagement with science; on reorganizing museums to become sites for participation and contribution by visitors, and particularly by institutions' local communities; and on making and engineering design programming within museums. The goal is to chart a course toward a vision of the future of science museums in which they maintain their status as sources of trusted information, while also fulfilling their potential as sites of genuine participation and social interaction, in which visitors make meaningful contributions to the substance and workings of the museum floor while also engaging with, learning about and holding themselves accountable to the core concepts and practices of the STEM disciplines. The conference will build the capacity and collaborative engagement of a network of science centers whose work is central to achieving the museum field's ultimate goal of engaging the public of all ages in learning STEM in informal environments. The conference and associated activities will be evaluated by staff at the New York Hall of Science, with oversight by an external advisory committee of research and development professionals. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Over the last decade there has been significant growth in the number of afterschool programs that offer science activities to youth. Measuring the quality and contributions of these programs to youth learning is important to both the afterschool organizations and the communities that support them, including participating youth and their families. To address the range and evolving interests and capacities of all young people within a community, there are, by necessity, a wide range of types of afterschool science programming. Such programming may vary by focus (e.g., botany, astronomy, computer science, engineering, or zoology), structure (e.g., hands-on, place-based, on-line, or in partnership with local industry) and other factors. Across the range of programming, there are different intended learning goals and opportunities for students. For these reasons, a range of measurement tools are needed to monitor the quality and outcomes of wide range of afterschool science programs. To explore the current state of evaluation and measurement tools for use in afterschool science programs, the University of Washington, in partnership with the Afterschool Alliance and the National Girls Collaborative, will design and host a conference for afterschool STEM leaders, researchers, and evaluators. This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This conference is grounded in the programmatic priorities and strategies of afterschool organizations. The goals of the conference are to (a) articulate and map the range of intended outcomes of afterschool STEM programs; (b) identify how existing measurement and evaluation tools map on to intended outcomes; and (c) identify overlaps, complementarities, and gaps in the available tools in order to provide guidance to (i) practitioners on how and why to select current evaluation tools and (ii) researchers on directions for future tool development. Tangible convening products include:
*A detailed, visual representation ("intended outcomes map") of the range of outcomes afterschool programs are seeking to achieve, related to student learning, educator capacity, program quality, family impacts, learning ecosystems connectivity;
*A taxonomy of current evaluation instruments aligned to these outcomes, with an explanation of how they overlap or differentiate both methodologically and theoretically;
*The identification of the areas where further work is needed, including further specification of learning outcomes and future development of evaluation tools.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
This award was provided as part of NSF's Social, Behavioral and Economic Sciences Postdoctoral Research Fellowships (SPRF) program and is supported by SBE's Developmental Sciences program and the Directorate for Education and Human Resources' (EHR) Advancing Informal STEM Learning program. The goal of the SPRF program is to prepare promising, early career doctoral-level scientists for scientific careers in academia, industry or private sector, and government. SPRF awards involve two years of training under the sponsorship of established scientists and encourage Postdoctoral Fellows to perform independent research. NSF seeks to promote the participation of scientists from all segments of the scientific community, including those from underrepresented groups, in its research programs and activities; the postdoctoral period is considered to be an important level of professional development in attaining this goal. Each Postdoctoral Fellow must address important scientific questions that advance their respective disciplinary fields. Under the sponsorship of Dr. Sandra D. Simpkins at the University of California, Irvine, this postdoctoral fellowship award supports an early career scientist exploring high-quality and culturally responsive, math afterschool program (ASP) practices for under-represented minority (URM) youth. Mathematical proficiency is the foundation of youth's STEM pursuits. Yet today, far too many youth do not pursue STEM based on a perception that they are "not good at math". Students need to engage in contexts that spark their interest and their continued mastery and growth. ASPs are settings for such dynamic opportunities, particularly for URM students such as Latinos who attend lower quality schools and do not feel supported. In college, URM students often struggle with uninspiring and culturally incongruent STEM learning environments. The intergenerational nature of university-based STEM ASPs, whereby younger students are paired with undergraduate (UG) mentors, are opportunities to support both K-12 and UG students' motivational beliefs in math and STEM more broadly. This project will examine these intergenerational developmental processes in the context of a math enrichment ASP located at a Hispanic-Serving Institution. By studying how ASPs can serve as an important lever for promoting URM students' access and success in STEM, this project seeks to meaningfully inform efforts to broaden the participation of underrepresented groups in these fields.
This project seeks to understand how participating in a math enrichment ASP supports both youth participants' and UG mentors' motivational beliefs in math; to describe high-quality and culturally responsive practices; and to understand how to support the effectiveness of youth-staff relationships. To accomplish these research objectives, data will be collected from both youth participants and UG mentors through multiple methods including surveys, in-depth interviews, participant-observations, and video observations of youth-staff interactions. This project will add to our understanding of university-ASP partnerships. Further, the knowledge gained from this study will impact the larger landscape of practice and research on STEM ASPs by 1) addressing critical gaps in the current literature on high-quality and culturally responsive STEM ASP practices and 2) informing ASP staff development training. Overall, this mixed methods project will provide critical and rich information on the ways that ASPs can effectively deliver on its promise of promoting positive development for all youth, especially URM youth who may need and benefit from these spaces the most. The invaluable insight garnered from this study will be disseminated to traditional academic audiences to advance knowledge, as well as to local, state, and national organizations to inform the larger landscape of practice in STEM ASPs.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
Gathering evidence for the long-term impact of programs for youth on their involvement in STEM studies and careers continues to be a challenge, especially for program interventions happening in earlier stages of development (e.g., elementary, middle, high-school years. Work that focuses on mechanisms for mitigating these challenges is important. The conference and associated activities aim to build a research action agenda that is rooted in practice to support better understanding of the long-term impacts of informal STEM programs for girls provided by cultural institutions, along with methods and approaches for measuring them. The project team will use a collaborative co-design approach to establish a STEM for Girls Research Alliance. The Alliance will include three levels of participants, with different levels of commitment: a core planning group (CPG) of 8-10 people, approximately 20-25 participating members (PM) and 50-60 interested stakeholder group representatives (SGR). The project team will utilize face-to-face meetings, digital engagement strategies, and surveys to develop the agenda and solicit multiple rounds of feedback and input. The CPG, consisting of leaders and representatives from state-based STEM for Girls organizations that are part of the National Girls Collaborative Project (NGCP) and members of the New York State STEAM for Girls Collaborative, will be responsible for setting priorities and guiding the action agenda. The PM will include representatives (educators and researchers) from informal STEM programs at cultural institutions that participate in the state-based collaboratives. The PM will be regularly consulted on important aspects of the action agenda that relate to their work. Finally, the SGR will include representatives from several audiences that are being served by or work with the participating members: girls and young women, parents, educators, funders, researchers and employers. The SG will be engaged via focus groups virtually or at national meetings to which these individuals attend.
To support broader involvement of professionals working in this sector, a comprehensive digital engagement plan using web and social media networks will be developed. The plan will utilize a consistent hashtag, #STEMeffect, allowing participants to follow the conversation across social media platforms. Social media platforms to be utilized will include Twitter, Instagram, Facebook, LinkedIn, Google+, Snapchat and others. More than 60,000 people will be engaged via the networks of the NY STEAM Collaborative, NGCP, WSKG Public Media and project partners. A robust research action plan will position researchers to further explore the role of informal STEM education experiences in shaping the career choices of girls and identify where there are breaks in the hoped-for pathways to STEM college and careers. It also will benefit informal STEM organizations by yielding information that will help them to fine-tune their programs for girls and young women. Ultimately, contributions to the knowledge base will result in broadened participation of girls and women in STEM programs and careers. This work is funded by the Advancing Informal STEM Learning (AISL) program as part of its strategy to enhance learning in informal environments and support innovative research, approaches, and resources for use in a variety of settings.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Lynda KennedyAlicia SantiagoBabette Moeller