This project, a collaboration of teams at Georgia Institute of Technology, Northwestern University, and the Museum of Design Atlanta and the Museum of Science and Industry in Chicago, will investigate how to foster engagement and broadening participation in computing by audiences in museums and other informal learning environments that can transfer to at-home and in-school engagement (and vice versa). The project seeks to address the national need to make major strides in developing computing literacy as a core 21st century STEM skill. The project will adapt and expand to new venues their current work on their EarSketch system which connects computer programming concepts to music remixing, i.e. the manipulation of musical samples, beats and effects. The initiative involves a four-year process of iteratively designing and developing a tangible programming environment based on the EarSketch learning environment. The team will develop three new applications: TuneTable, a multi-user tabletop exhibit for museums; TunePad, a smaller version for use at home and in schools; and an online connection between the earlier EarSketch program and the two new devices.
The goal is to: a) engage museum learners in collaborative, playful programming experiences that create music; b) direct museum learners to further learning and computational music experiences online with the EarSketch learning environment; c) attract EarSketch learners from local area schools to visit the museum and interact with novice TuneTable users, either as mentors in museum workshops or museum guests; and d) inform the development of a smaller scale, affordable tangible-based experience that could be used at homes or in smaller educational settings, such as classrooms and community centers. In addition to the development of new learning experiences, the project will test the hypothesis that creative, playful, and social engagement in the arts with computer programming across multiple settings (e.g. museums, homes, and classrooms) can encourage: a) deeper learner involvement in computer programming, b) social connections to other learners, c) positive attitudes towards computing, and d) the use and recognition of computational concepts for personal expression in music. The project's knowledge-building efforts include research on four major questions related to the goals and evaluation processes conducted by SageFox on the fidelity of implementation, impact, success of the exhibits, and success of bridging contexts. Methods will draw on the Active Prolonged Engagement approach (unobtrusive observation, interviews, tracking-and-timing, data summaries and team debriefs) as well as Participatory Action Research methods.
This work is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Michael HornBrian MagerkoJason Freeman
This project formed a partnership between a research team with experience in computer science (CS) education and learning sciences research and a newly fashioned practitioner team focused on building a grassroots, informal, volunteer group created to help women help themselves and others learn to write computer code. This research-practitioner partnership had a two-pronged focus, first on improving the program offered to learners through making adjustments based on research findings, and second on investigating the phenomenon of how women in the workforce informally learn CS skills that enable them to rewrite their career paths to contribute to what we know from research. The context of the study was situated in the virtual community that has formed around the phenomenally successful Salesforce Customer Relationship Management software platform.
This Exploratory Pathways project aimed to fill a gap in the research; we know little about the phenomenon of adult women in the workforce who are patching together resources to learn CS skills with a goal of job enhancement or job change. This project took an ethnographic approach to studying the informal learning (both through online, written resources and through sharing of knowledge with others) of the women involved in a 10-week, virtual Women’s Coaching and Learning group. The organization of this group consisted of learners—novice coders in the Apex language that is used on the Salesforce software platform, of coaches—more knowledgeable coders, and of a steering committee that ran the group and created the informal curriculum followed in the 10-week course.
Our overarching research question in this study was: In what ways are informal CS learning opportunities being used and created by adult women, what are their experiences with those opportunities, and how does this suggest ways to enhance those opportunities in the future to increase effectiveness in broadening access to and engagement in informal CS learning experiences for women?
We broke the question down into a number of sub questions, including:
Sociocultural context: What past gendered interactions do women report that discouraged (or encouraged) them from learning to code? What do interactions look like in female-only coaching and learning groups? In what ways does a coaching and learning group support persistence? What social barriers and supports outside the group affect persistence?
Personal context: What are the characteristics and backgrounds of female administrators who seek out resources to teach themselves to code? What are the motivations for these women to teach themselves to code? What motivates them to seek out and join all-women coding groups?
Physical context: How are women learning to code both through written resources and in virtual, informal coaching and learning classes? What are the conceptual barriers and supports that they encounter, and what works for women in these classes to overcome barriers? What conceptual barriers and supports affect persistence?
Persistence and identity: In what ways does participating in a learning group with female coaching motivate (or not) women to persist in learning to code? How do their goals or reasons for learning to code change through their participation? How does their identity as a “coder” change or shift as they participate?
Our findings for these subquestions are summarized in the “project products” linked to below.
The connections between technology applications of all sorts and human users that are ubiquitous in informal learning and assume a great deal about how the technology is used and how learning takes place. Much of the research in this area has been focused on game design and interaction. This project will examine this interaction involving the use of gestures that represent how individuals work with systems and large data sets that represent complex systems like the oceans, to understand how basic elements of a project with a 3-D type of design might enhance the user experience and increase the utility and learning that takes place by understanding the cognitive elements of these game like interactions in specific STEM related settings like museums.
This exploratory pathways project will investigate the use of interactive, gesture-enabled, multi-touch spheres for teaching about ocean systems in science centers and museums. The gesture-enabled aspect of the project will improve on interactive table-top installations which can frustrate users who use unexpected gestures and receive no response leading to brief interaction and abandonment without significant interaction or learning. The project will investigate ways in which unsupported gestures would still produce a system response which would encourage the user to remain at the installation and continue to investigate. The effect of multiple gestures will be supported by using natural mappings between gestures and interactions with the on-sphere data.
The project investigates theories of embodied cognition that support the notion that by engaging with global-scale datasets on a spherical display more effectively models the earth in a non-distorted manner and therefore will be more natural and allow users to develop a more accurate conceptual model of how data relates to itself and the globe. In this way, the project shares some aspects of understanding about learning through game play. The sphere will not be a fully developed game but will share characteristics of game play.
This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
Citizen science engages members of the public in science. It advances the progress of science by involving more people and embracing new ideas. Recent projects use software and apps to do science more efficiently. However, existing citizen science software and databases are ad hoc, non-interoperable, non-standardized, and isolated, resulting in data and software siloes that hamper scientific advancement. This project will develop new software and integrate existing software, apps, and data for citizen science - allowing expanded discovery, appraisal, exploration, visualization, analysis, and reuse of software and data. Over the three phases, the software of two platforms, CitSci.org and CyberTracker, will be integrated and new software will be built to integrate and share additional software and data. The project will: (1) broaden the inclusivity, accessibility, and reach of citizen science; (2) elevate the value and rigor of citizen science data; (3) improve interoperability, usability, scalability and sustainability of citizen science software and data; and (4) mobilize data to allow cross-disciplinary research and meta-analyses. These outcomes benefit society by making citizen science projects such as those that monitor disease outbreaks, collect biodiversity data, monitor street potholes, track climate change, and any number of other possible topics more possible, efficient, and impactful through shared software.
The project will develop a cyber-enabled Framework for Advancing Buildable and Reusable Infrastructures for Citizen Science (Cyber-FABRICS) to elevate the reach and complexity of citizen science while adding value by mobilizing well-documented data to advance scientific research, meta-analyses, and decision support. Over the three phases of the project, the software of two platforms, CitSci.org and CyberTracker, will be integrated by developing APIs and reusable software libraries for these and other platforms to use to integrate and share data and software. Using participatory design and agile methods over four years, the project will: (1) broaden the inclusivity, accessibility, and reach of citizen science; (2) elevate the value and rigor of citizen science software and data; (3) improve interoperability, usability, scalability and sustainability of citizen science software and data; and (4) mobilize data to allow cross-disciplinary research and meta-analyses. These outcomes benefit society by making citizen science projects and any number of other possible topics more possible, efficient, and impactful through shared software and data. Adoption of Cyber-FABRICS infrastructure, software, and services will allow anyone with an Internet or cellular connection, including those in remote, underserved, and international communities, to contribute to research and monitoring, either independently or as a team. This project is also being supported by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
DATE:
-
TEAM MEMBERS:
Gregory NewmanLouis LiebenbergStacy LynnMelinda Laituri
Situated within the Advancing Informal STEM Learning program, this Research in Service to Practice award seeks to design, implement, and evaluate an intervention aimed at fostering a culture of productive failure practices. The project responds to a broad concern in educational research and practice: Experiences of failure are frequently so negative that students shut down, lose agency, and develop low self-efficacy and learned helplessness. Surrendering too quickly to obstacles is particularly unfortunate, given evidence that initially "getting it wrong" ultimately breeds deep and sustained learning. In order to learn how students can make the most of productive failure, the proposed project will study how a community of practice that includes middle school youth and their mentors attempts to change its handling of learning obstacles. Building on prior research documenting storytelling practices in an afterschool program, the team now aims to embolden young students' productive practices of failure storytelling in computer science, a field in which experts practice candid, pervasive, and collaborative discourse around errors ("bugs"). Pulling together the domains of narrative analysis, meta-cognitive reflection, and control theories of motivation, within the context of authentic computer-science debugging activity, this study develops a theoretical framework that views productive responses to failure as a discipline-specific process of reflecting as a community on how to locate obstacles, how to construct causal theories about why those obstacles emerged, and how to plan productive responses. A design-based research approach will investigate three questions: (1) What is the impact of the interventions on students and instructors' actions and discourse when they are debugging errors in computer code? (2) What is the impact of the interventions on students and instructors' reflections back on their prior debugging experiences and on failure in general? and (3) What is the impact of the instructor-development efforts on the instructors' capacity to foster students' productive attitudes toward failure? The study focus will be 15 summer and weekend coding workshops with 5th-8th grade students from populations typically under-represented in STEM. The interventions are (a) setting new norms and practices for debugging, (b) instructor education, and (c) coding software that provides students with feedback on their productive struggle. Data sources include video and audio recordings of the learning environment, artifacts produced during the activities, and semi-structured interviews. Measures will capture variations in debugging activities, reflections on debugging, students' ideas about grit and growth mindset, and instructors' struggles and successes with the new curriculum. The empirical results will consist of mixed-methods, micro-longitudinal accounts of how a community of practice works to reform its orientation to failure. The products of this work include empirical knowledge, theory, and curriculum about how learning communities help students develop robust and efficient responses to failure. These will be disseminated through journals, open-source software, and workshops/conferences for researchers and practitioners working with youth afterschool programs. The products may be useful for exploring practices in the classroom. This project is being conducted by the 9 Dots Community Learning Center, UCLA and UC Berkeley.
DATE:
-
TEAM MEMBERS:
Melissa ChenDor AbrahamsonNoel EnyedyFrancis SteenDavid DeLiema
As part of an overall strategy to enhance learning within maker contexts in formal and informal environments, the Innovative Technology Experiences for Students and Teachers (ITEST) and Advancing Informal STEM Learning (AISL) programs partnered to support innovative models for making in a variety of settings through the Enabling the Future of Making to Catalyze New Approaches in STEM Learning and Innovation Dear Colleague Letter. This Early Concept Grant for Exploratory Research (EAGER) will test an innovative approach to bringing making from primarily informal out-of-school contexts into formal science classrooms. While the literature base to support the positive outcomes and impacts of design-based making in informal settings at the K-12 level is emerging, to date, minimal studies have investigated the impacts of making design principles within formal contexts. If successful, this project would not only add to this gap in the literature base but would also present a novel model for bridging the successful engineering design practices of making and tinkering primarily found in informal science education into formal science education classrooms. The model would also demonstrate an innovative, highly interactive way to engage high school students and their teachers in engineering based design principles with immediate real-world applications, as the scientific instruments developed in this project could be integrated directly into science classrooms at relatively minimal costs.
Through a multi-phased design and implementation model, high school students and their teachers will engage deeply in making design principles through the design and development of their own scientific instruments using Arduino-compatible hardware and software. The first phase of the project will reflect a more traditional making experience with up to twenty high school students and their teachers participating in an after-school design making club, in this case, focused on the development and testing of scientific instrument prototypes. During the second phase of the project, the first effort to transpose the after school making experience to a more formalized experience will be tested with up to eight students selected to participate in two week summer research internships focused on scientific instrument design and development through making at Northwestern University. A two-day summer teacher workshop will also be held for high school teachers participating in the subsequent pilot study. The collective insights gleaned from the after school program, student internships, and teacher workshop will culminate to inform the full implementation of the formal classroom pilot study. The third and final phase will coalesce months of iterative, formative research, design and development, resulting in a comprehensive pilot investigation in up to seven high school physics classrooms.
Using a multi-phased, mixed methods exploratory design-based research approach, this 18-month EAGER will explore several salient research questions: (a) How and to what extent does the design & making of scientific instrumentation serve as useful tasks for learning important science and engineering knowledge, practices, and epistemologies? (b) How engaging is this making activity to learners of diverse abilities and prior interests? What can be generalized to other types of making activities? (c) How accessible is the Arduino hardware and coding environment to learners? What combination of hardware and software materials and tools best support accessibility and learning in this type of digital making activity? and (d) What types of scaffolding (for students and teachers) are required to support the effective use of maker materials and activities in a classroom setting? Structured interviews, artifacts, video recordings from visor cameras, student design logs, logfiles, and ethnographic field notes will be employed to garner data and address the research questions. Given the early stage of the proposed research, the dissemination of the findings will be limited to a few select journals, teacher forums and workshops, and professional conferences.
This EAGER is well-poised to directly impact up to 125 high school physics students (average= 25 students/class), approximately 7 high school physics teachers, 6-8 high school summer interns, nearly 20 high school students participating in the after-school design making club, and indirectly many more. The results of this EAGER could provide the basis and evidence needed to support a more robust, expanded future investigation to further substantiate the findings and build the case for similar efforts to bring making into formal science education contexts.
The Cyberlearning Resource Center (CRC) has responsibility for promoting integrative collaboration among cyberlearning grantees (across NSF programs); synthesis and national dissemination of cyberlearning findings, technologies, models, materials, and best practices; creating a national presence for Cyberlearning; helping the disparate Cyberlearning research and development communities coordinate efforts to build capacity; and providing infrastructure (technological and social) for supporting these efforts. Monitored through the Cyberlearning: Transforming Education program, the CRC serves as a resource for all NSF grantees and programs with cyberlearning components, helping to promote synergy and integrate projects across NSF's cyberlearning investments. Among society's central challenges are amplifying, expanding, and transforming opportunities people have for learning and more effectively drawing in, motivating, and engaging young learners. Engaging actively as a citizen and productively in the workforce requires understanding a broad variety of concepts and possessing the ability to collaborate, learn, solve problems, and make decisions. Whether learning is facilitated in school or out of school, and whether learners are youngsters or adults, to develop such knowledge and capabilities, learners must be motivated to learn, actively engage over the long term in learning activities, and put forth sustained cognitive and social effort. Consistent with NSF's mission and strategic plan, a variety of programs at NSF invest in research aimed towards achieving these goals. In support of this important thematic thrust, the Cyberlearning Resource Center works with researchers and NSF program officers to identify and disseminate findings from across programs and projects; develop ways to broker productive partnerships and collaborations; convene meetings for purposes of envisioning the future, integrating findings, and building capacity,; and monitor the cyberlearning portfolio and its influences and impacts.
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.
Bridging Earth and Mars (BEAM): Engineering Robots to Explore the Red Planet engages the general public and K-8 students in exhibits and programs designed to foster awareness of robotic technology, computer programming, and the challenges and opportunities inherent in NASA missions and S-STEM careers. The Saint Louis Science Center (SLSC) of St. Louis, Missouri is the lead institution and project site; partners include Washington University in St. Louis, Saint Louis University, the St. Louis regional FIRST Robotics organization, and the Challenger Learning Center-St. Louis. Project goals are to: 1) inform, engage, and inspire the public to appreciate NASA’s Mission by sharing findings and information about NASA’s missions to Mars; 2) ignite interest in S-STEM topics and careers for diverse K-8 students; and, 3) encourage students in grades 6-8 to sustain participation in educational experiences along the S-STEM careers pipeline. The SLSC will design and build a Martian surface and panorama where two rovers can be remotely controlled. Visitors in the McDonnell Planetarium will use controllers to program rover exploration of the Martian landscape in real-time. Visitors in SLSC’s Cyberville gallery, located one-quarter mile away across a highway-spanning enclosed bridge, will program the second rover with simulated time lag and view its movements via a two-way camera system. SLSC will organize and host a series of Innovation Workshops for K-8 students, each featuring teamwork-building engineering challenges from current and updated NASA-based science curricula. Participants will be recruited from SLSC community partners, which include community centers and faith-based programs for underserved families.
Research shows that participation and interest in science starts to drop as youth enter high school. This is also the point when science becomes more complex and there is increased need for content knowledge, mathematics capability, and computer or computational knowledge. Evidence suggests that youth who participate in original scientific research are more likely to enter and maintain a career in science as compared to students who do not have these experiences. We know young people get excited by space science. This project (STEM-ID) is informed by previous work in which high school students were introduced to scientific research and contributed to the search for pulsars. Students were able to develop the required science and math knowledge and computer skills that enabled them to successfully participate. STEM-ID builds on this previous work with two primary goals: the replication of the local program into a distributed program model and an investigation of the degree to which authentic research experiences build strong science identities and research self-efficacies. More specifically the project will support (a) significant geographic expansion to institutions situated in communities with diverse populations allowing substantial inclusion of under-served groups, (b) an online learning and discovery environment that will support the participation of youth throughout the country via online activities, and (c) opportunities for deeper participation in research and advancement within the research community. This project is funded by the Advancing Informal STEM Learning (AISL) program which seeks to advance new approaches to, and understanding of, the design and development of STEM learning in informal environments. STEM-ID will serve 2000 high school youth and 200 high school teachers in afterschool clubs with support from 30 undergraduate and graduate students and 10 college/university faculty. Exploratory educational research will determine the broad mechanisms by which online activities and in-person and online peer-mentor teacher-scientist interactions influence science identity, self-efficacy, motivation, and career intentions, as well as a focused understanding of the mechanisms that influence patterns of participation. Youth will be monitored longitudinally through the first two years of college to provide an understanding of the long-term effects of out-of-class science enrichment programs on STEM career decisions. These studies will build an understanding of the best practices for enhancing STEM persistence in college through engagement in authentic STEM programs before youth get to college. In addition to the benefits of the education research, this program may lead participants to discover dozens of new pulsars. These pulsars will be used for fundamental advances such as for testing of general relativity, constraining neutron star masses, or detecting gravitational waves. The resulting survey will also be sensitive to transient signals such as sporadic pulsars and extragalactic bursts. This project provides a potential model for youth from geographical disparate places to participate in authentic research experiences. For providers, it will offer a model for program delivery with lower costs. Findings will support greater understanding of the mechanisms for participation in STEM. This work is being led by West Virginia University and the National Radio Astronomy Observatory. Participating sites include California Institute of Technology, Cornell University, El Paso Community College, Howard University, Montana State University, Penn State University, Texas Tech University, University of Vermont, University of Washington, and Vanderbilt University.
A recent report by the Association for Computing Machinery estimates that by decade's end, half of all STEM jobs in the United States will be in computing. Yet, the participation of women and underrepresented groups in post-secondary computer science programs remains discouragingly and persistently low. One of the most important findings from research in computer science education is the degree to which informal experiences with computers (at many ages and in many settings) shape young people's trajectories through high school and into undergraduate degree programs. Just as early language and mathematics literacy begins at home and is reinforced throughout childhood through a variety of experiences both in school and out, for reasons of diversity and competency, formal experiences with computational literacy alone are insufficient for developing the next generation of scientists, engineers, and citizens. Thus, this CAREER program of research seeks to contribute to a conceptual and design framework to rethink computational literacy in informal environments in an effort to engage a broad and diverse audience. It builds on the concept of cultural forms to understand existing computational literacy practices across a variety of learning settings and to contribute innovative technology designs. As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds new approaches to and evidence-based understanding of the design and development of STEM learning in these settings. This CAREER program of research seeks to understand the role of cultural forms in informal computational learning experiences and to develop a theoretically grounded approach for designing such experiences for youth. This work starts from the premise that new forms of computational literacy will be born from existing cultural forms of literacy and numeracy (i.e., for mathematical literacy there are forms like counting songs -- "10 little ducks went out to play"). Many of these forms play out in homes between parents and children, in schools between teachers and students, and in all sorts of other place between friends and siblings. This program of study is a three-phased design and development effort focused on key research questions that include understanding (1) how cultural forms can help shape audience experiences in informal learning environments; (2) how different cultural forms interact with youth's identity-related needs and motivations; and (3) how new types of computational literacy experiences based on these forms can be created. Each phase includes inductive research that attempts to understand computational literacy as it exists in the world and a design phase guided by concrete learning objectives that address specific aspects of computational literacy. Data collection strategies will include naturalist observation, semi-structured, and in-depth interviews, and learning assessments; outcome measures will center on voluntary engagement, motivation, and persistence around the learning experiences. The contexts for research and design will be museums, homes, and afterschool programs. This research builds on a decade of experience by the PI in designing and studying computational literacy experiences across a range of learning settings including museums, homes, out-of-school programs, and classrooms. Engaging a broad and diverse audience in the future of STEM computing fields is an urgent priority of the US education system, both in schools and beyond. This project would complement substantial existing efforts to promote in-school computational literacy and, if successful, help bring about a more representative, computationally empowered citizenry. The integrated education plan supports the training and mentoring of graduate and undergraduate students in emerging research methods at the intersection of the learning sciences, computer science, and human-computer interaction. This work will also develop publically available learning experiences potentially impacting thousands of youth. These experiences will be available in museums, on the Web, and through App stores.