Off

Partnerships between universities and industry can yield important research and commercial breakthroughs. ATLAS professor Ellen Do has worked to cultivate relationships between CU Boulder and industry players, including as a member of the Pervasive Personalized Intelligence (PPI) Center, to support graduate students and enhance opportunities for commercialization of ATLAS research.

The , which recently concluded its tenure, was founded “with a mission of bringing industry and university talent together to solve the intelligence challenges faced by software and computer engineers in Internet of Things systems." It operated under the supervision of the National Science Foundation and included members from NEC, Intel and Trimble.

“It’s been such a good experience. We’ve learned a lot. Ellen Do and her team have helped to expand our thinking and encouraged us to explore new areas.” - Dr. Haifeng Chen, Head of Data Science Department at NEC Laboratories, and his colleague Kai Ishikawa, Principal Researcher (PPI Center event recap)

The PPI Center’s in Portland, OR, included a research poster session, and ATLAS students were honored with three of the four awards industry attendees voted on at the event. 

• Suibi Che-Chuan Weng, PhD student, won "Most Industry Ready" for Editing Reality: Empowering Users to Manipulate Reality through Addition, Erasing, and Modification with Speech to Prompt in Mixed Reality.
• Rishi Vanukuru, PhD student, won "Most Impactful" for Asynchronous spatial guidance using mobile devices and Augmented Reality.
• Ada Zhao, MS student, won "Most Impactful" for The WizARd and Apprentice: Augmented Reality Expert Capture for Training Novices.

2 more ATLAS PhD students participated: Krithik Ranjan presented PuppetGuide: Tangible Personalized Museum Tour Guides using LLMs and David Hunter presented Tangible Interaction with Object Detection and Large Language Models.

As for the experience participating in the PPI Center, Do says, “it is good to know that the industry is interested in supporting research and considers our research relevant.” She sees ways ATLAS could form partnerships within several industry sectors on a range of themes due to the multidisciplinary nature of the research conducted here.

Since their involvement in PPI started, Do and her team have had a series of meetings with mentors from global technology firms, discussing collaborative research opportunities.

Vanukuru is currently doing an internship at Microsoft Research Cambridge focused on spatial computing in its VR/AR group. Weng and Zhao are working on research in the ACME Lab this summer, extending the Editing Reality (and PuppetGuide), and WizARd and Apprentice projects with interns from the CU SPUR program. Zhao is also conducting a pilot study, interviewing laser cutter operating experts about how they would demonstrate operations and how they can annotate their demonstration using the WizARd prototype for novice learners. Hunter has embarked on an internship with Trimble this summer, while he and Ranjan are also working in the ACME Lab.

Off

ATLAS is well-represented at #TEI2024 - the 18th ACM International Conference on Tangible, Embedded and Embodied Interaction. This year’s conference, in Cork, Ireland, celebrates “cutting-edge scientific research and art that is on the edge of disciplines and on the edge of new unique developments and possibilities.”

Research from 12 members of the ATLAS community including faculty, alumni and students is featured at the conference. The work spans a range of disciplines, including weaving, biomaterials, mixed reality and robotics. In addition, ACME Lab director, Ellen Do, acted as Co-Chair of Graduate Student Consortium; PhD student, Sandra Bae, was an Associate Chair for Pictorials; and ATLAS PhD alum, Fiona Bell, was an Associate Chair for Papers.

Research ATLAS PhD students presented at TEI’24


Shanel Wu, Xavier A Corr, Xi Gao, Sasha De Koninck, Robin Bowers, and Laura Devendorf

Abstract: We present the Loom Pedals, an open-source hardware/software interface for enhancing a weaver’s ability to create on-the-fly, improvised designs in Jacquard weaving. Learning from traditional handweaving and our own weaving experiences, we describe our process of designing, implementing, and using the prototype Loom Pedals system with a TC2 Digital Jacquard loom. The Loom Pedals include a set of modular, reconfigurable foot pedals which can be mapped to parametric Operations that generate and transform digital woven designs. Our novel interface integrates design and loom control, providing a customizable workflow for playful, improvisational Jacquard weaving. We conducted a formative evaluation of the prototype through autobiographical methods and collaboratively developed future Loom Pedals features. We contribute our prototype, design process, and conceptual reflections on weaving as a human-machine dialog between a weaver, the loom, and many other agents.

Fiona Bell, Joshua Coffie, and Mirela Alistar

Abstract: We explore how actively engaging with the temporalities of a nonhuman organism can lead to multispecies understanding. To do so, we design a bio-digital calendar that brings attention to the growth and health of kombucha SCOBY, a symbiotic culture of bacteria and yeast that lives in a tea medium. The non-invasive bio-digital calendar surrounds the kombucha SCOBY to track (via sensors) and enhance (via sound) its growth. As we looked at and listened to our kombucha SCOBY calendar on a daily basis, we became attuned to the slowness of kombucha SCOBY. This multisensory noticing practice with the calendar, in turn, destabilized our preconceived human-centered positionality, leading to a more humble, decentered relationship between us and the organism. Through our experiences with the bio-digital calendar, we gained a better relational multispecies understanding of temporalities based on care, which, in the long term, might be a solution to a more sustainable future.

Yuzhen Zhang, Ruixiang Han, Ran Zhou, Peter Gyory, Clement Zheng, Patrick C. Shih, Ellen Yi-Luen Do, Malte F Jung, Wendy Ju, and Daniel Leithinger

Abstract: Driven by the vision of future responsive environments, where everyday surroundings can perceive human behaviors and respond through intelligent robotic actuation, we propose Wizard of Props (WoP): a human-centered design workflow for creating expressive, implicit, and meaningful interactions. This collaborative experience prototyping approach integrates full-scale physical props with Mixed Reality (MR) to support ideation, prototyping, and rapid testing of responsive environments. We present two design explorations that showcase our investigations of diverse design solutions based on varying technology resources, contextual considerations, and target audiences. Design Exploration One focuses on mixed environment building, where we observe fluid prototyping methods. In Design Exploration Two, we explore how novice designers approach WoP, and illustrate their design ideas and behaviors. Our findings reveal that WoP complements conventional design methods, enabling intuitive body-storming, supporting flexible prototyping fidelity, and fostering expressive environment-human interactions through in-situ improvisational performance.

Fiona Bell, Shanel Wu, Nadia Campo Woytuk, Eldy S. Lazaro Vasquez, Mirela Alistar, and Leah Buechley

Abstract: In this studio, we will explore sustainable tangible interfaces by making a range of biomaterials that are bio-based and readily biodegradable. Building off of previous TEI studios that were centered around one specific biomaterial (i.e., bioplastics at TEI’22 and microbial cellulose at TEI’23), this studio will provide participants the ability to experience a wide variety of biomaterials from algae-based bioplastics, to food-waste-based bioclays, to gelatin-based biofoams. We will teach participants how to identify types of biomaterials that are applicable to their own research and how to make them. Through hands-on activities, we will demonstrate how to implement biomaterials in the design of sustainable tangible interfaces and discuss topics sensitized by biological media such as more-than-human temporalities, bioethics, care, and unmaking. Ultimately, our goal is to facilitate a space in which HCI researchers and designers can collaborate, create, and discuss the opportunities and challenges of working with sustainable biomaterials.

Ruhan Yang

Abstract: Modular robots have proven valuable for STEM education. However, modular robot kits are often expensive, which makes them limited in accessibility. My research focuses on using paper and approachable techniques to create modular robots. The kit’s design encompasses three core technologies: paper circuits, sensation feedback mechanisms, and 3D geometry. I have developed proof-of-concept demonstrations of technologies for each aspect. I will integrate these technologies to design and build a paper modular robot kit. This kit includes various types of modules for input, output, and other functions. My dissertation will discuss the development of these technologies and how they are integrated. This research will address the considerations and techniques for paper as an interactive material, providing a guideline for future research and development of paper-based interaction.

Off

ATLAS Professor Ellen Yi-Luen Do had the opportunity to be a keynote speaker at , a symposium hosted by the Taiwan Human-Computer Interaction Society at Taiwan University in Taipei. The event gathered researchers and practitioners across a range of backgrounds in technology, design and human factors to deepen community connections and explore new ideas. 

Sessions included presentations on fabrication, perception, interactions and other timely topics, with a surprising range in mediums from humble materials like felt and puppets to advanced VR technologies and metaverse interactivity.

As director of the ACME Lab at ATLAS, Do and her team conduct research on using everyday items as interfaces, creating objects to think with, new ways of working, and methods and tools to help others make things. Do delivered her presentation, entitled “Fun with Creative Technology & Design”, advocating for playful computing with easily accessible materials like paper and cardboard, while highlighting ways to make toolkits for others to create for themselves. 

The audience, which included experts in computer science, psychology, media, art, design and business responded enthusiastically, finding common ground in this relatable, inclusive approach to otherwise complex technologies. Do received a particularly warm reception from students in the field. She noted, “Several students came to thank me for my talk, stating that they learned so much from me, and that they never thought research could be this fun and interesting.” 

Do expressed excitement for a few standout presentations from the conference including , Distinguished Scientist at Google DeepMind, who delivered a keynote on the large language model revolution. She said, “I was happy to learn that Bard will be a tool-use application applying to many of the Google apps and services people already use, including Maps, Sheets, Gmail, Docs, and more.” 

She also called out by Ping-Yi Wang and Lung-Pan Cheng as particularly intriguing.

Back in 2015, Do wrote the article “”, and saw the founding of Taiwan HCI. Looking back, she reflects, “I’m happy to see TaiCHI 2023 have 300 people registered with vibrant discussions, demos and posters. It's definitely growing!”

Off

ATLAS is well-represented at this year’s conference convening at Carnegie Mellon University in Pittsburgh from July 10-14, 2023. This year’s theme is resilience. 

"Resilience is at once about flexibility, durability, and strength as well as a sense of mutuality and hope where solidaristic modes of engagement make new kinds of worlds possible. 

This also recognizes that resilience takes many forms in design discourse, ranging across: indigenous knowledge, more-than-human perspectives, and the relationship between human, material and artificial intelligences."

It is exciting to see members across more than half of ATLAS labs represented in this year’s proceedings, with broad-reaching research covering microbiomes as materials for interactive design; 3D printing with spent coffee grounds; personal informatics systems; improving cross-disciplinary collaboration among artists and researchers; expressive movement for altering emotions and awareness; and the intersection of crocheting and data. Take a look:

Fiona Bell (ATLAS PhD alum), Michelle Ramsahoye (ATLAS affiliate PhD student), Joshua Coffie (ATLAS MS alum), Julia Tung (ATLAS BS student), and Mirela Alistar (ATLAS Living Matter Lab director, assistant professor)

Our bodies are home to an unseen ecosystem of microbes that live in symbiosis with us. In this work, we extend the “human” in Human-Computer Interaction (HCI) to include these microbes. Specifically, we explore the skin microbiome as an intimate material for interaction design. Viewing the body as a microbial interface, we start by presenting a method to grow our microbiome such that it becomes visible to the human eye. We then present a design space that explores how different environmental parameters, such as temperature and growth media, can be controlled to influence the color of the microbiome. We further investigate how our interactions in a daily uncontrolled environment (e.g., exercising, hugging, typing) can impact the microbiome. We demonstrate several wearable applications that reveal and control the microbiome. Lastly, we address the challenges and opportunities of working with the microbiome as an intimate, living material for interaction design.

Michael L. Rivera (ATLAS Utility Research Lab Director, assistant professor), S. Sandra Bae (ATLAS PhD student)

The widespread adoption of 3D printers exacerbates existing environmental challenges as these machines increase energy consumption, waste output, and the use of plastics. Material choice for 3D printing is tightly connected to these challenges, and as such researchers and designers are exploring sustainable alternatives. Building on these efforts, this work explores using spent coffee grounds as a sustainable material for prototyping with 3D printing. This material, in addition to being compostable and recyclable, can be easily made and printed at home. We describe the material in detail, including the process of making it from readily available ingredients, its material characteristics and its printing parameters. We then explore how it can support sustainable prototyping practices as well as HCI applications. In reflecting on our design process, we discuss challenges and opportunities for the HCI community to support sustainable prototyping and personal fabrication. We conclude with a set of design considerations for others to weigh when exploring sustainable materials for 3D printing and prototyping.

For additional details, see our article on how this and other Utility Research Lab projects won awards at the Rocky Mountain RepRap Festival.

Michael Jeffrey Daniel Hoefer, Stephen Voida, (ATLAS affiliate assistant professor, founding faculty, information science)

A grand challenge for computing is to better understand fundamental human needs and their satisfaction. In this work, we design a personal informatics technology probe that scaffolds reflection on how time-use satisfies Max-Neef's fundamental needs of being, having, doing, and interacting via self-aspects, relationships and organizations, activities, and environments. Through a combination of a think-aloud study (N=10) and a week-long in situ deployment (N=7), participants used the probe to complete self- aspect elicitation and Day Reconstruction Method tasks. Participants then interacted with network visualizations of their daily lives, and discovered insights about their lives. During the study, we collected a dataset of 662 activities annotated with need satisfaction ratings. Despite challenges in operationalizing a theory of need through direct elicitation from individuals, personal informatics systems show potential as a participatory and individually meaningful approach for understanding need satisfaction in everyday life.

Ruhan Yang (ATLAS PhD student), Ellen Yi-Luen Do (ATLAS ACME Lab director, faculty member)

This paper explores the implementation of embedded magnets to enhance paper-based interactions. The integration of magnets in paper-based interactions simplifies the fabrication process, making it more accessible for building soft robotics systems. We discuss various interaction patterns achievable through this approach and highlight their potential applications.

[Workshop]
Laura Devendorf (ATLAS Unstable Design Lab director, assistant professor), Leah Buechley, Noura Howell, Jennifer Jacobs, Hsin-Liu (Cindy) Kao, Martin Murer, Daniela Rosner, Nica Ross, Robert Soden, Jared Tso, Clement Zheng (ATLAS PhD alum)

While cross-disciplinary collaboration has long been, and continues to be a cornerstone of inventive work in interactive design, the infrastructures of academia, as well as barriers to participation imposed by our professional organizations, make collaboration for some groups harder than others. In this workshop, we’ll focus specifically on how artists residencies are addressing (or not) the challenges that artists, craftspeople, and/or independent designers face when collaborating with researchers affiliated with DIS. While focusing on the question “what is mutual benefit”, this workshop seeks to combine the perspectives of artists as well as researchers collaborating with artists (through residencies or otherwise) to (1) reflect on benefits or deficiencies in what we are currently doing and (2) generate resources for our community to effectively structure and evaluate our methods of collaboration with artists. Our hope is to provide recognition of and pathways for equitable inclusion of artists as a first step towards broader infrastructural change. 

Refer to the for more details on this research. 

 

[Demo]
Ruojia Sun (ATLAS PhD student), Althea Vail Wallop (ATLAS MS student), Grace Leslie (ATLAS Brain Music Lab director, assistant professor), Ellen Yi-Luen Do (ATLAS ACME Lab director, faculty member)

Movement forms the basis of our thoughts, emotions, and ways of being in the world. Informed by somaesthetics, we design for "taking up space" (e.g. encouraging expansive body movements), which may in turn alter our emotional experience. We demonstrate SoniSpace, an expressive movement interaction experience that uses movement sonification and visualization to encourage users to take up space with their body. We use a first-person design approach to embed qualities of awareness, exploration, and comfort into the sound and visual design to promote authentic and enjoyable movement expression regardless of prior movement experience. Preliminary results from 20 user experiences with the system show that users felt more comfortable with taking up space and with movement in general following the interaction. We discuss our findings about designing for somatically-focused movement interactions and directions for future work.

[Demo]
Mikhaila Friske (ATLAS affiliate PhD student)

This demo focuses around crocheting and data. In addition to a physical workbook for conference goers to peruse and try, there will be a few small set-ups for specific activities and a small craft circle for people to craft within if they so choose.

Off

11 ATLAS community members have contributed to work featured at the 22nd annual to be held on June 19-23, 2023 at Northwestern University in Chicago, Illinois. IDC is the premier international conference for researchers, educators and practitioners to share the latest research findings, innovative methodologies and new technologies in the areas of inclusive child-centered design, learning and interaction. IDC’23 is hosted by the Center for Computer Science and Learning Sciences at Northwestern University.

Coming out of the pandemic, this year’s theme asks participants to “rediscover childhood” to understand what it means to be a child in this and coming decades and what adults can do to provide a sustainable and equitable future for the next generation. Key topics include privacy, ethics, equity, social and emotional wellbeing, sustainability, and healthy human development.

Research presented by ATLAS faculty, students and affiliates

Casey Lee Hunt (ATLAS THING Lab member, PhD student), Kaiwen Sun, Zahra Dhuliawala, Fumi Tsukiyama, Iva Matkovic, Zachary Schwemler (ATLAS MS alumnus), Anastasia Wolf, Zihao Zhang, Allison Druin, Amanda Huynh, Daniel Leithinger (ATLAS THING Lab Director, Computer Science faculty member), Jason Yip

Children’s online co-design has become prevalent since COVID-19. However, related research focuses on insights gained across several shorter-term projects, rather than longitudinal investigations. To explore longitudinal co-design online, we engaged in participatory design with children (ages 8 - 12) for 20 sessions in two years on a single project: an online collaboration platform with tabletop telepresence robots. We found that (1) the online technology space required children to play a role as technology managers and troubleshooters, (2) the home setting shaped online social dynamics, and (3) providing children the ability to choose their design techniques prevented gridlock from situational uncertainties. We discuss how each finding resulted from interplay between our long-term technology design and online co-design processes. We then present insights about the future of online co-design, a conceptual model for longitudinal co-design online, and describe opportunities for further longitudinal online co-design research to generate new methods, techniques, and theories.

Junnan Yu, Ronni Hayden (PhD student), Ricarose Roque (Assistant Professor, Information Science)

Physical play has often been leveraged to provide children with active and engaging learning experiences. However, coding activities are predominantly sedentary in front of the screen, and the application of physical play in Computer Science education is less explored, e.g., how can we engage in computational thinking (CT) through physical play? In this design-based exploration, we conducted three design activities where young children, college students, and researchers were invited to create physical play projects using the BBC micro:bit and reflect on their experiences. By examining participants’ projects and creating processes, we provide empirical evidence that remixing physical play activities with coding can engage learners in various CT concepts and practices, reveal how CT concepts and practices can be represented in physical play, and highlight implications for designing physical play-mediated computational learning experiences. Ultimately, we encourage more learning experiences to incorporate physical play into computing education for children.

Ricarose Roque chairs the session “Computational and Data Literacy” in which this paper is included.

[Pictorial]
Ricarose Roque (Assistant Professor, Information Science)

This pictorial presents visuals of families engaging with creative technologies as “knowledge-building artifacts” to provoke reflection on the social, material, and emotional context of designed interactions (“things that make you think”) as well as provocations to re-value these contexts and promote alternative visions in what and how engagement with computing can look like (“things that matter”). The selected images are from a large and ongoing collection of documentation from a family technology program. The images were captured using the Reggio Emilia documentation approach to documentation, which aims to “make learning visible.”

Ricarose Roque is one of three Pictorial Chairs in the conference Organizing Committee.

[Work-in-progress]
Krithik Ranjan (ATLAS ACME Lab member, PhD student), Peter Gyory (ATLAS ACME Lab member, PhD Candidate), Michael L. Rivera (Utility Research Lab Director, Assistant Professor, Human-Computer Interaction and Digital Fabrication), and Ellen Yi-Luen Do (ATLAS ACME Lab Director, Computer Science faculty member)

Computational thinking has been identified as an important skill for children to learn in the 21st century, and many innovative kits and tools have been developed to integrate it into children’s learning. Yet, most solutions require the use of devices like computers or other expensive hardware, thus being inaccessible to low-income schools and communities. We present Cartoonimator, a low-cost, paper-based computational kit for children to create animations and engage with computational thinking. Cartoonimator requires only paper and a smartphone to use, offering an affordable learning experience. Children can draw the scenes and characters for their animation on the paper, which is printed with computer vision markers. We developed the mobile web app to provide an interface to capture keyframes and compile them into animations. In this paper, we describe the implementation and workflow of Cartoonimator, its deployment with children at a local STEAM event, and a planned evaluation for the kit.

[Work-in-progress] 
Cornelius Onimisi Adejoro, Luise Arn, Larissa Schwartz (Master's student), Tom Yeh (Associate Professor, Computer Science)

This paper presents a new approach to engaging children in Nigeria to share their views of AI. This approach is centered on an inclusive writing contest for children in a secondary school in Abuja to write about AI to compete for prizes and share their writings with others. A preliminary analysis of the first 11 articles we received exhibits diverse gender and ethnic representation that conveys cultural values and perspectives distinct from those of the children in Western countries. This finding suggests future work to conduct an in-depth cross-cultural analysis of the articles and to replicate similar writing contests to engage children in other underrepresented countries

Off

The Engineering Education and AI-Augmented Learning Interdisciplinary Research Theme awarded multiple seed grants this spring to help spur research teaming in the college and boost early projects with the high potential for societal impact, including to several ATLAS Institute affiliates.

Off

Over the years, the computer-human interaction field has seen many trends. For a time, gesture and pen-based interactions were key, then with the rising ubiquity of smartphones came a focus on haptic technologies. Now according to Ellen Do, ATLAS ACME Lab director, “material exploration” was the theme of the day at , the premiere conference on computer-human interaction. 

Where researchers tend to focus on advanced electronics and innovative fibers, Do champions the use of everyday components as the basis for radical creativity and invention.  

At the ACME Lab, Do notes that her students consistently look to humble, easy-to-source materials like paper, cardboard and even couch cushion foam for inspiration. These ubiquitous materials are often overlooked, but they offer many possibilities for developing ingenious tools for human-computer interaction that can be printed, cut and assembled with ease. 

Access to off-the-shelf tools allows ACME Lab researchers to speed the prototyping process, giving them freedom to quickly iterate and push their thinking. When paired with the advanced camera and sensor technology found in everyday smartphones and off-the-shelf electronics like microprocessors, the team has the power to create limitless forms of human-computer interaction.

The team discovered that paper markers make a viable alternative to physical circuits, requiring fewer tools and expertise to enable designers an easier path to exploring physical computing. They have built a programming library called Beholder, which empowers users to develop their own software leveraging computer vision (CV) markers. They presented this research at CHI.

Peter Gyory (ATLAS ACME Lab member, PhD candidate), S. Sandra Bae (ATLAS ACME Lab member, PhD student), Ruhan Yang (ATLAS ACME Lab member, PhD student), Ellen Yi-Luen Do (ATLAS ACME Lab Director, Computer Science faculty member), Clement Zheng (PhD alumnus, ATLAS ACME Lab)

[video:https://youtu.be/xYf1VJoqpBQ]

Do notes that ACME Lab has focused much energy on developing platforms upon which others can build out their own ideas. Put simply, she says, “We celebrate building things to help people build things,” including useful computational tools, process documents and 3D-printed devices. It is not just about prototyping; instead, ACME Lab aims toward “iso-typing”—functional tools that empower creatives, artists and scientists to make new and better things more easily. 

With the ACME Lab’s simple toolkit, designers no longer need to study advanced computer vision to use the technology. Instead of spending too much time just figuring out how to get things to work, they can focus on rapid prototyping with alternative controllers and interfaces to build their own gadgets much more quickly. Do and her team presented this concept to fellow members of the research community and global business leaders at the Beyond Prototyping Boards workshop at CHI.

It is by putting tech integrations together first and then exploring the design space that you realize more opportunities for innovation. As Do notes, “ATLAS is doing such a diverse research, which is pretty unique,” and creates more opportunities to cross-pollinate ideas and support one another’s work across the institute. 
 

Related research presented at CHI 2023

Fabricating Paper Circuits with Subtractive Processing
Ruhan Yang (ATLAS ACME Lab member, PhD student), Krithik Ranjan (ATLAS ACME Lab member, PhD student), Ellen Yi-Luen Do (ATLAS ACME Lab Director, Computer Science faculty member)

[video:https://youtu.be/v9W9n_Lstns]
 

Facilitating Physical Computing with Computer Vision Markers
Clement Zheng (PhD alumnus, ATLAS ACME Lab member), Peter Gyory (ATLAS ACME Lab member, PhD Candidate), Ellen Yi-Luen Do (ATLAS ACME Lab Director and Computer Science faculty member)

[video:https://youtu.be/c_pXZIerZY0]

Off

We are happy to announce that 19 members of the ATLAS community contributed to work accepted for the 2023 ACM CHI Conference on Human Factors in Computing Systems, taking place in Hamburg, Germany, April 23–28.

Accepting fewer than 25 percent of submissions, CHI is the premier international conference on human-computer interaction (HCI), attracting researchers and practitioners from around the world.

A special shout-out goes to Laura Devendorf, Etta Sandry and Emma Goodwill, who were awarded an Honorable Mention (top 5% of submissions) for their paper, "AdaCAD: Parametric Design as a New Form of Notation for Complex Weaving."

Details of all accepted work by members of the ATLAS community, which includes faculty with tenure homes in the College of Engineering and Applied Science and College of Media, Communication and Information, are listed below.

ATLAS @ CHI 2023 Papers

 ()

Laura Devendorf (ATLAS Unstable Design Lab Director, Information Science faculty member),Etta Sandry (ATLAS Unstable Design Lab weaving resident)Emma R. Goodwill (ATLAS Unstable Design Lab member, undergraduate student)

Woven textiles are increasingly a medium through which HCI is inventing new technologies. Key challenges in integrating woven textiles in HCI include the high level of textile knowledge required to make effective use of the new possibilities they afford and the need for tools that bridge the concerns of textile designers and concerns of HCI researchers. This paper presents AdaCAD, a parametric design tool for designing woven textile structures. Through our design and evaluation of AdaCAD we found that parametric design helps weavers notate and explain the logics behind the complex structures they generate. We discuss these finding in relation to prior work in integrating craft and/or weaving in HCI, histories of woven notation, and boundary object theory to illuminate further possibilities for collaboration between craftspeople and HCI practitioners.

Peter Gyory (ATLAS ACME Lab member, PhD candidate), S. Sandra Bae (ATLAS ACME Lab member, PhD student), Ruhan Yang (ATLAS ACME Lab member, PhD student), Ellen Yi-Luen Do (ATLAS ACME Lab Director, Computer Science faculty member), Clement Zheng (PhD alumnus, ATLAS ACME Lab)

The electronics-centered approach to physical computing presents challenges when designers build tangible interactive systems due to its inherent emphasis on circuitry and electronic components. To explore an alternative physical computing approach we have developed a computer vision (CV) based system that uses a webcam, computer, and printed fiducial markers to create functional tangible interfaces. Through a series of design studios, we probed how designers build tangible interfaces with this CV-driven approach. In this paper, we apply the annotated portfolio method to reflect on the fifteen outcomes from these studios. We observed that CV markers offer versatile materiality for tangible interactions, afford the use of democratic materials for interface construction, and engage designers in embodied debugging with their own vision as a proxy for CV. By sharing our insights, we inform other designers and educators who seek alternative ways to facilitate physical computing and tangible interaction design.

Netta Ofer (ATLAS Living Matter Lab member, PhD student), Mirela Alistar (ATLAS Living Matter Lab Director, Computer Science faculty member)

Designing with living organisms can offer new perspectives to design research and practices in HCI. In this work, we explore first-person perspectives through design research with Kombucha Scoby, a microbial biofilm. We began with a material design exploration, producing digitally fabricated and crafted samples with Scoby. As we noticed our felt experiences while growing and working with Kombucha Scoby, we shifted towards a reflective autoethnographic study. Through reflective writings, we followed sensory experiences such as hearing the Kombucha fermentation, touching the Scoby while harvesting it, and watching the slow growth of layers over time. Subsequently, we designed "sensory engagement probes”: designed experiments that bring forward new connections and communicate our process, motivations, and tensions that emerged while engaging with the organism. Lastly, we discuss how such design research can inform material design with living matter by creating space to contemplate "life as shared experience" and more-than-human design perspectives.

Keke Wu (recent ATLAS PhD student), , Emma Petersen (ATLAS MS alumnus), , Danielle Albers Szafir (former ATLAS faculty member)

Data is everywhere, but may not be accessible to everyone. Conventional data visualization tools and guidelines often do not actively consider the specific needs and abilities of people with Intellectual and Developmental Disabilities (IDD), leaving them excluded from data-driven activities and vulnerable to ethical issues. To understand the needs and challenges people with IDD have with data, we conducted 15 semi-structured interviews with individuals with IDD and their caregivers. Our algorithmic interview approach situated data in the lived experiences of people with IDD to uncover otherwise hidden data encounters in their everyday life. Drawing on findings and observations, we characterize how they conceptualize data, when and where they use data, and what barriers exist when they interact with data. We use our results as a lens to reimagine the role of visualization in data accessibility and establish a critical near-term research agenda for cognitively accessible visualization.

Keke Wu (recent ATLAS PhD student)

Visualization amplifies cognition and helps a viewer see the trends, patterns, and outliers in data. However, conventional visualization tools and guidelines do not actively consider the unique needs and abilities of people with Intellectual and Developmental Disabilities (IDD), leaving them excluded from data-driven activities and vulnerable to ethical issues in everyday life. My dissertation work explores the challenges and opportunities of cognitively accessible visualization. Through mixed-method approaches and close collaboration with people with IDD, my team and I ran experiments and developed guidelines to improve current visualizations, we interviewed people with IDD and gained an initial understanding of their daily data experiences, and we are currently in the process of revising a participatory design workshop to create accessible visualizations for and with this population. For the remaining dissertation work, I hope to further expand our knowledge of cognitively accessible visualization, translating what I have learned from these experiences into a graphical user interface that supports people with IDD with their self-advocacy and self-expression using personally relevant data. My ultimate career goal is to theorize cognitively accessible visualization and empower people with IDD to make informed decisions and generate meaningful discoveries through accessible visual analytics.

Clement Zheng (PhD alumnus, ATLAS ACME Lab), , , Laura Devendorf (ATLAS Unstable Design Lab Director, Information Science faculty member), ,

Glazed ceramic is a versatile material that we use every day. In this paper, we present a new approach that instruments existing glazed ceramic ware with interactive electronic circuits. We informed this work by collaborating with a ceramics designer and connected his craft practice to our experience in physical computing. From this partnership, we developed a systematic approach that begins with the subtractive fabrication of traces on glazed ceramic surfaces via the resist-blasting technique, followed by applying conductive ink into the inlaid traces. We capture and detail this approach through an annotated flowchart for others to refer to, as well as externalize the material insights we uncovered through ceramic and circuit swatches. We then demonstrate a range of interactive home applications built with this approach. Finally, we reflect on the process we took and discuss the importance of collaborating with craftspeople for material-driven research within HCI.

Ran Zhou (ATLAS THING Lab member, PhD student), Zachary Schwemler (ATLAS MS alumnus), , , Casey Lee Hunt (ATLAS THING Lab member, PhD student), Daniel Leithinger (ATLAS THING Lab Director, Computer Science faculty member)

Emerging research has demonstrated the viability of emotional communication through haptic technology inspired by interpersonal touch. However, the meaning-making of artificial touch remains ambiguous and contextual. We see this ambiguity caused by robotic touch’s "otherness" as an opportunity for exploring alternatives. To empower emotional haptic design in longitudinal out-of-lab exploration, we devise TactorBots, a design toolkit consisting of eight wearable hardware modules for rendering robotic touch gestures controlled by a web-based software application. We deployed TactorBots to thirteen designers and researchers to validate its functionality, characterize its design experience, and analyze what, how, and why alternative perceptions, practices, contexts, and metaphors would emerge in the experiment. We provide suggestions for designing future toolkits and field studies based on our experiences. Reflecting on the findings, we derive design implications for further enhancing the ambiguity and shifting the mindsets to expand the design space.

Note: This team will also lead an Interactivity session:

Workshops

ATLAS will also be represented at the Electrofab 2023 workshop during CHI. This year’s theme is “Beyond Prototyping Boards: Future Paradigms for Electronics Toolkits,” and will feature two papers authored by ATLAS members.

Ruhan Yang (ATLAS ACME Lab member, PhD student), Krithik Ranjan (ATLAS ACME Lab member, PhD student), Ellen Yi-Luen Do (ATLAS ACME Lab Director, Computer Science faculty member)

This paper introduces a new method of paper circuit fabrication that overcomes design barriers and increases flexibility in circuit design. Conventional circuit boards rely on thin traces, which limits the complexity and accuracy when applied to paper circuits. To address this issue, we propose a method that uses large conductive zones in paper circuits and performs subtractive processing during their fabrication. This approach eliminates design barriers and allows for more flexibility in circuit design. We introduce PaperCAD, a software tool that simplifies the design process by converting traditional circuit design to paper circuit design. We demonstrate our technique by creating two paper circuit boards. Our approach has the potential to promote the development of new applications for paper circuits.

Clement Zheng (PhD alumnus, ATLAS ACME Lab member), Peter Gyory (ATLAS ACME Lab member, PhD Candidate), Ellen Yi-Luen Do (ATLAS ACME Lab Director and Computer Science faculty member)

The electronics-centered approach to physical computing presents challenges when designers build tangible interactive systems due to its inherent emphasis on circuitry and electronic components. To explore an alternative physical computing approach we have developed a computer vision (CV) based system that uses a webcam, computer, and printed fiducial markers to create functional tangible interfaces. Over the last three years, we ran a series of studios with design participants to investigate how CV markers can participate in physical computing and the construction of physical interactive systems. We observed that CV markers offer versatile materiality for tangible interactions, afford the use of democratic materials for interface construction, and engage designers in embodied debugging with their own vision as a proxy for CV. Taking these insights, we are developing a visual editor that enables designers to easily program marker behavior and connect it to keyboard events. We believe that such a platform will enable designers to develop physical and digital interfaces concurrently while minimizing the complexity of integrating both sides. In addition, this platform can also facilitate the construction of many alternative interfaces for existing software that cater to different people. We discuss our motivation, progress, and future work of this research here.

Two ATLAS community members also co-organized a workshop in the Extended Abstracts portion of CHI 2023.

, , , , Fiona Bell (PhD Candidate), Netta Ofer (ATLAS Living Matter Lab member, PhD student), , , , , ,

As knowledge around bio-digital interaction continues to unfold, there are new opportunities for HCI researchers to integrate biology as a design and computational material. Our motivation for the workshop is to bring together interdisciplinary researchers with interest in exploring the next generation of biological HCI and exploring novel bio-digital interfaces implicating diverse contexts, scales, and stakeholders. The workshop aims to provide a space for interactive discussions, presentations, and brainstorming regarding opportunities and approaches for HCI around bio-digital interfaces. We invite researchers from both academia and industry to submit a short position paper in the following areas: Synthetic Biology, Biological Circuits, Do-It-Yourself Biology (DIYBio), Biomimetic Interfaces, Living Interfaces, Living Artefacts, and Bio-ethics. We will evaluate submissions on fit, ability to stimulate discussion, and contribution to HCI. On our website we have included examples of past work in this area to help inspire and inform position papers. Our website will host a recording of the entire workshop session with accepted papers to support asynchronous viewing for participants who are unable to attend in-person or synchronously.

Off

Off