chi2023.acm.org

Some of the works presented are:

The Impact of Navigation Aids on Search Performance and Object Recall in Wide-Area Augmented Reality (Paper). You-Jin Kim (MAT PhD) and Radha Kumaran (CS PhD).

Abstract

Head-worn augmented reality (AR) is a hotly pursued and increasingly feasible contender paradigm for replacing or complementing smartphones and watches for continual information consumption. Here, we compare three different AR navigation aids (on-screen compass, on-screen radar and in-world vertical arrows) in a wide-area outdoor user study (n=24) where participants search for hidden virtual target items amongst physical and virtual objects. We analyzed participants’ search task performance, movements, eye-gaze, survey responses and object recall. There were two key findings. First, all navigational aids enhanced search performance relative to a control condition, with some benefit and strongest user preference for in-world arrows. Second, users recalled fewer physical objects than virtual objects in the environment, suggesting reduced awareness of the physical environment. Together, these findings suggest that while navigational aids presented in AR can enhance search task performance, users may pay less attention to the physical environment, which could have undesirable side-effects.

---

Comparing Zealous and Restrained AI Recommendations in a Real-World Human-AI Collaboration Task. Chengyuan Xu (MAT PhD), Kuo-Chin Lien (Appen), Tobias Höllerer (MAT, CS professor).

Abstract

When designing an AI-assisted decision-making system, there is often a tradeo! between precision and recall in the AI’s recommendations. We argue that careful exploitation of this tradeo! can harness the complementary strengths in the human-AI collaboration to signi"cantly improve team performance. We investigate a real-world video anonymization task for which recall is paramount and more costly to improve. We analyze the performance of 78 professional annotators working with a) no AI assistance, b) a high-precision "restrained" AI, and c) a high-recall "zealous" AI in over 3,466 person-hours of annotation work. In comparison, the zealous AI helps human teammates achieve signi"cantly shorter task completion time and higher recall. In a follow-up study, we remove AI assistance for everyone and "nd negative training e!ects on annotators trained with the restrained AI. These "ndings and our analysis point to important implications for the design of AI assistance in recall-demanding scenarios.

---

PunchPrint: Creating Composite Fiber-Filament Craft Artifacts by Integrating Punch Needle Embroidery and 3D Printing (Paper). Ashley Del Valle (MAT PhD), Mert Toka (MAT PhD), Alejandro Aponte (MAT PhD), Jennifer Jacobs (MAT Assistant Professor).

Abstract

New printing strategies have enabled 3D-printed materials that imitate traditional textiles. These flament-based textiles are easy to fabricate but lack the look and feel of fber textiles. We seek to augment 3D-printed textiles with needlecraft to produce composite materials that integrate the programmability of additive fabrication with the richness of traditional textile craft. We present PunchPrint: a technique for integrating fber and flament in a textile by com- bining punch needle embroidery and 3D printing. Using a toolpath that imitates textile weave structure, we print a fexible fabric that provides a substrate for punch needle production. We evaluate our material’s robustness through tensile strength and needle compat- ibility tests. We integrate our technique into a parametric design tool and produce functional artifacts that show how PunchPrint broadens punch needle craft by reducing labor in small, detailed artifacts, enabling the integration of openings and multiple yarn weights, and scafolding soft 3D structures.

Paper

---

Fencing Hallucination: An Interactive Installation for Fencing with AI and Synthesizing Chronophotographs. Weihao Qiu (MAT PhD) and George Legrady (MAT Professor).

Abstract

Fencing Hallucination is a multi-screen interactive installation that enables real-time human-AI interaction in the form of a Fencing game and generates a chronophotograph based on the audience’s movement. It mitigates the conflicts between interactivity, modality variety, and computational limitation in creative AI tools. Fenc- ing Hallucination captures the audience’s pose data as an input to the Multilayer Perceptron(MLP), which generates the virtual AI Fencer’s pose data. It also uses the audience’s pose to synthesize the chronophotograph. The system first represents pose data as stick figures. Then it uses a diffusion model to perform image-to-image translations, converting the stick figures into a series of realistic fencing images. Finally, it combines all images with an additive effect into one image as the result. This multi-step process overcomes the challenge of preserving both the overall motion patterns and fine details when synthesizing a chronophotograph.

The MAT alumni that were selected to participate are:

Yoon Chung Han
Solen KIratli
Hannen E. Wolfe
Yin Yu
Weidi Zhang
Rodger (Jieliang) Luo

The International Symposium on Electronic Art is one of the world’s most prominent international arts and technology events, bringing together scholarly, artistic, and scientific domains in an interdisciplinary discussion and showcase of creative productions applying new technologies in art, interactivity, and electronic and digital media.

www.isea2023-proposals.org

Burbano is a native of Pasto, Colombia and an associate professor in Universidad de los Andes’s School of Architecture and Design. As a contributor to the conference, Burbano has presented research within the Art Papers program (in 2017), and as a volunteer, has served on the SIGGRAPH 2018, 2020, and 2021 conference committees. Most recently, Burbano served as the first-ever chair of the Retrospective Program in 2021, which honored the history of computer graphics and interactive techniques. Andres received his PhD from Media Arts and Technology in 2013.

For more information, please read this article on the ACMSIGGRAPH Blog.

The next SIGGRAPH conference is in August 2023 and will be held in Los Angeles, California s2023.siggraph.org.

Space Control is a multitrack workstation dedicated to the design, realization, and mixture of spatial gestures for electroacoustic music composition. With its simple interface and minimal learning curve, it makes quick and powerful spatialization available to users of all experience levels.

Released in June 2022, Space Control was created by the team of Professor João Pedro Oliveira, acting as project manager, and software developer Raphael Radna. Radna is a PhD candidate in Music Composition at UC Santa Barbara, and is also pursuing a Masters of Science degree from the Media Arts and Technology Graduate Program at UCSB.

Space Control runs on Apple Computers, and is available on GitHub. Use this link for direct access to the software download.

There is also a Quick Start video available on YouTube:

For more information, please see the article on the UCSB News website https://www.news.ucsb.edu/2022/020785/space-control.

The project was supported by a Faculty Research Grant from the UCSB Academic Senate.

EmissionControl2 is a granular sound synthesizer. The theory of granular synthesis is described in the book Microsound (Curtis Roads, 2001, MIT Press).

Released in October 2020, the new app was developed by a team consisting of Professor Curtis Roads acting as project manager, with software developers Jack Kilgore and Rodney Duplessis. Kilgore is a computer science major at UCSB. Duplessis is a PhD student in music composition at UCSB and is also pursuing a Masters degree in the Media Arts and Technology graduate program.

EmissionControl2 is free and open-source software available at: github.com/jackkilgore/EmissionControl2/releases/latest

The project was supported by a Faculty Research Grant from the UCSB Academic Senate.