Media Arts and Technology, UC Santa Barbara

Events

Sketches of Sensorium, an immersive audio visual event, will premier at the AlloSphere on Thursday September 12, 2024, from 5:30 to 7:30pm. The event premieres as a satellite to the UC Irvine Beall Center for Art and Technology’s forthcoming exhibition, Future Tense: Art, Complexity, and Uncertainty, produced in partnership with the 2024 Getty PST Art: Art and Science Collide initiative.

Sketches of Sensorium

Sketches for Sensorium showcases core elements of the late environmental artist Newton Harrison’s (1932 - 2022) long-term project, Sensorium for the World Ocean. It is a project of the Center for the Study of the Force Majeure in collaboration with Virtual Planet Technologies, Almost Human Media, and the AlloSphere Research Group. The installation incorporates immersive audio and visual scientific climate and ocean health data provided by the Ocean Health Index of the Halpern Lab at the Bren School of Environmental Science & Management.

AlloSphere Facility Program Dates:

September 12, October 10, and November 14: from 5:30pm to 7:30pm

September 28, October 26, and November 23: from 1:30pm to 3:30pm

To reserve a time, you can sign up on this page.

For more information, please visit:

news.ucsb.edu/2024/021608/immersive-ocean-health-project-premieres-ucsbs-allosphere-part-getty-pst-art

www.independent.com/2024/09/11/sketches-of-sensorium-part-of-getty-pst-art-at-uc-santa-barbara

allosphere.ucsb.edu/research/sketches_of_sensorium/2024.html

MAT Seminar Series: Tradition and post-Modernity: pre-Modern Japanese Aesthetics in My Contemporary Sound and Video Art. Speaker: Daryl Jamieson. Monday, November 18th, 2024 at 1pm PST via Zoom.

Abstract

Against the background of a failing Modernity, I will show how my music theatre, sound art, and video works make use of aesthetic concepts from mediaeval Japan and East Asia. The focus will be on my works related to the non-human world, the interconnectedness of all things, and the meanings of ‘silence’. I will also talk about the fundamental rhythmic structure of nō theatre, how nō relates to aesthetics and philosophy, and how I have used nō structures in my contemporary practice. Throughout the talk I will illustrate with examples taken from my work, as well as selected contemporary composers and artists who have influenced my practice.

Bio

Daryl Jamieson (b.1980) is from Halifax, Nova Scotia. He studied at Wilfrid Laurier University with Glenn Buhr and Linda Catlin Smith, the Guildhall School of Music and Drama with Diana Burrell, and then with Nicola LeFanu at the University of York. He has lived in Japan since 2006, first studying under Jo Kondo at the Tokyo University of the Arts. He is currently an assistant professor of composition and aesthetics at Kyushu University, and his music is published by Da Vinci Edition, Osaka.

Jamieson's work explores time and place, and is heavily influenced by nō theatre and Japanese poetry. His earliest large-scale series is a trilogy of musical theatre pieces called Vanitas, which received the 2018 Toshi Ichiyanagi Contemporary Prize. In his citation, Ichiyanagi called the Vanitas Series 'an epic musical work of extraordinarily elegance and contemporary topical perspective'. Jamieson's other pieces include solo, chamber and orchestral works, and many songs. Since 2016 he has begun to incorporate field recordings into his work, particularly in his utamakura and Descants series. His music has been performed around the world by many artists, including the Quatuor Bozzini, the Thin Edge New Music Collective, Muromachi Ensemble, and Satoko Inoue.

He founded the intercultural musical theatre company Atelier Jaku in 2013. He is also active as a researcher, writing on aesthetics of the Kyoto School and Japanese philosophy, as well as contemporary music and spirituality. He has received grants and awards from the Canada Council for the Arts, among others.

For more information about the MAT Seminar Series, go to:
seminar.mat.ucsb.edu.

Beyond Reality: Designing Personal Experiences and Interactive Narratives in AR Theater, a PhD dissertation defense by You-Jin Kim. Friday November 8th, 2024 at 2pm PST. Elings Hall room 2003.

Beyond Reality: Designing Personal Experiences and Interactive Narratives in AR Theater

Abstract

Focusing on interactive narratives and digital performance, this talk explores how augmented settings extend “Beyond Reality.” You-Jin Kim’s research utilizes user inputs such as EEG, natural movement, and eye gaze to make digital content interaction in augmented reality (AR) reflect human intent and expression. The discussion highlights how human expression—particularly delicate forms like dance and performance—can be communicated through emerging technologies and practices. He will present his works, including Dynamic Theater, Spatial Orchestra, and Reality Distortion Room, to illustrate how stories unfold through user interaction in AR.

It becomes evident that audiences are not interested in digitally generated performances alone, as the human form of art has been explored for years, a point clearly demonstrated in his work Dynamic Theater 2023. However, You-Jin will discuss how AI agents, trained with user audience data captured from the Dynamic Theater project, could generate virtual audiences. These AI-driven virtual audiences could replace NPC (non-player character) audiences, enhancing the overall experience of watching live theater and presenting an immersive theater experience.

Past Events

News

MAT PhD student Weihao Qiu has been awarded the 2024 Mellichamp Initiative in Mind and Machine Intelligence Graduate Student Fellowship.

Weihao is currently a PhD candidate in the Media Arts and Technology (MAT) program, where his research is centered on improving the modularity, customizability, and interactivity of Generative AI tools. His primary goal is to enhance the diversity, expressiveness, and audience connectedness of AI-based artworks. Weihao's research contributions have been published in conferences, such as Neural Information Processing Systems (NeurIPS), The ACM Conference on Human Factors in Computing Systems (CHI), and The International Conference on Robotics and Automation (ICRA). His artwork has been exhibited in venues such as Beijing Times Art Museum, FeraFile, The Wolf Museum of Exploration + Innovation (MOXI), SIGGRAPH, and UCSB MAT End of Year Shows.

The intent of the fellowship is to provide graduate students who are passionate about exploring the intersection of multiple fields related to the initiative with the opportunity to participate in research projects and activities organized as part of the annual summit.

Mellichamp Initiative in Mind & Machine Intelligence Summit 2024

The Second Edition (2023) of a book by Professor Curtis Roads, "The Computer Music Tutorial" has been released.

The Computer Music Tutorial, Second Edition (2023) by Curtis Roads

Curtis Roads, professor in Media Arts and Technology and affiliate faculty in Music at UCSB, has announced the publication of an expanded, updated, and fully revised Second Edition of his textbook The Computer Music Tutorial (2023, The MIT Press, 1257 pages).

Essential and state-of-the-art, The Computer Music Tutorial, Second Edition is a singular text that introduces computer and electronic music, explains its motivations, and puts topics into context. Curtis Roads's step-by-step presentation orients musicians, engineers, scientists, and anyone else new to computer and electronic music.

The new edition continues to be the definitive tutorial on all aspects of computer music, including digital audio, signal processing, musical input devices, performance software, editing systems, algorithmic composition, MIDI, and psychoacoustics, but the second edition also reflects the enormous growth of the field since the book's original publication in 1996. New chapters cover up-to-date topics like virtual analog, pulsar synthesis, concatenative synthesis, spectrum analysis by atomic decomposition, Open Sound Control, spectrum editors, and instrument and patch editors. Exhaustively referenced and cross-referenced, the second edition adds hundreds of new figures and references to the original charts, diagrams, screen images, and photographs in order to explain basic concepts and terms.

Features include:

New chapters on virtual analog, pulsar synthesis, concatenative synthesis, spectrum analysis by atomic decomposition, Open Sound Control, spectrum editors, instrument and patch editors, and an appendix on machine learning.

Two thousand references support the book's descriptions and point readers to further study.

Mathematical notation and program code examples used only when necessary.

Twenty-five years of classroom, seminar, and workshop use inform the pace and level of the material.

As Prof. Roads states: "I finished writing the first edition in 1993. It finally came out in 1996, the year I joined the UCSB Music faculty as a Visiting Associate Professor. Writing the Second Edition required going through the research literature in the field since 1993. It often felt overwhelming but I just had to keep going. In 2017 I devoted all my creative time to the project. I promised myself I would finish it in 2020, and at 10 PM on 31 December 2020 I finished writing. Time for Champagne! The production process took all of 2021 and most of 2022. In a way it was a perfect project for the pandemic lockdown, as it gave me a daily purpose in a time of isolation. The textbook has been the core of my teaching at UCSB."

An article about the release of the 2nd edition was published in the UCSB Current:

news.ucsb.edu/2023/021272/core-textbook-computer-music-distills-vast-information-space-definitive-tutorial

The book can be found at MIT Press:

mitpress.mit.edu/9780262044912/the-computer-music-tutorial

Professor Roads's previous books include Microsound (2001, The MIT Press) and Composing Electronic Music: A New Aesthetic (2015, Oxford University Press).

MAT professor JoAnn Kuchera-Morin will give a presentation titled "From Music Composition to Multimodal Interactive Composition - An Historical Overview" at SIGGRAPH SPARKS 2024, Pioneering Interactive Art and Artists from the 1960s to 2000. February 23rd, 2024 at 9am PST.

This SPARKS session focuses on the innovative interactive digital artwork and pioneering artists prior to the year 2000. Interactive digital art’s roots began forming in the 1960s and blossomed in the following decades. By relinquishing the power to control the outcome of a work of art, digital artists in the 1960-1990s established a democratic, reciprocal relationship with the viewer. Without a defined history, artists were free to experiment and create works that capitalized on the concept of “possibilities”. These individualized personal art experiences took many forms including screen-based art, immersive installation environments, haptic device art, and much more.

Presentations:

Vladimir Bonačić’s interactive digital installations 1969 – 1971
Darko Fritz

Media Art as Thinking Space
Monika Fleischmann and Wolfgang Strauss

Interactive Plant Growing – a journey of an interactive garden created in 1992
Christa Sommerer and Laurent Mignonneau

Searching for Conditions of Possibility: Jeffrey Shaw’s Artistic Practice in Expanded Cinema
Lukasz Mirocha

Engaging Subjectivity Through Interaction
Greg Garvey

The enduring telematic vision of a coexistent third space
Paul Sermon

From Music Composition to Multimodal Interactive Composition – An Historical Overview
JoAnn Kuchera-Morin

https://dac.siggraph.org/sparks/feb-2024-pioneering-interactive-art-and-artists

This event is co-moderated by MAT alumni Dr. Myungin Lee and co-sponsored by the ACM SIGGRAPH History Committee.

A team of MAT students led by MAT Chair and transLAB Director Professor Marcos Novak designed and installed an immersive and interactive exhibit called the "Synaptic Time Tunnel" for the 2023 SIGGRAPH Conference at the Los Angeles Convention Center.

Synaptic Time Tunnel, SIGGRAPH 2023.

Sponsored by Autodesk, the Synaptic Time Tunnel was a tribute to 50 years of innovation and achievement in the field of computer graphics and interactive techniques that have been presented at the SIGGRAPH conferences.

An international audience of more than 14,275 attendees from 78 countries enjoyed the conference and its Mobile and Virtual Access component.

Contributors:

Marcos Novak - MAT Chair and transLAB Director, UCSB
Graham Wakefield - York University, UCSB
Haru Ji - York University, UCSB
Nefeli Manoudaki - transLAB, MAT/UCSB
Iason Paterakis - transLAB, MAT/UCSB
Diarmid Flatley - transLAB, MAT/UCSB
Ryan Millet - transLAB, MAT/UCSB
Kon Hyong Kim - AlloSphere Research Group, MAT/UCSB
Gustavo Rincon - AlloSphere Research Group, MAT/UCSB
Weihao Qiu - Experimental Visualization Lab, MAT/UCSB
Pau Rosello Diaz - transLAB, MAT/UCSB
Alan Macy - BIOPAC Systems Inc.
JoAnn Kuchera-Morin - AlloSphere Research Group, MAT/UCSB
Devon Frost - MAT/UCSB
Alysia James - Department of Theater and Dance/UCSB

More information about the Synaptic Time Tunnel can be found in the following news articles:

Forbes.com: SIGGRAPH, Autodesk Take Time Tunnel Through Computer Graphics History on 50th Anniversary

Forbes.com: SIGGRAPH 2023 Highlights

PR Newswire: SIGGRAPH 2023 Conference Commemorates 50 Years of Innovations With Growth in Contributed Works and In-person Attendees

s2023.siggraph.org

translab.mat.ucsb.edu/S50_SynapticTimeTunnel

translab.mat.ucsb.edu

MAT alumni Andres Burbano has been selected as chair of the 51st annual ACM SIGGRAPH 2024 conference.

ACM SIGGRAPH is the premier conference and exhibition on computer graphics and interactive techniques. This year they celebrate their 50th conference and reflect on half a century of discovery and advancement while charting a course for the bold and limitless future ahead.

Burbano is a native of Pasto, Colombia and an associate professor in Universidad de los Andes’s School of Architecture and Design. As a contributor to the conference, Burbano has presented research within the Art Papers program (in 2017), and as a volunteer, has served on the SIGGRAPH 2018, 2020, and 2021 conference committees. Most recently, Burbano served as the first-ever chair of the Retrospective Program in 2021, which honored the history of computer graphics and interactive techniques. Andres received his PhD from Media Arts and Technology in 2013.

Read more from the ACM SIGGRAPH's website and this article on the ACMSIGGRAPH Blog.

The next ACM SIGGRAPH conference is in August 2023 and will be held in Los Angeles, California s2023.siggraph.org.

Past News

Alumni Testimonials

"With a deep interest in exploring sound, not only creatively, but technically and scientifically, I began my studies at MAT at UCSB. It was here, through academic discipline and perseverance, alongside professors and colleagues, that I was able to hone my skills and begin my successful career.

Years later, I am leading development of game audio and augmented reality technology at Apple.

The strong academic foundations that I gained in spatial audio, sound synthesis, and audio engine architecture have allowed me to achieve even greater success in my career. I will always be grateful to those who helped me take those first steps to success!"

David Thall
Lead Audio Programmer
Game and Augmented Reality Technology
Apple
"As a UCSB MAT Master's student (2002-2004), I benefited greatly from the required and elective courses taught by professional leaders with broad perspectives, both technical and humanistic. This helped me to improve my research skills, and to refine my academic vision, which culminated in a PhD (2009) from UCSB Electrical and Computer Engineering specializing in Digital Signal Processing. Since that time I have been employed at several academic institutions around Europe, where my broad technical and humanistic perspective has been unique and advantageous."

Bob L. Sturm, Associate Professor
School of Electronic Engineering and Computer Science
Royal Institute of Technology KTH
Stockholm, Sweden
"As one of the first graduates of the Media Arts and Technology PhD program, I have found the experiences provided by the MAT community invaluable to both my professional development and personal enjoyment of creating technology-based experiences, throughout life. I have been employed for more than 10 years now in the department of Architecture, Design and Media Technology at Aalborg University Copenhagen, where I teach both interaction design and real-time signal processing for audio and music performance. As Associate Professor, I guide students to create their own software and hardware tools, concepts, and practices for creating new sonic and embodied interactions, as well as running the Augmented Performance Lab. Together with my colleagues, I helped start the Sound and Music Computing masters program in 2014, and co-chaired the international New Interfaces for Musical Expression (NIME) conference in 2017."

Dan Overholt
Associate Professor
Aalborg Univeristy, Copenhagen
Denmark
"MAT is a rare graduate program in that it operates more like an creative ecosystem -- your work as a researcher is significant and connects to others. People care a lot about what you are doing, and invest thought into your own thinking. Throughout my eight years of study, from 2007 to 2015, and as a postdoctoral student afterwards, this supportive environment provided the technological, financial, and intellectual resources necessary for me to take risks in my work. As a result, I was able to dive deep into subjects I thought were off limits to my cognitive function, and achieve the great satisfaction of learning how to learn better. It is a testament to the culture fostered there that an experimental filmmaker such as myself entering the program with very basic programming skills can now make regular contributions to mathematics journals, work as a real-time computer graphics programmer in the DTLA arts district, be asked to consult on science fiction television dramas, and innovate novel geometrical algorithms of use in architecture. I think the MAT program at UCSB is a hidden gem -- you enter it with one direction in mind, and come out brilliantly refracted into a spectrum of possibilities."

Pablo Colapinto
Oblong Industries Inc & Independent Artist
Los Angeles
"The education and mentorship I received as an MAT student gave me the skills to discuss my work critically and in the context of the rich history of media arts; and has been pivotal in having my work accepted in exhibitions around the world, including Dubai, Montreal, Tehran, Hong Kong, New York and cities throughout the US. Further, my PhD in MAT was instrumental in securing my position as Curator of Interactive Media for MOXI, the Wolf Museum of Exploration and Innovation. In that capacity, almost half of the artists I have curated into MOXI have been MAT alumni, MAT faculty, MAT students, and distinguished media artists who I met as part of my work in the MAT program. My collaborations with MAT students and alumni are ongoing, and I continue to be grateful for the education, mentorship and community of the UCSB MAT program."

Marco Pinter
Computational Artist
Curator of Interactive Media, MOXI (The Wolf Museum of Exploration + Innovation)
Director of Software Innovation, InTouch Health

Lavin	Kinetic	Hive
Melange	Turn	CHON