Paper
Parasitic signals: Multimodal Sonata for Real-time Interactive Simulation of the SARS-CoV-2 Virus
Myungin Lee, Sabina Hyoju Ahn, Yoojin Oh, JoAnn Kuchera-Morin
/nextImageExportOptimizer/01%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
/nextImageExportOptimizer/03%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
/nextImageExportOptimizer/05%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
/nextImageExportOptimizer/07%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
/nextImageExportOptimizer/02%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
/nextImageExportOptimizer/04%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
/nextImageExportOptimizer/06%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
This project aims to transform the nano-scale of a striking biological phenomenon, the relationship between the SARS-CoV-2 virus and human molecules, into an interactive audiovisual simulation. In this work, Atomic Force Microscopy (AFM) touching and imaging a single molecule measures the interaction between the spike protein of SARS-CoV-2 and human cellular proteins and measures the dynamic of the spike protein. We create a comprehensive scientific model based on diverse datasets and theories presenting a real-time interactive complex system with efficient rendering and sonification using a single C++ platform. This project invites the audience into an immersive space where they can control the behavior of biomolecules, allowing them to intuitively perceive biological properties. This project is not only a demonstration of scientific data but also attempts to look at the interspecies relationship in parasitism which particularly deals with our current and post-pandemic life with coronavirus and how we might control our coexistence in a virtual space.
Webpage: myunginlee.com/covid
Artists bio
/nextImageExportOptimizer/lee%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
Dr. Myungin Lee is a researcher designing multimodal instruments based on scientific theory, composition, signal processing, machine learning, and gestural interface. He pursues cohesive multimodal instrument design and compositions by establishing crossmodal correspondence between modalities, including physics, audio, graphics, and interface. He is a faculty member in the Immersive Media Design program at the University of Maryland, College Park.
/nextImageExportOptimizer/ahn%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
Sabina Hyoju Ahn is an artist engaging with various media represented through auditory perception, tactile sense, visual elements and a mixture of digital and analog technology. Her research seeks to find hidden rules and patterns in natural elements and multi-layered relationships between human and non-human beings by translating imperceptible data in natural elements into different perceptual experiences. In her work, biological materials are often used, combined or connected to machines, and transformed.
/nextImageExportOptimizer/photoOH%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
Yoojin Oh is currently senior scientist at the Institute of Biophysics, Johannes Kepler University Linz with a technical focus on microscopic imaging in nano-scale. She studied physics by developing scanning probe microscopic techniques and obtained a doctoral degree in Korea. In 2009, she moved to Europe as a post-doctoral researcher and applied microscopic techniques to living organisms and pathogenic systems. With her broad scientific activities, she is also interested in interdisciplinary artwork by collaborating with artists.
/nextImageExportOptimizer/kuchera-morin%20-%20Myungin%20Ben%20Lee-opt-3840.WEBP)
Dr. JoAnn Kuchera-Morin, Director and Chief Scientist of the AlloSphere Research Facility, is a Professor of Media Arts and Technology and Music at the University of California, Santa Barbara. She created and was Chief Scientist of Digital Media for the University of California. This led to the creation of a Digital Media Center in the California NanoSystems Institute and the AlloSphere instrument designed for immersive, interactive scientific and artistic investigation of multi-dimensional datasets.
