Exploring Interactive Interfaces Under Sound and Visual Content
M.F.A (Master of Fine Arts) Thesis
Supervisor
Dr. Adam Tindale,
Prof. Nick Puckett
Support: Graduate Gallery,
OCAD University
Tools
©️ TouchDesigner, Arduino, Rhino,
©️ Leap Motion, Web Camera,
Computation Coding
The problem?
“ How can different interfaces be used to create an interactive artwork based on audio-visualization that provides quick examples and reduces the participation gap? ”
Where it from?
“ Inspired by a performance area called VJ'ing, in which live visuals and music are shared with audiences. I noticed most video jockeys (VJs) use MIDI Controllers and knobs to build visual content which can match the DJ set.
The Audience only can watch their performance ”
[ Visual Jockey works performance by Sheri(Siyu) Sun]
Sound Visualization
Interactive installation.Create a shape of sound.Enhances the relationship between the audience and the topic.Encouraging participation. To achieve this objective.
Noise Generated- Concept Development
©️ TouchDesigner
Installation Design- 3D modeling Technique
©️ Rhino
3D Print - Digital Fabrication
3D Printer Technique
How it Works?
“ Three interfaces: Arduino knob sensors, a web camera, and a leap motion. Each input will trigger different visual parameters, giving the audience dynamic exploration through projects. ”
Reference
Set up the environment.Design three different interactive interfaces.Engaging Audience participation.
Interactive method：MIDI controllers ( a technique for VJs during live shows).Outcome: Keyboard trigger different parameters.Create Visual Contents by yourself!
Create Visual Contents by yourself!
Interaction Design
Tools：Arduino, TouchDesigner.Interaction way: Spinning the potentiometer (Two).Aim: Control different parameters through potentiometer.1. Potentiometer in Arduino- Controlling
2. Web-camera - Following
Tools: Web- camera.
Interaction way: Touch Surface/ Move under the camera.
Aim: Encourage participants exploration by themselves.
4. Leap Motion - Communication
Tools: Leap Motion
Interaction way: Hand-based gestures: Such as Making a fist, or waving.
Target: provide a natural and intuitive way for the audience to interact with interactive art and enhance their relationship with the interface.
Participation,
Exploration, Feedback
Outcomes and Contribution
1. Teaching
The key contributions of this project include the introduction of how interfaces can be used to create engaging and interactive art experiences and how sound can be visualized in different ways. From the prototypes of the experiments, the project shows how interfaces can be used to allow audiences to engage with and influence an art piece. By providing a way for audiences to interact with an artwork, interfaces can make art more accessible to a broader range of people.
2. Bring Quick Examples
Another significant contribution of the project is the exploration of audio visualization. I selected three ways to trigger that allow audiences to experience the different possibilities in interactive art directly, it can bring quick examples to show the audiences how the different devices will bring the content.
3. Find Potential Users
This project demonstrates the potential of interfaces and audio visualization in interactive art. Furthermore, by exploring these concepts through prototypes and experiments, I would inspire people who are looking to create engaging and interactive art experiences.