This project is a Live VJ Performance which I performed at the IDEO Open Day. I DIY an interesting physical installation with buttons and knobs. Through actions such as clicking and rotating, I can interact in real time with the visual elements on my pre-programmed computer screen. Through this creative storytelling method, I abstractly described my experience in chronological order to illustrate what I think the sense of belonging is like.
Just as the personality of a person is very vague, the interactive feedback of interactive devices also gives people a sense of inexplicability. So I chose this way to narrate. The experience of interacting with this device is like feeling my personality in daily life, and he can also have his own interpretation.
Playful/humorous interactions had the effect of reinforcing anthropomorphic qualities, setting unrealistic users’ expectations of CA capability.
Human and animal have a wide variety of modalities to express emotional and internal states for interaction
These have been studied unequally, with a heavy focus on body movement, facial expression, and vocalics
AI has given machine situational awareness and autonomous cognition capabilities.
From passive interaction to proactive interaction.
Spoken dialogue interfaces will become the future gateways to many key services,and might be the next natural form of HCI.
But voice works as the only channel for expression.
As cryptic coloration is not only for camouflage, also working as a tool for information exchange to express intentions and emotions. Machine 1 adapts to the surrounding environment by changing color and only stands out to attract attention when necessary - Calm technology.
Smell can strongly influence human perceptions and expectations of living things. Machine 2 diffuses different smells designed from machine perspective to indicate different emotional and internal states of the smart speaker.
What does the machine's emotions smell like? I selected 4 basic emotions and tried to make scents from the machine's perspective. The angry scent is designed to have a smoky, electronic burning scent. Because if someone destroys the circuit inside the machine, then the machine may be very angry about it. The sad scent is designed with a wet feeling, and the wet environment is not suitable for the machine to work, so the machine will also feel sad in this situation.
Some Creatures display their internal states(fear, excitement, and other emotional states) through skin texture change. Texture is widespread and easily readable behavior. But it is rarely explored as a new way of human-computer interaction. Machine 3 expresses its internal state using skin texture changes.
Voice Control Prototype
Map with Russell’s circumplex model of emotions
Texture operates on two channels
Provide both tactile and visual sensation
Frequency - represent the Arousal dimension
Amplitude - represents the Valence dimension
Gesture is a very subtle behavior to effectively convey information. Different combinations between gesture and voice expressions will generate richer and funnier meaning of the response. Machine 4 raises its hands to actively inform but not overburden user. Sometimes he will initiate interactions for his own benefit rather than to provide services to humans.
Expectations of Intelligence Level
Confidence Interval for ML Model Accuracy
Different Proportions also affect user expectations. We will expect more for objects with a ratio close to the human body
The nuances of raising hands adjust the user's conceptual model of CA and establish accurate user expectations