"Peep" Screen
A modular and customizable screen conveys the emphasis of Oriental cultures on implicit beauty in a faintly discernible way.
Description

“Peep” Screen is a modular and movable free-standing furniture designed for Chinese residents / Immigrants to separate interior space and create private space. The main focus for this individual project is to bring the Chinese unique culture – connotation, ink painting and “Peep” back to modern life in an easily understandable way. User can not see through it but can get the feeling that someone is there which is a well presentation of Chinese traditional aesthetics.

Peep
Design process

Originally, I got inspirations from two Chinese culture elements - Chinese ink painting and oiled paper umbrella. Then,I focused on how to make combination between these two elements and finally got this shape. The unique round frame breaks the monopoly of the square line inside the house which can create a harmonious and relaxing for the people who live in it. The relationship between clouds and mountains creates positive and negative space, making the design more hierarchical.

Sketches
Details

"Peep" Screen is a modular furniture that users can design their own unique screen by themselves. Users can choose which frame to put in which location, and they can move it up and down as well as left and right which gives them the opportunity to decide which space they want to hide behind this screen. So this screen is a very user - friendly design that can be adjusted according to different needs of different users.

Materials
Environment
Customize
Description

“Peep” Screen is a modular and movable free-standing furniture designed for Chinese residents / Immigrants to separate interior space and create private space. The main focus for this individual project is to bring the Chinese unique culture – connotation, ink painting and “Peep” back to modern life in an easily understandable way. User can not see through it but can get the feeling that someone is there which is a well presentation of Chinese traditional aesthetics.

Peep
Design process

Originally, I got inspirations from two Chinese culture elements - Chinese ink painting and oiled paper umbrella. Then,I focused on how to make combination between these two elements and finally got this shape. The unique round frame breaks the monopoly of the square line inside the house which can create a harmonious and relaxing for the people who live in it. The relationship between clouds and mountains creates positive and negative space, making the design more hierarchical.

Sketches
Details

"Peep" Screen is a modular furniture that users can design their own unique screen by themselves. Users can choose which frame to put in which location, and they can move it up and down as well as left and right which gives them the opportunity to decide which space they want to hide behind this screen. So this screen is a very user - friendly design that can be adjusted according to different needs of different users.

Materials
Environment
Customize
Project Info
July.2020 - Sep. 2020
YITU Tech, Shanghai & Hangzhou
Tools
Wekinator, Python- Machine Learning Demo
Sketch, Principle - APP Interface & Interaction
Role
Research, Concept Generation, Prototyping
Innovation Team Projects
Project Info
Mar. 2019 - Jun. 2019
Unit 2 A Tool for Whom
Royal College of Art, London
Tools
Python - Machine Learning prototype
Unity - Working Drawing Interface
Sketch, Principle - APP Interface & Interaction
Role & Teammates
Personal Project
Project Info
Feb. 2017 - May. 2017
Parsons School of Design, New York
Tools
Adobe Illustrator - Graphic Design
Adobe Photoshop - Strokes Design
Role & Teammates
Personal Branding Project
Project Info
Feb. 2020 - Jun. 2020
Unit 5 Launch Pad
Royal College of Art, London
Tools
Python - Machine Learning prototype
Rhino - 3D Printed Physical Model
AE, PR - Real & Fictional Film
Role & Teammates
Personal Graduation Project
Project Info
Nov. 2018 - Jan. 2019
Unit 1 - Smart Habitat
Royal College of Art, London
Tools
Wekinator - Machine Learning
Leap Motion, Kinect - Gesture Tracking
After Effects - Concept Video
Role & Teammates
Personal Project
Project Info
Nov. 2019 - Jan. 2020
Unit 4 Design For The Unsettling
Royal College of Art, London
Tools
Google Assistant API - Voice Interaction
Arduino - Functional Prototypes
IFTTT - Online IoT Platform
Role & Teammates
Personal Project
Project Info
Oct. 2019 - Nov. 2019
Unit 3 - The Exhibitionist
Royal College of Art, London
Tools
Unity, C4D, Premiere - VR Prototype
Raspberry Pi - Tangible Heartbeat Prototype
AR.js, A-Frame - AR Poster
Role & Teammates
Research, Concept Generation, VR + AR + Tangible Interaction Design & Prototyping
Anne-Marie Heck, Rashmi Bidasaria
Project Info
Jan. 2018 - Mar. 2018
Unit 7 - Solar Term 二十四节气
D&I, Tongji University, Shanghai
Tools
Rhino, Grasshopper - Parametric modeling
Arduino, 3D-printing - Tangible Prototype
Role & Teammates
Personal Project
Project Info
Nov. 2018 - 5 days workshop
AcrossRCA - SenseAbility
Royal College of Art, London
Tools
Arduino - Sensory Interaction Prototype
Scent Making
A/B Testing
Role & Teammates
Research, Concept Generation, Sensory Interaction Design & Prototyping
Moritz Dittrich, Janina Frye, Sushila Pun, Yiling Zhang
Overview

"Peep - 窥" Screen is a modular and customizable folding screen designed for Chinese residents / Immigrants to separate interior space and create private space. The main focus for this individual project is to bring the Chinese unique culture – connotation, ink painting and “Peep” back to modern life in an easily understandable way.

User can not see through it but can get the feeling that someone is there which is a well presentation of Chinese traditional aesthetics. Its simple and modern design technique reinterprets the aesthetic relationship between the East and the West, the tradition and the modernity.

Video Still 01 — augur arrives and persuades users to subscribe to augur AI auto-upgrade service
Video Still 02 — augur begins to observe the environment and find patterns that seek user attentions
Video Still 03 — The Upgrade parts designed by AI arrived. User checks the manual to install new parts.
Video Still 04 — augur attempts to use a similar interaction paradigm to attract the user's attention
Evolution Process
Evolved from a basic unit to highly personalized smart objects with different functions and shapes
Click to enlarge
AI Design CMF Diagram
Demonstrate how augur AI collects information and designs its own personalized CMF base on that.
Click to enlarge
Decision Diagram
Demonstrate how augur AI makes upgrade decisions and finishes upgrade within one upgrade cycle.
Click to enlarge
小小AI展厅数字化
数字化被称为“信息的DNA”。依靠智能芯片,计算机能将我们生活的世界转化为一个可度量的数字世界,捕捉到我们肉眼看不到的各种复杂信息。进入展厅,大屏幕就可实时分析参观者的位置信息、性别年龄等数据;
笑容联结你我他
表情是人类重要的交流方式。人工智能会观察你表情的变化,当你露出微笑,它就知道你很开心。通过捕捉观展者的微笑表情,随机制作出活灵活现的表情包;
你们有多像?
每一亿个人中就有一个人和你长得高度相似。中国目前人口约为14亿,意味着有10多个人和你长得几乎相同哦!可能连爸爸妈妈都无法分辨的细微差别,机器却能发现。通过对脸部进行精密识别,判别观展者的外貌相似度;
AI 小伙伴 奇奇
机器人的概念最早起源于古希腊。在中国的西周,也有巧匠制作过“能歌善舞”的木质机器人。随着人工智能的高速发展,机器人变得越来越聪明,并被广泛应用于各个行业。AI机器人奇奇能与小观众进行简单对话,还可以为他们拍照留念;
一起学跳舞
机器视觉算法能检测到人体的17个关键部位,这是对复杂动作判断最有效的17个人体采样点,人工智能以此来实时识别你的动作。
时光打印机
起初的语音识别技术只能识别10个英文数字。现在,机器不仅能听懂我们的话,还可以直接翻译成多种语言,让人们在世界各地都可以轻松交流。通过自然语音识别,打印机能将观展者的留言转化为二维码打印在明信片上,成为留给未来的时光寄语。
Prototype
Program 1 for creating the Interactive movement of graphic elements such as triangles and squares.
Program 2 for creating the connection between the physical installation that have buttons and knobs with graphic elements to enable real-time interaction.
Tangible Heartbeat Prototype
The two drumsticks beat the surface of the box with a certain time difference to perfectly simulate the beating of the heart, so that the experiencers who put their hands on the shell can feel the dual sensory stimulation of vibration and sound. And this sensory stimulation can also stimulate people's curiosity about this installation during non-experience time.
Visual Guide Map with Full Version Exhibition Mock Up
The ‘Exhibition mock-up’ explores the possibilities of showcasing what a larger vision for this project could be.
Click to enlarge
AR Poster
Click to enlarge
KEY FEATURES
Welcome to Doodle Pet
Skill Training
Users can train their own unique AI pets in a variety of ways to unlock their favorite skills.

Taking cat as an example, users can train AI pets by taking pictures of what they think are cats in daily life. They can also import the previous images from the album, or choose from the provided network image libraries.
Draw With AI Pet
After the skills are unlocked, users can collaborate with their AI pets to create unique drawings. When the users draw the outline, their pets will create the corresponding textures to provide uncertainty and inspire users.

Since users choose different images for training skills, the texture will reflect users' unique perspectives.
Review Diary
On the diary page, users can view images selected to train and unlock skills, as well as view previous creations.

For parents, they can better understand the world in the eyes of children and the cognitive development process of children by viewing these images and statistics.
motivation
Identify opportunity areas for innovation
AI Mark-Making
Google DeepDream Exhibition
Obvious Art - AI portrait fetched over $400,000

Train AI with lots of famous art works
But how AI works is still a black box for the public
Machine For Myself
There is also a trend that people who make things have started to shift their focus from objects to processes, building their own machines that make things.

New relationship with machine from subordination to collaboration
What will be a new form of Human-machine Interaction in creative area
when tool has its own thought?

How to let the general public better understand AI and even cooperate with it?
Initial Prototype
Trained algorithm with paired images - Cats’ edges & images of Cats and turned it into an interactive interface using Unity.
Based on Pix2Pix - Image-to-Image Translation with Conditional Adversarial Nets & Keijiro Takahashi Pix2Pix for Unity.
An interactive real-time drawing recommendation system.
AI just try to make suggestions instead of taking over control.
Suggestions provided by AI doesn't aim to obtain a suitable answer, but can create uncertainty and inspire users.
Drawing Outcome
The obstacles to human creativity are human experience, logic, and methods used by humans.
Can AI help us to transcend our experience or logic or methods, so that human creativity can be further released?
RESEARCH
Who can benefit from it?
Case Study
It is very important for young people to cultivate creativity in the era of AI. What children need is technology that matches their infinite imagination.

How to cultivate creativity?
1. Go out in nature and capture inspiration from life
2. Art-related activities such as drawing and photography
Everyone can create @ Apple inc.
Literature Review
Piaget’s theory of cognitive development

The Concrete Operational Stage (7~11)
Children are able to incorporate inductive reasoning. Inductive reasoning involves drawing inferences from observations in order to make a generalization.
User Interview
Most of the parents believe that their children need to learn AI-related content.

Drawing can extend child’s imagination and creativity

Child from 1~6 can always think independently
Child after 6 are more easy to be limited by others
Persona
Limitation or Diversification?
Normally, AI scientists decide what kind of data to select.
So the output highly depends on what they think “Cat” is.
What if we give the right to children to choose the training images
depending on their views of the world?

How might we design a tablet app to
extend creativity and maintain independent thinking for children(6~10)
by using machine learning technology?
PROTOTYPING & ITERATION
Make the technology invisible
Prototype 1.0
User Journey
Competitor Analysis
Virtual pet games can motivate behavior change
Virtual pet games have similar logic with machine learning process
Prototype 2.0 - Virtual Pet
User Testing
Users pay more attention to upgrading pets by feeding, rather than drawing with pets.
Deviated from the main objective - cultivate creativity
Cats drawing @Whalen & Paper prototype testing
User Flow
Click to enlarge
Wireframe & IA
Click to enlarge
Stakeholder Analysis
Inspired By Biological System
Gulf - Expectation & Experience

Playful/humorous interactions had the effect of reinforcing anthropomorphic qualities, setting unrealistic users’ expectations of CA capability.

Human and animal have a wide variety of modalities to express emotional and internal states for interaction

These have been studied unequally, with a heavy focus on body movement, facial expression, and vocalics

How might we develop a new expressive nonverbal channel
for the CA  to express emotional and internal states for interaction?

AI has given machine situational awareness and autonomous cognition capabilities.

From passive interaction to proactive interaction.

But how about Color, Smell, Skin Texture, Subtle Gesture...?
Machine Proactive Interaction
The Context
Conversational Agent(CA)

Spoken dialogue interfaces will become the future gateways to many key services,and might be the next natural form of HCI.

But voice works as the only channel for expression.

EXPERIENCE PROTOTYPING
Machine1 - Cryptic Coloration

As cryptic coloration is not only for camouflage, also working as a tool for information exchange to express intentions and emotions. Machine 1 adapts to the surrounding environment by changing color and only stands out to attract attention when necessary - Calm technology.

Machine 2 - Scent Making

Smell can strongly influence human perceptions and expectations of living things. Machine 2 diffuses different smells designed from machine perspective to indicate different emotional and internal states of the smart speaker.

What does the machine's emotions smell like? I selected 4 basic emotions and tried to make scents from the machine's perspective. The angry scent is designed to have a smoky, electronic burning scent. Because if someone destroys the circuit inside the machine, then the machine may be very angry about it. The sad scent is designed with a wet feeling, and the wet environment is not suitable for the machine to work, so the machine will also feel sad in this situation.

Machine 3 - Texture Waving

Some Creatures display their internal states(fear, excitement, and other emotional states) through skin texture change. Texture is widespread and easily readable behavior. But it is rarely explored as a new way of human-computer interaction. Machine 3 expresses its internal state using skin texture changes.

Voice Control Prototype

Map with Russell’s circumplex model of emotions

Texture operates on two channels
Provide both tactile and visual sensation

Frequency - represent the Arousal dimension
Amplitude - represents the Valence dimension

Machine 4 - Hands Up

Gesture is a very subtle behavior to effectively convey information. Different combinations between gesture and voice expressions will generate richer and funnier meaning of the response. Machine 4 raises its hands to actively inform but not overburden user. Sometimes he will initiate interactions for his own benefit rather than to provide services to humans.

Expectations of Intelligence Level

Confidence Interval for ML Model Accuracy

Different Proportions also affect user expectations. We will expect more for objects with a ratio close to the human body

The nuances of raising hands adjust the user's conceptual model of CA and establish accurate user expectations

Exhibition & Validation
view more projects