Xiao Jiang Portfolio for UCL MArch Design for Performance and Interaction

Page 1

OVERVIEW

the

id

In this project, I will be discussing the nature of an ancient thought experiment, the Ship of Theseus, and how it applies to psychological projection. When we encounter a third party individual, we start judging them immediately based on environmental factors, social norms, stereotypes and so on; that is, we see the embodiment of our own expression and projection in them. This raises the question, when one is covered completely by our own presumption and prejudice, do we still see another as who he or she originally is, or do we see an exemplification of what we want to see? If the latter is so, where can we draw the line that differentiates this individual from who he or she originally is and the exemplification of our own mind?

and

a discussion of psychological projection

Bio Design Installation Time-lapse


RESEARCH

Mind Map

THE ID AND SHIP OF THESEUS

Moss Test

The mind map is an important step as it connects all ideas and thoughts around the ideology and connect dots to form a bigger picture. “Me” as representation of self is often divided into id, ego, and superego. Each one represents a part of you; they form you, but do not isolate you.

Mold Test

Environment Test

on dyed filter paper

on clay vacuumed environment with clay

Work in Progress I chose moss as the medium to conceptualize thoughts and prejudices. I was looking for something that implies a feature of time, that can change or grow or alter gradually over time without being a distraction. When it covers the “body” entirely, such material should not change the fundamentals of the “body.” Plywood serves as a symbol of salute to the origins of the Ship of Theseus, while the removable structure allows viewers to look into the installation’s inside only if they remove a piece of wood board, indicating limited and biased perspective. Clay reflects ancient Chinese mythology that claims humanity was created by the mother goddess, Nüwa, who molded yellow clay into the shape of a human and gave life to them. Related to my own personal experience with ceramics, clay is always something I work comfortably with.

on agar

open air with clay


CONCEPT

Proposal

Starting in 2020, when COVID-19 disrupted every part of our lives, everyone was suddenly wearing masks and we are expected to wear them as an essential item for the foreseeable future. I cannot help but think of how a mask that covers the majority of one’s face has started to replace and become one’s identity. As a very intimate object that touches your skin directly and contains massive amounts of your DNA through breathing, the mask scientifically contains your identity. On the other hand, customized masks are now emerging with different colors, prints, and textures that all serve as details that reveal your identity. Therefore, I have decided to use masks as an embodiment of the individual for this project. To visualize the difference between two masks, lip gloss and foundation will remain on one of the masks. The procedure will be the same for both; slime mold will be planted on one mask and the expansion procedure will be monitored with no interference.

THE ID AND SHIP OF THESEUS


TESTS

Setting

THE ID AND SHIP OF THESEUS

Container Test Agar is tested within a glass open box and an acrylic open box. As agar needs to be boiled before setting, container strength is important.

glass box

arclic box

Stage One Result


FINAL PRESENTATION

THE ID AND SHIP OF THESEUS

Transmitting

https://vimeo.com/493699051

Achieving

The final presentation, based on the nature of the project, is divided into three parts: initiating, transmitting, and achieving. These three parts echo the growing procedure of slime mold, its position as it travels, and also implies the shifting of minds of ideology.

Initiating

Presentation


GRAPHIC DESIGN ANIMATION INTERACTIVE AR


INTERVIEW I interviewed the staff one-on-one and analyzed their personality composition. Based on their personality, I designed a unique badge using a circle (emotion), a square (reason), and a triangle (will) that represents each individual. Inner shapes represent supplementary personalities and their relative position refers to personal preference during the interview.

Each member of the staff has been provided with several unique stickers that are encoded with their own personality. They are invited to put a sticker or two on their department poster whenever and wherever they like; the only requirement is to use their LEFT HAND ONLY. The key is to really follow your heart. You are what you put out there.

triangle(will)

circle(emotion)

square(reason)

REASON Dominate Personality

WILL Dominate Personality

EMOTION Dominate Personality

HUMAN RESOURCES

MARKETING DEPARTMENT

ADMINISTRATION DEPARTMENT


COLLABORATE You don’t have to restrict yourself in the designer area. Stacking and overlapping is welcomed. There will be three blank posters hanging in these three offices, and each staff will be assigned a special sticker to identify themselves. Staff members are asked to put a sticker on the poster whenever and wherever they like using their left hand. According to mythology of “Tarot” and “Chakra,” your innocent act or move will revel your inner personality even when you are not paying attention. Without restricting time, place, or how you place your stickers, there is still a way to decrypt your emotional statues or even your close future.

HUMAN RESOURCES

MARKETING DEPARTMENT

ADMINISTRATION DEPARTMENT


REDESIGN DESCRIPTIVE INFORMATION

When the day is over, posters full of stickers will be collected. I will then analyze the final pattern and the way they put the stickers on to make a conclusion from the collective information and redesign another poster that will exaggerate their personality and position in the office. At the same time, I will convert it into something more AR friendly. Two posters are displayed side-by-side as comparison.

This poster was created from your collaboration. Each shape represents a perspective of your personality: the circle as emotion, square as reason, and triangle as will. Please feel free to take out you phone and scan the QR code, you will be surprised.

SHAPES Each shape on the poster represents each individual in this department, with different sizes and shapes. The poster reveals one’s activity and ambition, and the location of each shape refers to either the very first sticker each person chose to add or most of one’s sticker locations. The crosses and bar codes are designed for a better AR scan experience.

DEPARTMENT TITLE CONNECTIONS

HUMAN RESOURCES

MARKETING DEPARTMENT

ADMINISTRATION DEPARTMENT


INTERACT STORY BOARD This particular animation walks through a day of an EMOTION dominate employee, who may come in to work cheerfully, represented by large portion and replication of the circle shape. By mid-day, work pressure and office social pressure may start to be overwhelming, represented by the square and triangle, and how the shapes push and pull. Eventually, as an emotion dominate person, emotion will find a way to take control, shape-wise as well.

MAKING PROGRESS The AR experience is made possible by SPARK AR

FINAL PRESENTATION https://vimeo.com/493699596 With the Marauder's Map in Harry Potter, one’s every secret has nowhere to hide under its magic. With AR technology today, we can make magic actually happen in real life. After a day’s work, everyone becomes a collective of icons whose embedded vibes cannot be told or seen, that is “what’s under the water”. With Augmented Reality, each of you becomes a living character just as in the Marauder's Map. Your path, emotions, efficiency, and even your relations with your coworker are not secret under this “magic.”


abstract interactive installation TouchDesigner data visualization

This is an interactive immersive experience using audio control and moving images, made possible by TouchDesigner, that helps define a word that we may not understand in social context. With this project, I hope to eventually achieve a comprehensive system that helps explain things for us by searching what can be found in existing databases of human creation in order to forge a collage of images that defines a subjective word in an objective perception.


method

inspiration This project is inspired by a conversation with my friend Liang. Liang had the nickname “mao xiao zhu (毛小猪)” until today, which can be translated literally as “furry little pig,” but “mao xiao zhu (毛小猪 )” is not really a word, nor have I heard it elsewhere. This nickname was given to her by her father when she was little. Weirdly, this nickname has nothing to do with her objectively, as she is neither furry nor chubby, and her zodiac sign is not a pig either. Liang told me that she was often confused by this nickname during her entire childhood and still wonders where this nickname came from, or what picture does it construct for people who are not familiar with her personally. Therefore, we decided to come up with something that would solve this problem for her by helping her find out what “mao xiao zhu” means, or at least resembles, in a third personal perspective.

There are often words we can’t find in the dictionary but, when used in certain conversations, we are often curious about the meaning of these words and struggle to figure it out. With this project, all undefined words are explained by retrieving a certain database, so we can at least have a reference of what these words refer to in common knowledge.

?

Secondly, by referring to the mega database of movies, I am hoping to find out how the word “mao xiao zhu” may appear in visual and audio contexts, individually or collaboratively. Subzin.com is a great help to me as it is a database for all movie subtitles that made my search significantly easier.

brainstorm The first step in defining “mao xiao zhu” was to try to understand this word literally by its characters, by looking in a dictionary and searching for the etymology of the words, with the hope of discovering the origin of the characters.

“TouchDesigner is a node based visual programming language for real time interactive multimedia content. With TouchDesigner, I am able to connect audio control with movie database, and make interactive experience possible through minimal coding.

tools

research movie clips

Legend of the Demon Cat. 2017 “only cat hair can be such thin and soft”

An Elephant Sitting Still. 2018 “this big, long fur, dog this big, this tall”

Dying to Survive. 2018 “why the hell you bombed me instead”

Youth. 2017 “and taught myself to knit you a sweater”

Let The Bullets Fly. 2010 “the $1.8 million bounty is but a strand of hair”

The Rooftop. 2013 “the reward goes to red hair, best employee of the year ”


tests

making

data-moshing tests

With the audio analysis TOP in TouchDesigner, input audio was divided into statistics of low, mid, and high tones, and even kick snares and rhythm. For this particular project, I only selected rhythm and created a filter that only recognized a similar rhythm to “maoxiaozhu.”

Before I finalized everything with TouchDesigner, there were several failed attempts with different media and tools.

collage edit tests audio analysis

With movie file TOP in TouchDesigner, I was able to introduce all movie clips from the database and have them filtered by numerical data of rhythm, so that when the audience shouted out the magical word “maoxiaozhu,” coordinated movie clips would show as a collage glitch.

full picture

movie input

Reactive video collage based on webcam that mimics actual filter process.

Data-moshing is the process of manipulating the data of media files in order to achieve visual or auditory effects when the file is decoded. During my early attempts, I used data-moshing to fuse different movies clips in order to forge a new language that explains the context based on combining similar elements.

clip edit

Movie clips were edited, merged, and covered before final input. The idea was to process raw material before making connections between clips. The main idea was to let the machinery do the work under a certain set of logic I established. I hoped not to interfere too much with this process as I am merely an observer of any result it presents.

web cam module


presentation The final presentation will be an interactive immersive experience with audio control and video collages that contain all movie clips that contain the word “mao” or “xiao” or “zhu” and compose collative images. This installation is presented in an open space to create an immersive experience. A laptop with a built-in microphone is placed in the middle of the space as controller. My friend Liang will sit in front of the camera as a default subject while participants shout out her nickname, “mao xiao zhu,” in their own native voice with their dialect or accent. The program will then analyze the characteristics of their voice and retrieve movie clips that fit most accurately with the voice and present it as a collective movie collage.

phase 1 During phase 1, viewers are presented with the real-time setting of this interactive installation and how participants play with it. On the left side of the screen, a searching experience on a phone is displayed as a reference of how this part of the installation is mimicking the actual searching experience on social media.

phase 2

https://vimeo.com/493698358

In the second phase, viewers are introduced to TouchDesigner, a visualization tool that helps us put together all the information we gathered by matching images with audio. During the final testing round, I invited several of my friends to play with this installation and observe how and what it turned out.


AD

QU D

NE

AL

W

ER

DE

US

TI

LT

ON

ER

LA

T

FA U

ES

ND

NA

IN

G

IR

DO

E

M

YD

Inspired by my personal experience of being a patient for digestive disease for years, Nice Shit provides a convenient domestic resolution that could analyze your digestive health by examining your shit every time you poop. Nice Shit not only provides bio tests for patients but also nutrition analysis for non-patients as well in order to raise awareness of digestive health among all age groups. This is a comprehensive project that includes product design, UI/UX design, and branding design.

IN

OC

G

TO

R

W

EL

SE

L

RE

VE

PO

RE

RT

AL

ER

PA G

T

E

a solution to digestive disease


INFLUENCE Digestive disease is a big topic that does not only concern me but millions of others as well, and the numbers continue rising. From physical to financial, digestive disease is a burden for large numbers of families not paying enough attention. Additionally, it happens not only with the elderly as people may assume, but patients range for toddlers to middle age, male or female.

236,000

COST: $200-$400 PREPARATION: FASTING BEFORE HEAD, WITH CONTRAST INJECTED DURING PROCEDURE, DRINK SUFFICIENT WATER AFTERWARD TO HELP FLUSH DOWN THE CONTRAST TIME: 10-15 MINUTES

COLONOSCOPY COST: $600-$6400 PREPARATION: 1.FOLLOW A SPECIAL DIET THE DAY BEFORE THE EXAM, 2.TAKE A LAXATIVE, 3.USE AN ENEMA KIT TIME: 30-60 MINUTES

RESEARCH

ambulatory care visits was caused by digestive disease

ROBERT

Annual Medical spend: $15,000+

COST: $160-$1300 PREPARATION: FASTING BEFORE HEAD, WITH CONTRAST INJECTED DURING PROCEDURE TIME: 15-30 MINUTES

COST: AVG $4900 PREPARATION: FASTING BEFORE HEAD, WITH CONTRAST INJECTED DURING PROCEDURE, DRINK SUFFICIENT WATER AFTERWARD TO HELP FLUSH DOWN THE CONTRAST TIME: 1-2 HOURS

Business Owner Upper class

CT SCAN

PET SCAN

105

USER PROFILE

ULTRASOUND

PROCEDURE

MALE 66 YRO

CAROLINE

Medical history: Diabetes, Heart disease, Bladder control Needs: Monitor Body activity

UI Designer Middle Class Annual Medical Spend: $23,000+

COST

142,000,000,000 cost of surgical procedures for digestive disease

98,000,000,000 direct medical cost of digestive disease

13,000,000,000 drugs prescribed for digestive disease

AGE U NDER 15 AGE 15-44

AGE 65+ AGE 45-46

FEMAL E

FEMALE 25 YRO

Medical History: Ibd For 5 Years Needs: Control Progression

MAL E

Digestive disease in reality is also a big topic that does not only concern myself but millions of others as well, and the number continues to rise. From physical to financial, digestive disease may become burden for numbers of families that are not paying enough attention. Meanwhile, it happens not only to elderly as people may assume, patients range for toddlers to middle age, male or female.

USER MAP

TERESA

Unemployed Middle Class Annual Medical spend: $5,000+

FEMALE 10 YRO

Medical history: Undiagnosed Needs: Save time and money by reduce hospital visits


As we have a basic idea for what we want to produce, we prepared all potential contestants for comparison, and pros and cons were evaluated from 5 essential aspects.

Rapid stool tests are rapid immunochromatographic tests for the qualitative detection of rotavirus in human feces samples. The test utilizes antibodies specific for rotavirus to selectively detect rotavirus from human feces samples.

The AI Toilet provided by LIXIL includes a sensor camera inside the AI toilet. When the user defecates, the toilet will immediately perform image recognition of the stool and automatically classify the shape and size of stool according to international indicators.

SPEAKER Speaker will play different to inform, alert or just simply amuse you.

NICE SHIT Nice shit is a portable device that you can install on your toilet with a coordinating app on your phone to examine your shit every time you poop.

PRODUCT

The sensor-embedded camera will scan your anal print for your identity when you sit down and accurately detect where you have pooped in order to release the probe to the right place.

TEST KIT

The concept for Nice Shit product design is to keep it simple and user friendly. Because of its special nature, installed in the toilet, sanitation and functionality under water is essential. The device contains three major parts: a speaker for alerts and amusement sounds, a camera for identity capture and poop location, and a test kit container that stores test paper, solution, and a probe.

The test kit contains 20 pieces of test paper that will cover approximately a month of usage. Each purchase contains 6 test kits for you to change out.

PROBE The probe is a three-section structure that connects with all-direction nobs and reaches nearly every spot in a toilet.

C

U

R

A TIM C Y E

Hospital is the typical place people go when feeling unwell.

LIXIL AI TOILET

CAMERA

C E

A

S

ES

P

R

IC

CASE BODY

E

A

N

G

EX

C

The case has light magnets embedded and a flexible holder that will secure your changeable test kit and is easy to install.

R

HARDWARE

IN

TR

O

HOSPITAL

RAPID STOOL TESTS

CO M PA R I S O N

CONCLUSION 1. DIGESTIVE DISEASE IS AN URGENT MATTER WITH A LARGE AUDIENCE, YET NO EFFICIENT SOLUTION. 2. DIAGNOSES FOR MOST DIGESTIVE DISEASE ARE COMPLICATED AND PAINFUL, AND OFTEN COST A FORTUNE. 3. CURRENT SOLUTIONS FOR DIGESTIVE DISEASE ARE EITHER TOO EXPENSIVE OR TOO TROUBLESOME. 4. TARGET CUSTOMER SHOULD INCLUDE ALL AGE GROUPS AND GENDERS, THAT ID SHOULD NOT LIMIT PATIENTS. 5. USABILITY SHOULD BE EASY AND SEAMLESS, THE PURPOSE IS TO MONITOR DIGESTIVE HEALTH WHEN PEOPLE ARE NOT PAYING ATTENTION.

SUCTION DISK ULTRA THIN BATTERY

TEST PAPER

The battery is embedded inside the main part; it is not changeable. With standard operation, the battery could normally last about three years.

The test paper is infused in a special solution that will change color and appearance based on the test result. The test paper is flushable and will be discarded when the result is received.

The suction disk is attached to the end of the probe that picks the test paper from the opening of the test kit and delivers it to your poop for examination. The suction disk is also equipped with a sensor that will identify the test result and send it to your phone.


1 open the box and take out the product

3

2 place the sensor on the inside wall

5

SOFTWARE

lock down the test kit

4 connect the device with the app

when you sit down, the camera scans for your identity, and makes a fart sound if it recognizes you

STORY BOARD

USER FLOW

The storyboard introduces how Nice Shit functions with front installation and replacement. When you receive a Nice Shit, take it out from the box, install it on your toilet, and connect to your phone with the instructions. After that, no additional care is needed. When test paper storage is low, you will receive a notification from your phone to remind you to replace the test kit. Each test kit contains 20 pieces of test paper, which covers approximately one month of usage, and each box contains six supplementary replacements, which ensure your usage of about half a year, and, of course, you may always purchase additional test kits from our official website.

User flow introduces functions and special features for the Nice Shit app. One of the most special features is the customized interface for patients and non-patients. After answering a short questionnaire when you register, the system will display a different home page and function priority based on your answers. Besides daily reports that are available to you a few minutes after you poop, there are also monthly and annual reports that analyze you bowel movements and summarize long-term tendencies for future medical reference.

7

6

LOGIN

STATUS when the camera detects your poop, the probe reaches out with a test strip precisely on your shit to test

8 the result will be reported on your phone, while the speaker makes different sound for different statuses

when the test is finished, the probe will retreat and release the test stripe to be flushed

9

10

when the test kit is running low, an alert on the app will remind you to change the kit

when the test kit is empty, the speaker will make a naughty sound when you use the toilet to remind you

GENERAL INFO

ALERT


REP

LOGO

LAN

Nice Shit in my conception is going to be not only an isolated device that you install in your toilet but an ideology that differentiates from other tech devices you are used to seeing. With a toilet paper logo and bold colors, I wish to bring a tiny bit of joy into the trivial and mundane parts of life of fellow fighters who have to face a lifelong chronic disease every day.

LOGO

DIN

G PA

O RT

PAG E

GE

The general tone for this brand is set to be positive and cheery to dilute the cold distance that people often feel with ordinary high-tech products. Key elements were extracted from everyday objects that you can find in your bathroom, in order to bring users an intimate experience.

ALE

LOGO VARIATIONS

DOI

RT SEV

BRANDING

ICONS

vegetable

protein

MY

carb

ADD

LOGO & SUPPLEMENT SHAPES

COLOR #e1007b

#f9d324

#56e09f

#5494fc

FONT AVENIR NEXT Demi Bold Italic

AVENIR NEXT Bold Italic

AVENIR NEXT Heavy Italic

AVENIR NEXT Heavy Italic

NEW

USE

R

DOC

TO R

ERE

ALE

RT

NG W

ELL


UNKNOWN_CODE

INTERACTIVE PERFORMANCE EXPERIMENTAL MUSIC BRANDING EVENT COLLABORATIVE WORK

COLLABORATIVE WORK

On behalf of LAMFO, the independent fashion studio, I worked with an experimental group, Groundless Camp, to integrate experimental music and improvise performances to fully present the possibilities of cross border art. We also provided an interactive space for collective experience. LAMFO provided special temperature-sensitive fabrics for dancers; under a dancer’s touch, the fabric leaves traces of movement due to the change of color.

https://vimeo.com/503370716


UNKNOWN_CODE

COLLABORATIVE WORK

BEHIND THE SCENE: Pr-iron the fabric for better performance effect

BEHIND THE SCENE: Rehearsal

BEHIND THE SCENE: Setup


UNKNOWN_CODE

COLLABORATIVE WORK

CO-HOST

Differing from the traditional performance, we deconstructed the stage so that the audience's passive viewing habits in the past would be transformed into active selection of viewing. The audience can enter the spatial structure of the stage, arrange their own viewing, and become participants. This also enables the performer to be integrated into the exhibition space like an exhibit. The deconstruction of the performance space does not break the integrity of the work as performers scattered in different areas will cooperate with each other to complete experimental works. After deconstructing the traditional stage viewing habits, the stage is reorganized through multi-media, live stream software, interactive sound generators, and temperature sensitive fabric. At this time, the different media become the "stage" and the audience is back to their original viewing habits. In such case, audiences not only participated in the stage and performance, but also constituted a very personal viewing experience by different viewing routes and sequences.


EQUILIBRIUM

WINDOW INSTALLATION INTERACTIVE BRANDING EVENT

OTHER WORKS

LAMFO cooperated with CHAO Hotel, Beijing to create an interactive window installation based on LAMFO’s first season ideology "EQUILIBRIUM". We tried to explore people's self-cognition and individual identity in different environments, as well as self-balance in this highly refined and fragmented society. Only when the participants stand at the best viewing point can they observe a balanced field of reaction forces between sculpture and fabric. This field leads the participants to feel a loss of control and tension from the multidimensional space. Any attempt to stand off-center will result in a state of being out of focus, and the resulting anxiety and uncertainty reflects the reality of our daily life. http://jiangxiao.me/lamfo-chao.html


Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.