HUMAN CONNECTIONS Communication through Facial Expression
Media Environment Studio, 2020-1, Final Output of yvonne.S Supervised by david.H
INPUT EMOTION
01 Step1 - Facial Expression Input by FaceOSC Step2 - Connect FaceOSC and Processing
Facaial Expression Recognition Facial expressions may have evolved as efficient ways to telegraph feelings and intentions. And it is possible that forcing your face to express happiness, sadness or anger may help you feel those emotions. Tools: FaceOSC, Processing 3, Unity
02
Pet Phrase/Voice Recognition Pet phrase is an informal term for an expression frequently used by an individual in speech and/or writing. Pet Phrase can reflect our personality and reveal our mental status. Tools: LilyEmotion 1.0
03
Digital Animations a. mobius b. X - different shapes & colors equal different emotion Frame Position Controlling Tools: Maya, Processing, FaceOSC
04 Repeated and Rythem
Way of Deployment Mondrian (Primary Colour)
Physical Displays a. petals b. iris c. domino d. stained glass (church window) e. normal coloured glasses - different patterns based on theory - physical experiments For now, they’re still the simulations in Autodesk maya.
OUTCOMES
FaceOSC Emotion Input
FaceOSC will track a face and send its pose and gesture data over OSC, as well as the raw tracked points (when
Processing 3 Data Input
Processing will get the data from FaceOSC, and also can input video to make the face gesture control frames.
Connect with FaceOSC, Get the data of facial expression Input Animation Recognize the width of mouth Create Trigger Event - Reverse the speed of animation
Digital Animation Mobius
Blue & Smooth equals Calm; Red & Sharp equals Angry.
Petals Breathe
Abstract Petal Field - Transformation
I’d like to use facial expression to control the transformation of these ‘petals’. I was guessing, in this case, the petals and human can infulence each other. Because Repetition helps to create a rhythm and a sense of movement and tension and order. It can also transform simple things into complexity and holistic.
我想使用面部表情来控制这些“花瓣”的变换。 我猜想，在这种情况下，花瓣和人类之间会相互影响。 因为重复有助于创造节奏，运动感，紧张感 和秩序感。 它还可以将简单的事情转变为复杂性和整体性。
Stained Glass Way of Deployment v1
There’s a ring outside the installation with some spot lights. Then your facial expression would be connected to this r glasses would be changed too.
A RING OUTSIDE WHICH CAN ROTATE WITH SPOT LIGH
装置外面有一圈圆环，上面有一些聚光灯。 然后，面部表情将连接到圆环。 当更改面部表情时，它将随聚光
ring. When you change your facial expression, it will rotate with the spot lights, which means the shadow of stained
HTS
光灯一起旋转，这意味着彩色玻璃的阴影也会被更改。
SPOT LIGHT
Stained Glass Way of Deployment v2
In this case, the light will move on the track beside by using a motor.
SPOT LIGHT moving on a track
Stained Glass Way of Deployment v3
Using the projector to mapping the fake shadow on it. So there’s no need to think about where to deploy the light. How to do it? In this case, we can use the projector instead of the light equipments. Hanging the projector from the ceiling, then project the fake glass shadow on the wall. Why projection mapping? We can use projection mapping to imbue life into static objects via optical illusions, or by adding supplementary dimensions. Weakness? It can be interesting, BUT It’s not real. Thus maybe it cannot present like the real effect of stained glass.
PROJECTOR HANGING FROM THE CEILING
EFFECT SIMULATION Process -Match size in Photoshop -Create 3D Model -Do the Simulation -Rendering shadow-only Animation -Project on the wall/glasses 处理 -在Photoshop中匹配大小 -创建3D模型 -模拟 -渲染仅阴影动画 -在墙上/玻璃上投影
我们可以使用投影仪代替照明设备。 将投影机悬挂在天花板上，然后将数字阴影投射在墙 上。 为什么投影映射 我们可以使用投影映射通过错觉或添加补充尺寸将生 命注入静态对象。 弱点 可能很有趣，但那不是真实的。 因此，它的呈现效果 可能不如彩色玻璃那样出彩。
Stained Glass Mondrian v1
Primary Colours Primary Colours are the first colors we learned about. When we were a baby, we can only see the bright primary colors. Maybe that’s why primary colours are so appealing to us. Complementary Colours Colors that are opposite each other on the color wheel are considered to be complementary colors Complementary colors are especially pleasing to the eye because different types of photoreceptor cells, which contribute to color vision, perceive different types of light in the color spectrum, Apartment Therapy explains. Golden Ratio If you take our Golden Ratio diagram above and draw an arch in each square, from one corner to the opposite corner, you will draw the first curve of the Golden Spiral (or Fibonacci Sequence). You’ll find this beautiful creature throughout nature’s forms—ferns, flowers, seashells, even hurricanes—which perhaps why we find it so visually appealing. Because it is, indeed, nature at its finest. The Piramids of Giza and DaVinci’s MonaLisa are designed using the golden ratio. It’s a mathematical ratio which is commonly found in nature. When we use it in design, it foster organic and natural looking compositions that are aethetically pleasing to the eye. Basic Shapes The simple shapes are the square, rectangle, circle, ellipse, and triangle. These are the basic forms that are used as the foundation for all other shapes. Squares and rectangles are familiar safe and comfortable, Squares are considered to be one of the most honest shapes. Simple shapes work beautifully, they are memorable, easy on the eye, and instantly recognisable.
Stained Glass Mondrian v2
At present the reaction is ONLY to one expression Thin mouth ( frown ) = light position A Low shadow Wide mouth ( smile ) = light position B Long shadow
Stained Glass Mondrian v3
Stained Glass Mondrian v4
Physical Experiments Shadow of Coloured Acetate Sheets
I use coloured acetate sheets to cast shadows. It is a cheaper way to simulate the coloured shadow without stained glass.
Physical Experiments Shadow of Coloured Acetate Sheets
Stained Glass
Light Streaming through Window We cannot see the light directly. We can only see light with medium, such as in a dusty atmosphere. The natural light streaming through stained glass was compared to divine light. And visual richness of stained glass made a powerful appeal to eyes and emotions. 我们不能直接看到光。 我们只能通过介质看到光线，例如在多尘的气氛中。 彩色玻璃的视觉 丰富性对眼睛和情感具有强大的吸引力。
Stained Glass
Light Streaming through Window