Independent director animation
Time-Stitched:
A Virtual Patchwork Odyssey Xu Zhuoyan 2023
Background ＆ inspiration
断（だん）、舍（しゃ）、离（り）
Chinese culture
Baijiyi(百衲衣), also known as "Baijiayi", is a traditional Chinese clothing originating from ancient China. This type of clothing is unique in that it is made from many small pieces of fabric, often sourced from family members or friends' old clothes. Each piece of fabric carries specific emotions and stories, making each piece of Bai Nie clothing have unique emotional value and historical significance.
Emotional connection
Sustainability and reuse
Story inheritance
Arts and Crafts
Symbolic meaning
History and changes
Each piece of fabric represents a
Making bainai from old clothes is
Bai Nie Yi is like a living history
Making Bai Nie Yi is not only a
In some cultures, Bai Nie Yi is
As time goes by, the styles and
personal memory and emotion,
a sustainable way of life,
book, recording the stories of
life practice, but also an artistic
also given special symbolic
production techniques of Bai Nie
and the pieces are stitched
demonstrating an early
many families or communities,
creation. It embodies the
meanings, such as happiness,
Yi are also constantly
together to symbolize the strong
awareness of resource reuse
and is a form of cultural
craftsmanship and creativity of
health, longevity or unity.
developing and changing,
bonds between family and
and environmental protection.
inheritance.
craftsmanship.
community members.
Detachment, a life philosophy originating from Japan, advocates improving the quality of life by simplifying life. It involves reducing unnecessary possessions and information (cutting off), letting go of possessions and emotions that are no longer needed (discarding), and moving toward new lifestyles and thought patterns (departure). This approach has shown its value in dealing with the complexities and consumerist pressures of modern society, helping people focus on intrinsic value and personal growth.
reflecting the evolution of society and culture.
owever, the practice of renunciation should also take into account its limitations and diversity of applications. In some cases, it may make more sense to keep items that are associated with personal history, sentiment, or culture. Therefore, a more flexible and personalized approach that includes not only physical and psychological simplification but also recognition of the emotional and cultural value of objects and habits may be more appropriate. This comprehensive approach emphasizes the importance of personal choice, allowing people to simplify their lives while also valuing those things that are special to them H
Buddhism
Bai Nie Yi also has important cultural and spiritual significance in Buddhism. In the Buddhist tradition, this kind of clothing is called "cassock"(袈裟)or "gasa" and is usually worn by monks. Its production and use contain profound Buddhist philosophy and practice thoughts: Abstain from greed and simplicity: Buddhism emphasizes avoiding greed and material desires, and the production of Bai Nie Yi reflects this lifestyle of simplicity and non-material pursuit. Monks use old fabrics to make cassocks, demonstrating a non-dependence on material goods and a self-sufficient attitude towards life. Zen spirit: In Zen Buddhism, the robe has become a symbol of practice and meditation. Each piece of fabric represents a story, a lesson, or a spiritual awakening. The concept of impermanence: Buddhism teaches that everything in the world is impermanent. The patchwork of the robe and the constantly changing pieces of cloth symbolize this impermanence and continuous change of the universe. Compassion and mutual aid: Each piece of fabric used for the Bai Nie Yi usually comes from a donation from a donor, which reflects the spirit of compassion and mutual aid among Buddhists. Personal practice journey: For Buddhists, cassock is not only a piece of clothing, but also a testimony of their practice journey. Each piece of fabric added was a milestone on their path.
O
bjects and Memory: Showing that objects are not
only physical objects, but also carry personal or collective memories and emotions. Through the story of each piece of fabric in Bai Nie Yi, the connection between objects and personal history is explored. Cultural sustainability: Counter-disconnection can also be seen as a cultural sustainability practice. It emphasizes preserving and cherishing items with cultural and historical value rather than simply discarding them. Reflection on modern consumerism: By showing the making and use of Bai Nie Yi, your project can explore the issues of over-reliance on material things and consumerism in modern society.
Balance between spirituality and materiality:
ombining Buddhist thought to explore how to find a balance between spiritual abundance and material needs. This can be achieved by showing the stories and meanings behind the items. Redefine “value”: Your project can challenge traditional notions of value, exploring how an object’s “value” lies not just in its physical attributes, but also in the stories, emotions and history it carries. C
01
Inspiration and research:
ods of Heaven and Earth: The General in Heaven and the G Female General Underground（地上女将军，天下男将军）
Traditional interpretation from a modern perspective
In traditional Korean beliefs, these two gods represent power and balance between heaven and earth. The Heavenly General, as the guardian of the sky, symbolizes infinite power and protection. The underground female general is closely connected with the fertility of the earth and the well-being of the family. This relationship of opposition and harmony inspired me to explore themes of balance, strength and fragility between heaven and earth in animation.
The everlasting wooden pillar: a symbol of nature and protection
（장생목주）
Wooden pillars of longevity, a protective symbol in Korean tradition, are often carved with images of these two deities, representing respect for the natural world and supernatural forces. This cultural practice of blending nature and divinity inspired me to incorporate natural elements into my animations and explore mystical directions.
Cultural heritage and the power of symbolism These elements are not just expressions of folk beliefs, they are deeply rooted in the history and philosophy of Korean culture. In my animation work, I try to capture the deeper meaning of these myths and symbols, transforming them into visually engaging stories and character designs.
By combining these ancient elements with modern animation techniques and narrative methods, I hope to create works that have both historical depth and resonate with contemporary audiences, showcasing an artistic style that spans the ages.
02
Clothing design inspiration:
Mom use to be a fasion designer and she made some small things using scraps of cloth she didn’t use at her hometown.
03
. Application of motion capture technology and animation production in UE5
Modeling Process
- Maya and ZBrush Character and Costume Design
- Marvelous Designer and Character Creator 4 Animation
- Motion Capture and iClone 6 UE5
- Scene building and rendering 01
MODELING PROCESS (wooden pillar)
MAYA
Zbrush
Substance Painter
Unreal Engine 5 1. Basic Modeling and Geometric Construction (Using Maya Initial Modeling: I started by creating the basic model of the Jangseung stone pillar in Maya, focusing on establishing accurate proportions and basic geometric structures Model Optimization: After completing the basic model, I optimized it to accommodate the subsequent sculpting and texturing processes.
2. High-Polygon Sculpting (Using ZBrush
Detail Sculpting: Next, I performed high-polygon sculpting of the stone pillar in ZBrush, adding natural stone textures and features like cracks and erosion marks Preparation for Export: After sculpting, I prepared the model for export to Substance Painter, including optimizing the polygon count.
3. UV Unwrapping and Optimization (Using Maya
UV Unwrapping: Before importing the model into Substance Painter, I brought it back to Maya for UV unwrapping. This step is crucial as it determines the layout and mapping of textures on the model UV Adjustment: I adjusted the UV layout based on the model's details and texturing needs to ensure even and distortion-free texture mapping on the model.
4. Texture Painting (Using Substance Painter
Texture Painting: Then, I imported the model with the unwrapped UVs into Substance Painter for texture painting and detailing Baking Texture Maps: After completing the texture painting, I baked various required maps in Substance Painter, such as diffuse maps, specular maps, and normal maps.
5. Importing into Unreal Engine
Preparation for UE5 Import: I exported the model and the baked texture maps from Substance Painter, ready for use in UE5 Importing into UE5: I imported the model and texture maps into UE5 and adjusted the material settings to ensure the model was displayed correctly in the engine Scene Setup and Display: Finally, in UE5, I set up the scene to showcase the completed Jangseung stone pillar model.
Through this workflow, I ensured that every step, from basic modeling to texture painting and final display, was meticulously handled. The UV unwrapping step, in particular, ensured correct and optimized texture display on the model.
06
MODELING PROCESS
Character Creator
Zbrush
Substance Painter
Marvelous Designer
Base Modeling in Character Creator: I begin by sculpting the basic form of the Indian princess using Character Creator, ensuring the proportions and facial features resonate with the intended ethnicity and character
Garment Crafting in Marvelous Designer: I design the
(Indian Princess)
body texture
Hanbok using Marvelous Designer, leveraging the Banarasi fabric's rich textures and patterns to emulate a traditional Korean silhouette blended with Indian aesthetics
Detail Enhancement in ZBrush: To add cultural
ornaments and refine the Banarasi fabric's intricate weave, I turn to ZBrush, where I sculpt the fine details, including the jewelry and fabric motifs that highlight the cross-cultural ensemble
Texturing in Substance Painter:
The model is then brought into Substance Painter, where I meticulously paint the textures, ensuring the Banarasi silk's luster and the vibrant colors are vividly represented, lending realism and depth to the character.
07 07
Clothing design attempts
(Character: Indian Princess)
Character Creator
Zbrush
Substance Painter
Marvelous Designer
Cloth Simulation Challenge: Significant
challenges were encountered when simulating the fabric of an Indian princess's complex costume in iClone. The larger panniers included in the design caused mold wear and fabric density issues during fabric simulation, making the clothes unable to maintain the expected shape during animation playback, affecting the overall visual effect.
solution: To address
these issues, measures were taken to remove the panniers from the design. Subsequently, the clothes and character models were merged to form a unified FBX file. This modification reduces the complexity of cloth simulation and makes the bone binding process in iClone smoother.
Trade-offs and impacts: The main tradeoff with this change is the sacrifice of some animation accuracy and detail. Since the clothing is integrated with the character model, some dynamic effects originally achieved through cloth simulation cannot be displayed, thus reducing the authenticity and dynamics of the character animation.
08
Clothing design attempts
Character Creator
Zbrush
Substance Painter
Marvelous Designer
Redesign of clothing patterns:
Representation of Cultural Significance
Fabric selection and application: In terms of
creative expression
After solving the bustle issue, I conducted an in-depth study and redesign of Indian princess costume patterns. The newly designed pattern not only retains traditional Indian elements, but also cleverly incorporates traditional Korean patterns. This cross-cultural design approach reflects the exchange and integration of different cultures.
material selection, I specifically chose gauze and silk as the main fabrics. The special texture and transparency of tulle add layering and lightness to the garment, while silk gives the skirt a smooth, flowing look and feel.
Cultural and historical background:
The origin and history of Indian women's headscarves are profound and rich in cultural significance. This turban, commonly known as a "Dupatta" or "Chunari", is an important part of traditional Indian attire and is often worn with a Sari or Salwar Kameez. The origin of the dupatta can be traced back to ancient Indian civilization. It was not only a practical garment used to cover the head and body, but also a way to express personal identity, social status and religious beliefs.
The newly designed patterns and choice of fabrics enhanced not only the visual appeal of the dress but also profoundly embodied the theme of cross-cultural communication. This combination of cultural elements, while preserving their traditional aesthetics, also showcased a new and unique
Reflection on the Creative Process
This adjustment process was not just a response to technical challenges but also an exploration of cultural elements and materials. This experience strengthened my understanding of the integration of cultural elements in costume design and enhanced my ability to innovate in the face of design challenges. Through this project, I gained a deeper appreciation of the importance of costumes in character creation in animation and how to convey broader cultural messages through details.
07 09
MODELING PROCESS
(Character: Korean knee)
Character Creator
Zbrush Second verson
Substance Painter
Marvelous Designer Creation Challenge: The most challenging aspect of creating the Korean king character was the traditional Korean attire's waistband. This required precise simulation of the natural form of the ties, involving multiple fabric calculations to adjust the placement and fluidity of the waistband
Solution Process: Through repeated adjustments of the ties' length, thickness, and fabric properties, I gradually achieved the desired realism and natural flow
Combining Technique and Creativity: This
process showcased my mastery of fabric simulation techniques, while also reflecting my creativity and artistic expression in traditional costume design
Project Reflection: This
experience enhanced my skills in complex fabric simulation and deepened my understanding of traditional culture and costume design.
10
Scene building in UE5
Scene building in Unreal Engine 5 (UE5) involves creating and assembling digital environments for various applications such as video games, film production, or virtual reality experiences.
Environment Layout: Start by setting up the basic layout of the scene, including the ground, sky, and any major landscape features like mountains, buildings, or streets Asset Importing and Placement: Import 3D models, textures, and other assets into the UE5 project. Place these assets strategically within the scene to build up the environment Lighting and Shadow: Set up lighting to create the desired atmosphere and mood. UE5's advanced lighting system allows for realistic lighting and shadow effects, enhancing the scene's realism Materials and Textures: Apply materials and textures to objects to give them realistic appearances. UE5's material editor allows for detailed customization, enabling the creation of surfaces that can react realistically to light Animation and Interactivity: Incorporate animations and interactive elements. This can range from simple animated objects to complex interactive systems depending on the project's requirements Environmental Effects: Add environmental effects like weather conditions, water bodies, and particle effects to enhance the scene's realism and immersion Optimization: Optimize the scene for performance, ensuring that it runs smoothly without compromising on visual quality. This includes managing asset resolutions, lightmap settings, and other performance-related adjustments Final Adjustments and Testing: Make final adjustments to the scene, test it thoroughly to ensure everything works as intended, and make any necessary refinements.
11
SCENE BUILDING
12
SCENE BUILDING
13
Modified tree distributionbands and colors
Because this level collapsedthere are no screenshots forsubsequent modifications
14
ANIMATION PRODUCTION
OptiTrack Motive
iClone 6
Unreal Engine 5
Live face
This section focuses on the animation of the Indian Princess and the Immortal Wooden Pillar characters, including challenges and solutions for motion capture, facial capture, and bone rigging.
1.OptiTrack Motive
OptiTrack Motive is an advanced motion capture (MoCap) software widely used to capture human and object movements and convert these movements into digital format. It is a key tool in animation, game development, film production, and virtual reality applications. Preparation Phase:Set up the camera and
2. iPad Live Link
Integrating iPad Live Link facial capture with iClone and Unreal Engine 5 (UE5) enables a seamless and dynamic process for creating highly realistic and expressive character animations. Facial Capture with iPad Live Link: Utilize an iPad with
ARKit-enabled software to capture the actor's facial expressions in real-time, accurately tracking detailed movements.
calibrate the system
3. iClone
In this project, iClone is pivotal for importing, rigging, and refining motion and facial capture data, ensuring seamless animation export for integration with Unreal Engine 5. Import and Setup: Start by
4.Retargeting
Combine character with motion skeleton
In my animation pro ect, I faced a critical task retargeting the animation of an Indian princess character, which I had created in iClone, onto another character in Unreal Engine 5 UE5 . ere are the steps I followed j
:
Preparing the Character Model
Exporting the Animation
importing the 3D character model into iClone. Set up the model by ensuring it's properly rigged and ready for animation.
I exported the animation of the Indian princess character from iClone, choosing the FBX format, ensuring it included both the animation and skeletal data.
Importing into UE5
In UE5, I imported this FBX file. his process involved reading the animation and skeletal information of the Indian princess character T
Import the motion data captured by tools like Opti rack otive or iPad ive ink into iClone. Apply this data to the character, focusing on accurately syncing body movements and facial expressions.
Skeleton Mapping
Next, I performed skeleton
T
Streaming and Applying to iClone: Directly stream the
facial data to iClone, where it's applied to a 3D character model, allowing for synchronization and refinement of the facial animations.
M
H
T
D
reflective markers and configuring props
)
I first ensured that the Indian princess character had a complete skeletal system in iClone. his is fundamental for retargeting, as the animation data needs to be attached to this skeleton
Applying Captured Motion ata:
Character and prop preparation: applying
(
mapping in UE5. his step involved mapping the skeletal data of the Indian princess to the skeleton of the target character in UE5. his is a crucial step as it ensures that the animation can adapt to the new character’s skeletal structure T
L
L
T
Animation Refinement: Utilize iClone's tools to
Executing Retargeting
refine the animations. his may include ad usting timing, smoothing out transitions, and adding additional layers of animation for more nuanced character movements. T
After completing the skeleton mapping, I used UE5’s animation retargeting tool to apply the Indian princess’s animation to the target character. his process re uired careful handling to ensure the natural transition of the animation
j
T
q
Record motion data: start capturing and realtime monitoring
Exporting from iClone: Once the facial animations are finalized in iClone, export the character model along with the animations in the FBX format, ensuring the preservation of rigging and animation data.
Importing into Unreal Engine 5: Import the FBX file into
UE5, making sure the character’s skeletal structure and animations are correctly configured within the engine.
Animation Adjustment and Optimization
Finally, I made some ad ustments and optimizations to the retargeted animation. As the target character’s proportions and sizes might differ from the original, I needed to make meticulous ad ustments to ensure that the animation looked natural and fluid on the new character. j
Exporting for UE5: Once the animation meets the
desired uality, export the character model and animations from iClone in a format compatible with Unreal Engine 5, typically FBX, ensuring all animation data is retained. q
j
hrough this process, I successfully applied the animation of the Indian princess character from iClone to another character in UE5. his not only demonstrated my technical capabilities but also my creative problemsolving approach. his experience is invaluable for my future work in the fields of animation production and game development. T
T
T
15
ANIMATION & RENDERING 2.Shader
1.Mixamo
Mixamo is an online animation and automatic bone
Maya
Photoshop
Marvelous Designer
Mixamo
3.Music
A shader is a computer program used in
The creation and application of music is a key
4.Composition
Animation compositing is the process of combining multiple visual elements (such
rigging tool that provides an extensive pre-made
3D graphics rendering that defines how
aspect in animation production, as music can
as character animations, backgrounds, special effects) and audio to create a
animation library and fast character rigging functions.
light interacts with surfaces in a scene.
enhance the emotional depth of a story and
complete, coordinated animation work.
Shaders are used to control various visual
immerse the audience.
Choosing Mixamo as the animation tool: To animate the longevity wooden pillars and the
effects, ranging from simple color and texture manipulations to complex lighting
y understanding and music design:
First, have an in-depth understanding of the story,
and shadow effects.
emotional direction and visual style of the animation.
uild and render animated scenes in
Unreal Engine 5, including character design,
environment settings and real-time rendering, and then export the rendered video files.
PR post-production:
Import video files into Adobe
Premiere Pro for editing, including adding special
effects, color correction and audio processing, and finally export them as completed animation works.
Based on these understandings, the basic style and
Korean King character, I chose Mixamo, an online platform that offers
Stor
UE5 rendering: B
Material Ball Design
emotional tonality of the music are designed to ensure
an extensive animation library and
Water Foam: Adjust transparency, reflectivity, texture
that the music can be closely integrated with the
automatic bone rigging capabilities.
Atmospheric Effects: Set scattering and absorption
content and atmosphere of the animation.
Mixamo makes animation more
properties.
efficient, especially for projects that require fast and high-quality animation.
Animation and customization: O
n the Mixamo
platform, I first performed bone rigging on each character. Then, choose from an extensive library of animations suitable for the Immortal Wooden
Pillar and Korean King.
Through fine-tuning and
zation, I ensured that these
customi
preset animations closely integrated
'
with the character s characteristics and story background.
VFX Particle System Application
Dynamic Water Foam: Focus on particle motion and collision response
Musi
computing resources.
a.
Realism and Efficiency: Balance visual effects with
c Production Process
Composition & Recording (FL Studio) Compose melodies, harmonies, rhythms Record tracks using synthesizers and music software.
b. Editing
& Mixing (FL Studio)
Adjust track tempo, volume, timbre Enhance sound quality with mixers and effects plugins.
c. Synchroni
zation & Adjustment (BandLab)
Collaborative feedback, real-time music
Technical Challenges
adjustment to fit animation
Realism vs. Performance: Optimize particle count and
Precisely match actions, transitions, and emotional climaxes.
material settings.
Learning and Growth Enhanced skills in creating complex effects in
Deepened understanding of light and material
UE5
interactions.
16
Cross-cultural dream weaver:
Indian princess’s Korean-style dress T
he Indian princess stood on the beach in Thailand, wearing an exquisite long dress. The delicate fabric pattern complemented the style of traditional Korean clothing. Her posture is elegant and her eyes are looking at the distant mountains, as if she is reminiscing about the mountains and rivers of her hometown or looking forward to the beginning of a new life. Surrounded by a tranquil seascape, an old boat lies quietly on the beach, while the blue sky and water echo the colors of her clothes, creating an artistic conception of cross-cultural blending.
Thailand's famous beach stones and caves blend in with their surroundings, creating a quiet and mysterious atmosphere. Next to it, towering coconut trees reveal the tropical scenery of the Indian coastline. Their postures are both elegant and highspirited. An abandoned ship lies quietly on the shore, and the mottled colors and textures on its hull tell its own story. In the distance, a princess is wearing a long dress with Korean and Chinese-style patterns. She seems to be meditating, maybe reminiscing, maybe looking forward to it. Every detail tells a story across time and space, making the image a cross-cultural journey.
18
渲染图高清
19
20
Final
Thank you all for your support. It is really not easy for one person to complete this animation in 3 months, because it is the first time to use many softwares. I have to learn and sell them now, and often stay up all night. As a third-year student with a double degree from Dongseo University Although I still have many regrets about my graduation project, I am still very satisfied. I hope that I can maintain my passion for creation in my future life.
