Talos Authoring Toolkit Š A natural language parser and a nonverbal behaviour rule-set could be used for deeper understanding and more accurate annotation of the input chunks
Virtual People Factory Web Service
Batch processing & Skeleton Mapping
Module 1: Field Tool
Video Editor & Annotation Tool
Automatic Gesticon creation Deeper Understanding
WWW
Actors Video DB
Annotate Chunks
Gesture DB
Manual Cleaning process
Video Production
Antelope API
Gesticon Matching
NVB annotator
Stanford Parser
Manual Annotation
Module 2: Dialogue Hubs
Network Communication
Sentence split, etc. The NVB takes one chunk at a time (e.g., the facing on the main gate)
Text Constructor
Text Preprocessing
A
Visually Organize Hubs (relationships, topics, etc)
Annotated navigation instructions
Navigation Nodes KB Editor Location Nodes
Annotated location descriptions
Question Nodes
B
Annotated Answers
Answer Nodes Network Communication
Module 3: Natural Language Processing
Non Verbal Behaviour rules
WWW
Stanford Parser
A
Speech Recognition
Annotated navigation instructions
Navigation Nodes
Antelope API B
KB Editor Speech Grammars
Annotated location descriptions
Location Nodes
Question Nodes
NLU Component
Shallow Parsing
Annotated Answers
Answer Nodes
Deep Syntax
Successful?
No No
Network Communication
Module 4: Input Modalities (Emotion & Face Detection)
Yes
Emotion Classifier
A
E.g., Shore/ eMotion, etc
E.g., OpenCV, etc
A
Face Detector Scripted Character Reactions
Emotion Nodes
Emotion Recognition
B Face Detection
Emotion Rules
Scripted Character Reactions
FaceDetection Nodes
B
Face Detection Rules
Define: Type of Emotion
Define: No. times rule applies
Define: Intensity
Define: Character Reaction
Define: Face Coordinates
A GPS Receiver
GPS-Enabled Navigation Nodes
Annotated navigation instructions B
KB Editor GPS-Enabled Location Nodes
Camera Stream
Define: Character Reaction
Encoding QR-Codes
QR-Codes
Annotated location descriptions
Location Nodes
Annotated location descriptions
Navigation Nodes
Annotated Navigation instructions
Decoding
GPSCoordinates DB
Geotagging of Locations/ Waypoints
Matching Network Communication
Module 5: Positioning Module(GPS Script Builder, QR-Codes Builder)
No
Yes
Network Communication
Module 6: Instruments Builder(Questionnaires, Tests)
Successful
Yes
Questionaire Creation
Questionnaire
Quest.\Tests Builder
Automatic Generation of Init. Data Test Creation
Test
B 2D Menu Constructor
Tag Extraction Script Parser
TimeSchedule
Script Rendering
Script Parser
I don’t understand
Case Frames
Successful? Dialogue Manager
B
Dialogue DB
Script DB
Audio File Creation with LipSync
Script Building
Scene Editor
More Instruments can be build within this module. For example, eye-tracking, video and timing, etc
A
B