STUDIO AIR 2016, SEMESTER 2, ALEX & JULES YUCHENG YANG
SKETCHBOOK
C1 2
CONCEPTUALISATION
PRECEDENT
CONCEPTUALISATION 3
PRECEDENT
4
CONCEPTUALISATION
SOUND TOPOGRAP
PHIES
3D SOUND FORM SEQUENCES
THIS PROJECT IS FOCUSED AS THE SOURCES OF INTERACTION BETWEEN LIGHT AND SOUND, THE PROCESS IS A RESEARCH OF TRANSFORMATION OF THE PHYSICAL SOUND INTO DIFFERENT PHYSICAL MEDIUMS THROUGH DIGITAL DESIGN.
AN URBAN SOUND COLLAGE IS CREATED BY MIXING THE SOUNDS CAPTURED FROM THE CITY OF TEHRAN BY THE PARTICIPANTS. THE PHYSICAL SOUNDS ARE CONVERTED TO DIGITAL AUDIO FILES AND IMPORTED INTO 3-DIMENTIONAL DIGITAL DESIGN SOFTWARE.
CONCEPTUALISATION 5
A PROCESS OF DIGITAL FORM FINDING EVALUATED BY VARIOUS INFORMATION CONTAINED BY THE DIGITAL AUDIOS TO CREATE RESPONSIVE FORM OF SOUND.
A FUZZY FORM OF SOUND DEVELOPED AS PATTERNS ON THE SECTIONS, WHERE THESE PATTERNS RELATE AND ADAPT TO THE DIVERSITY OF THE INFORMATIONS CONTAINED
6
CONCEPTUALISATION
THE FORM CREATED BY THE SOUNDS ARE TRANSFORMED INTO SECTIONS IN TIME, WHERE THE RELATIONSHIP BETWEEN THE FORM AND THE LIGHT THROUGH THE SOUND CREATED A DYNAMIC ANIMATION.
CONCEPTUALISATION 7
PRECEDENT THE SCULPTURE IS RAGGED SOLID SURFACE THAT REACTS TO TOUCH USING INFRA RED SENSING TECHNOLOGY. THE SURFACE PROVIDES A VISUALLY GEOMETRIC MULTI-TOUCH AESTHETIC THAT IS ULTRA MODERN.
THE DEVICE WORKS WITH BOTH WEBCAMS AND PRESSURE POINTS TO FORM THE INTERACTIVE NATURE OF RIVIER’S PIECE. ACCORDING TO CREATIVE APPLICATIONS, WHEN THESE POINTS ARE STIMULATED, THE INFORMATION IS SENT TO A PROGRAM THAT “CALCULATES THE DATA FROM THE TOUCHED POINTS ON THE FORM IN 3D [WHICH IS] THEN TRANSPOSED ON THE FLAT FORM.” FASCINATING TECHNOLOGY ASIDE, IT IS CERTAIN THAT MATHIEU RIVIER’S WORK WITH INTERACTIVE ART IS GROUNDBREAKING AND SUPREMELY FASCINATING.
8
CONCEPTUALISATION
LIGHT FORM
CONCEPTUALISATION 9
WE WANT TO SERIES OF PANELS WITH THE SYSTEM GIVING BY MAPPING TEAMS, SHOW THESE DIFFERENT SYSTEMS RELATED TO THE SITE THOUGHT CONTROLLING THE LIGHT.
WHY PHYSICAL MODEL? THE PHYSICAL MODEL DEFINITELY IS THE MOST VISUALLY PLEASING COMPARED TO PHOTOS OR EVEN VIDEOS. THIS IS BECAUSE THE DIGITAL DEVICES CANNOT CAPTURE THE FULL BRIGHTNESS OF THE LIGHTS SO THEY LOOK SLIGHTLY MORE DULL ON SCREEN. IN REAL LIFE, THE LIGHTS ARE VERY BRIGHT IN A DARK ROOM AND IS DEFINITELY THE MOST ATTRACTIVE TO THE HUMAN EYE.
10
CONCEPTUALISATION
WE THINK SOUND TOPOGRAPHY PROJECT USING LIGHT TO SHOW THIS PROCESS AND VARIATIONS IS INTERESTING AND ATTRACTIVE.
WE LIKE HOW THIS LIGHT FORM TO DISPLAY THE TOPOGRAPHY OF THE SITE. USING SHAPE OF TRIANGLE CAN MORE CLEAR SHOWING THE VARIATION OF LANDFORM.
WE MAKE FOUR DIFFERENT SIZE OF TOPOGRAPHY LATER ON.
CONCEPTUALISATION 11
FIREFLY IS A SET OF COMPREHENSIVE SOFTWARE TOOLS DEDICATED TO BRIDGING THE GAP BETWEEN GRASSHOPPER - THE ARDUINO MICROCONTROLLER AND OTHER INPUT/ OUTPUT DEVICES LIKE WEB CAMS, MOBILE PHONES, GAME CONTROLLERS AND MORE. IT ALLOWS NEAR REAL-TIME DATA FLOW BETWEEN THE DIGITAL AND PHYSICAL WORLDS – ENABLING THE POSSIBILITY TO EXPLORE VIRTUAL AND PHYSICAL PROTOTYPES WITH UNPRECEDENTED FLUIDITY.
#INCLUDE <FIRMATA.H> BYTE ANALOGPIN; VOID ANALOGWRITECALLBACK(BYTE PIN, INT VALUE) { PINMODE(PIN, OUTPUT); ANALOGWRITE(PIN, VALUE); } VOID SETUP() { FIRMATA.SETFIRMWAREVERSION(FIRMATA_MAJOR_ VERSION, FIRMATA_MINOR_VERSION); FIRMATA.ATTACH(ANALOG_MESSAGE, ANALOGWRITECALLBACK); FIRMATA.BEGIN(); }
FIREFLY
VOID LOOP() { WHILE (FIRMATA.AVAILABLE()) { FIRMATA.PROCESSINPUT(); } FOR (ANALOGPIN = 0; ANALOGPIN < TOTAL_ ANALOG_PINS; ANALOGPIN++) { FIRMATA.SENDANALOG(ANALOGPIN, ANALOGREAD(ANALOGPIN)); } }
HOW TO SEND AND RECEIVE ANALOG MESSAGES USING FIRMATA 12
CONCEPTUALISATION
BEGIN(); //START THE LIBRARY BEGIN(LONG); //START THE LIBRARY AND OVERRIDE THE DEFAULT BAUD RATE BEGIN(STREAM &S); // START THE LIBRARY USING A [STREAM] (HTTP://WWW.ARDUINO.CC/EN/REFERENCE/STREAM) OTHER THAN SERIAL (EG SERIAL1 OR ETHERNETCLIENT) PRINTVERSION(); //SEND THE PROTOCOL VERSION TO THE HOST COMPUTER BLINKVERSION(): //BLINK THE PROTOCOL VERSION ON THE BUILD IN LED (TYPICALLY PIN 13) PRINTFIRMWAREVERSION(); //SEND THE FIRMWARE NAME AND VERSION TO THE HOST COMPUTER SETFIRMWAREVERSION(BYTE MAJOR, BYTE MINOR); // SET THE FIRMWARE NAME AND VERSION, USING THE SKETCH’S FILENAME, MINUS THE ‘.INO’ SETFIRMWARENAMEANDVERSION(CONST CHAR *NAME, BYTE MAJOR, BYTE MINOR); //SET BOTH THE NAME AND VERSION OF THE FIRMWARE
SENDANALOG(BYTE PIN, INT VALUE); // SEND AN ANALOG MESSAGE SENDDIGITALPORT(BYTE PORTNUMBER, INT PORTDATA); // SEND AN 8-BIT PORT IN A SINGLE DIGITAL MESSAGE SENDSTRING(CONST CHAR* STRING); //SEND A STRING TO THE HOST COMPUTER SENDSTRING(BYTE COMMAND, BYTE BYTEC, BYTE *BYTEV); //SEND A STRING TO THE HOST COMPUTER USING A CUSTOM COMMAND TYPE SENDSYSEX(BYTE COMMAND, BYTE BYTEC, BYTE* BYTEV); // SEND A COMMAND WITH AN ARBITRARY ARRAY OF BYTES WRITE(BYTE C); //WRITE A BYTE TO THE STREAM
AVAILABLE(); //CHECK TO SEE IF THERE ARE ANY INCOMING MESSAGES IN THE BUFFER PROCESSINPUT(); //PROCESS INCOMING MESSAGES FROM THE BUFFER, SENDING THE DATA TO ANY REGISTERED CALLBACK FUNCTIONS ATTACH(BYTE COMMAND, CALLBACKFUNCTION MYFUNCTION); //ATTACH A FUNCTION TO AN INCOMING MESSAGE TYPE DETACH(BYTE COMMAND); //DETACH A FUNCTION FROM AN INCOMING MESSAGE TYPE
METHOD
SENDING MESSAGES
RECEIVING MESSAGES
CONCEPTUALISATION 13
THE FIREFLY TOOLBAR FIG. 1 SHOWS THE FIREFLY TOOLBAR AS IT IS IN GRASSHOPPER.
FIG. 1 -FIREFLY TOOLBAR
FIREFLY ACTUALLY ADDS MORE FUNCTIONALITY TO GRASSHOPPER THAN JUST ARDUINO COMMUNICATION. AS SEEN IN FIG. 1, FIREFLY PROVIDES COMPONENTS TO INTERFACE WITH AUDIO INPUT, SEND AND RECEIVE DATA OVER A NETWORK,
FIREFLY
AND EVEN OPEN UP A WEBCAM FEED.
14
FIG. 2 -FIREFLY TOOLBAR
CONCEPTUALISATION
HOWEVER, THE COMPONENTS WE ARE CONCERNED ARE IN THE PANEL TO THE FAR LEFT (SHOWS IN FIG. 2). THESE ARE COMPONENTS SPECIFICALLY RELATED TO ARDUINO MICROCONTROLLER
DEPENDING ON THE MODEL OF ARDUINO BOARD THAT WE ARE USING, THE MOST IMPORTANT COMPONENT TO BECOME FAMILIAR WITH IS EITHER THE UNO OR MEGA COMPONENT ALONG WITH ITS TWO VARIATIONS: READ AND WRITE.
CONCEPTUALISATION 15
THE FUNCTIONALITY OF THE PHYSICAL ARDUINO BOARD (SPECIFIC PINS BEHAVING AS EITHER INPUTS OR OUTPUTS) IS VIRTUALLY REPRESENTED WITHIN FIREFLY AS TWO SEPARATE COMPONENTS (AS SHOWN IN FIG. 3 & FIG. 4).
THROUGH THIS SIMPLE BINARY IMPLEMENTATION, FIREFLY HAS ALREADY DESIGNATED WHICH PINS ON THE ARDUINO BOARD CAN BEHAVE AS INPUTS (THOSE ASSIGNED TO THE ‘READ’ COMPONENT) AND THOSE PINS WHICH CAN BEHAVE AS OUTPUTS (THOSE ASSIGNED TO THE ‘WRITE’ COMPONENT).
FIREFLY
IN THE ‘READ’ OBJECT, ALL SIX ANALOG PINS ARE AVAILABLE TO READ, WHICH MAKES PERFECT SENSE SINCE ANALOG PINS ARE MEANT FOR SENSING (MEASURING VOLTAGE) AND EVEN IN THE ARDUINO IDE VOLTAGE VALUES OTHER THAN HIGH OR LOW CANNOT ACTUALLY BE WRITTEN TO ANALOG PINS.
16
FIG. 3 -UNO READ COMPONENT
CONCEPTUALISATION
FIG. 4 -UNO WRITE COMPONENT
AT THE ‘WRITE” COMPONENT THE INCLUSION OF NINE DIGITAL PINS: DPIN3, DPIN5, DPIN6, DPIN8, DPIN9, DPIN10, DPIN11, DPIN12, AND DPIN13. DIGITAL PINS 2, 4, 7 ARE EXCLUDED FROM THE ‘WRITE’ COMPONENT BECAUSE THEY HAVE ALREADY BEEN DESIGNATED BY FIREFLY AS INPUTS (BY THEIR INCLUSION IN THE ‘READ’ COMPONENT). WHEN WIRING, WE HAVE TO NOTICE THAT DIGITAL PINS 0 AND 1 ARE RESERVED FOR SERIAL COMMUNICATION AND ARE NOT REPRESENTED IN EITHER THE ‘READ’ OR ‘WRITE’ COMPONENTS. FIG. 3 -UNO READ COMPONENT FIG. 4 -UNO WRITE COMPONENT
CONCEPTUALISATION 17
EADING & WRITING TO PINS WHILE THE ‘READ’ AND “WRITE’ COMPONENTS ARE CRITICAL TO INTERFACING WITH THE ARDUINO BOARD, IN TURN, THESE COMPONENTS DEPEND ON OTHER SMALLER COMPONENTS IN ORDER TO OPERATE PROPERLY. BEFORE ANY KIND OF COMMUNICATION CAN TAKE PLACE BETWEEN THE ARDUINO BOARD AND GRASSHOPPER , A SERIAL PORT MUST BE OPENED FOR THAT COMMUNICATION TO TAKE PLACE.
FIREFLY
FIG. 5 -OPEN PORT COMPONENT
18
WHEN DETERMINED THE CORRECT PORT NUMBER, HAVE ENTERED THAT NUMBER INTO THE “INTEGER” PARAMETER CONNECTED TO THE “OPEN PORT” COMPONENT, AND HAVE SET THE OPEN PROPERTY OF THAT COMPONENT TO TRUE, NOW IT IS READY TO BEGIN COMMUNICATING WITH THE ARDUINO BOARD. FOR EXAMPLE MY BOARD IS COM # 3
CONCEPTUALISATION
FIG. 6 -PORTS
S AVAILABLE COMPONENT
THE ‘OPEN PORT’ COMPONENT ESTABLISHES AND OPENS A PORT OVER WHICH COMMUNICATION WILL TAKE PLACE BETWEEN THE ARDUINO BOARD AND GRASSHOPPER.
OPEN ACCEPTS A “BOOLEAN” VALUE (TRUE OR FALSE) WHICH IS EASIEST TO INTERFACE WITH USING THE “BOOLEAN TOGGLE” PARAMETER WHILE PORT AND BAUD ACCEPT “INTEGER” PARAMETERS. THE SIGNIFICANCE OF EACH PARAMETER IS SELF EXPLANATORY: THE “BOOLEAN” OPENS AND CLOSES THE CONNECTION RESPECTIVELY, THE PORT “INTEGER” TELLS THE COMPONENT WHICH COMMUNICATION PORT THE ARDUINO BOARD IS ACTUALLY CONNECTED TO, AND THE BAUD “INTEGER” TELLS THE PORT AT WHAT TRANSMISSION SPEED TO OPERATE
CONCEPTUALISATION 19
MEGA READ IS BASCIALLY THE READING
FIREFLY
AT FIRST I NEED TO ASIGN A PORT TO DRIVER CHECK THE AVAILBLE PORT
20
CONCEPTUALISATION
TIMER IT IS QUITE IMPORTANT BE CAN READ DATA FROM ARDUINO TIME PERIOD ACCORING TO OUR
ECAUSE WE O BOARD EVERY R TIME SEETING
CONCEPTUALISATION 21
FIREFLY 22
CONCEPTUALISATION
THE DATA NEED TO BE REMAPPED SINCE THE RANGE OF DATA IS NOT ACCURATE
DATA ALSO SHOULD BE SMOOTHED SOMETIMES THE LED COULD BE GLITTERING SMOOTHING CAN LET IT MORE STABLE EASIER TO CONTROL LED LIGHTS
CONCEPTUALISATION 23
C3 24
CONCEPTUALISATION
FABRICATION
CONCEPTUALISATION 25
MODEL ASS
26
CONCEPTUALISATION
SEMBLING
CONCEPTUALISATION 27
FABRICATION
The initial model assembling process with metal rod It is very hard to insert the metal rod into the panels It is difficult to keep the same distance for each pan Difficult to adjust the positions of each panel.
THE SLOT FOR LED INSERT
28
CONCEPTUALISATION
N PROCESS
THE ETCH LINEWORK OF SITE MAP
Basically, four aluminum rods and two bases are the main structure of this model to hold and fix the 30 panels. We buy four aluminum rod at bunnings and run through the four corners in each panels. These panels are all have the holes in four corners which we designed in rhino and then laser cut. We found that it is difficult to move the panels in the rod and it is very unstable when we put all the panels on the rod. The distance of each panel is really hard to control , but we want to these panels have equal distance cause it should be fit with the distance of LED light lines so that the LED can illuminate the panel, to show what the panel have.
d. s. nel.
CONCEPTUALISATION 29
FABRICATION
PROS 1. It is easy to install and set up with timbwer stick. 2. The timber base is thick, stable and firm. 3. It is good at compression and strong enough to support the panels.
30
CONCEPTUALISATION
CONS heavy
1. It is hard and takes time to cut the slots manually. 2. It is hard to make it very accurate. 3. The 3mm with is not easy to control manually. 4. The material and coulor does not match panels as a whole.
N PROCESS Therefore, the problem is how to keep these panel with equal distance and stable them.
THE SLOT FOR INSERTING PANELS
At first, we chose to using wooden base like the fabrication prototype cause we think it is more thick and steady We want to make some slots that panel can be inserted. The width of panel is 3mm and we should exactly make 3mm width slots However, the process is quite hard and time consuming. We using milling machine to draw several slots and find the error is unavoidable. Then we used panels to test it, some of the slots can fit in but some are not. Moreover, it is really a slow process, only 5 slots using one hour. If we do all the 60 strips (30 each), it would be a process with couple of days. And also The wood base have the different color with the panel, so it is not looks perfect as a whole model. Therefore, we have to change our method.
CONCEPTUALISATION 31
FABRICATION SAME SPACING The idea is we make two base STRIPS to fix these 30 panels. Each bases has 30 slots which we cut by hand using machines to let every panel can perfectly joint together, therefore, the panel can be fixed. Expect wood base, this time we try the perspex. We found the varga saw, with the exact width of 3mm which is same with the width of the panel. And also the perspex is much easier to cut compared to the wood. Next, the problem is how to keep the 30 slots with equal distance. The distance should be according to the distance of every LED in the LED strip. We first draw the positions of each LED according to the strip on the perspex (There is a brown cover over the panel which we can draw the location), also we measure the distance between the LED which is 30mm. Therefore, a plastic with 30 labelled led location has been draw. As the right photo shows.
WHY THIS? 1. The same material with panels, which looks beautiful as a whole unity. 2. It is easy to cut and control manually compared to timber sticks.
32
CONCEPTUALISATION
N PROCESS
BASE CUT TING
CONCEPTUALISATION 33
BASE CUT TING
FABRICATION
SLOT MARK LINES
VARGA SAW MACHINE
34
CONCEPTUALISATION
N PROCESS
We then according to the location we draw to using varga saw to cut a slot. The process as shown in photo. All photos taken by yucheng and tenglei.
Left is the plastic base we cut. It is the same material with the panel so the model looks like more suitable. And we test it, every strip can perfect insert.
Then, we put base under the panel. Adjusting the panel and put them individually in their position and insert to the slot. When we finished, it is obviously more stable than before.
CONCEPTUALISATION 35
FABRICATIO BASE CUT TING
36
CONCEPTUALISATION
ON PROCESS FIANAL BASE
THE SLOT FOR INSERTING PANELS
CONCEPTUALISATION 37
FABRICATION
HOW TO MAKE IT STABLE ? 38
CONCEPTUALISATION
HOW TO MAKE IT STABLE ?
N PROCESS
CONCEPTUALISATION 39
FABRICATION
40
CONCEPTUALISATION
N PROCESS
PROS
1. The panels are installed correctly according to the LED strips. 2. The base is effectively and beautifully connected with the panels. 3. Good vidual effect. 4. LED illumination effect is good with etch line work. 5. LED slots fit very well.
CONS
1. The structure is not very stable because of lateral force. 2. Glue gun is not a very effective way to connect the base and panels. 3. Manuel base cutting takes time. It is better to use laser cut. 4. The base need to be improved. 5. Lateral bracing needed.
CONCEPTUALISATION 41
FUTURE PROPOSA
NEW BASE MOUNTING
OLD BASE MOUNTING
THE ORIGINAL BASE IS THIN AND NOT VERY HARD TO MOVE. THE NEW BASE IS DESIGNED BY THREE DOUBLE STRIPS STICKED TOGETHER AND PUT UNDER THE PANELS. SO THE PANELS ARE LIFTEED BY THOSE STRIPS WITH SLOTS. THE BASE STRIPS ARE CUT OUT BY LASER CUT MACHINE WHICH IS MORE ACCURATE THAN MANUAL CUT.
42
CONCEPTUALISATION
AL -- IMPROVEMENT
THE LATERAL BRACING ARE INSTALLED ON THE TOP SIDE POSITIONS TO GIVE A LATERAL SUPPORT. THUS THE STRUCTURE COULD STANDE STABLY AND FIRMLY WITHOUT SHAKING. THE FINAL FABRICATED MODEL FOR PRESENTATION IS NOT STABLE AND SHAKING AND HARD TO MOVE. IT IS HARD TO MOVE AND CARRY OWOING TO THE THIN BASE. HOWEVER, IT IS HARD TO MAKE A VERY THICK BASE BECAUSE IT MAY NOT FIT THE MODEL AS A WHOLE UNITY. THE LATERAL BRACING ADDED COULD MAKE IT STABLE AND DO NOT SHAKE ANY MORE AT LEAST.
NEW BASE MOUNTING WITH LATERAL BRACING
OLD BASE MOUNTING
CONCEPTUALISATION 43
FUTURE PROPO
44
CONCEPTUALISATION
OSAL -- MODEL
CONCEPTUALISATION 45
C4 46
CONCEPTUALISATION
GAME DAY
CONCEPTUALISATION 47
game day
48
CONCEPTUALISATION
y on site
CONCEPTUALISATION 49
game scre
First round play without any experience, just walking around and watch the growth of different systems.
Second round play, try to make Geemo (blackberry system) as much as possible, which is quickest spread and fastest aging.
50
CONCEPTUALISATION
eenshots
Third round play, all systems appear in this area on the phone screen.
Third round play, try to make Chemia (Stinkwort system) and Watercorp (Fennel system) as much as possible.
CONCEPTUALISATION 51
52
CONCEPTUALISATION
USING STRAVA TO RECORD OUR PATH OF PLAYING THE GAME. THERE ARE THREE ROUND SO WE RECORD THREE TIMES
CONCEPTUALISATION 53
When we were playing the game in Dight Falls, it feels quite different with the final presentation weâ&#x20AC;&#x2122;ve got in the classroom. Definitely, the crits should come along with us and play the game in Dight Falls to experience it. If we relate the game with our fabricated model, they are quite different. The two systems we selected spead and aging are very slow. That is the reason why we choose these two systems because every 40 frames we selected has subsequent and clear development in 30 panels. However, the other spawn and develop too fast to overlap and make panels are not very distinctive in every 40 frames. When we were playing the games, the Blackberry and Stinkwort systems develops and changes very fast which you can have clear response and visual variations on your phone screen, and see them almost everywhere. On the other hand, the Hawthorn and Fennel systems respond very slow and it is hard to find them unless you walk to specific area like riverside or human activity areas. The game help us understand more about the systems. But the way of presentation bwteen model and game are quite different. The model express less about the systems which is not as strong enough as the game communicate and interact with people. I think the LED illumination of the model is successful. However, it is undoubetly that it can be improved to engage more interactive elements.
54
CONCEPTUALISATION
FENNEL SYSTEM Longer span, large stress spread, spawns near water, clear variation, slowest growth
HAWTHORN SYSTEM Spawn close human activity, clear variation, less overlap, slow growth
CONCEPTUALISATION 55