Open-HAPPINESS Summary. noun 1. A new method of design by constructing direct connection between the device and human with machine learning and brain-computer interfaces techniques is explored. 2. A prototype of an interactive box that can learn to adjust its lightning environment according to people's emotional feedback with python is built.
Abstract. noun 1. With the development of machine learning and the brain-computer interfaces (BCI), the accuracy of emotion recognition utilizing electroencephalography (EEG) reaches a practical level. And training model make the algorithm pointing out the state of the subject in real time possible. 2. An open source, affordable, wireless bio-sensing headset—openBCI, is adopted, for the EEG detection, with the PYspace—a machine learning toolkit distinguishing the current state of the brain. The subject is required to stay in an interactive box with the headset on and watch a video containing one simple color. While the installation focusing on the response and influence of built environment toward people is limited, the motion and affection state of the subject is labeled. And with a random change to the luminance, the color temperature and the saturation of the video frame and supervise the machine to give the response to reach the preset state. After a long time collecting the data, the model figures out the sequence of events adjusted to people's general affection. We change the simple color into a mixed condition and add some texture in the picture and repeat the learning process. After a series of space operation like scaling, zooming, flashing, alternating, moving and rotating, the subject shows different feedback in mind. 3. Where after, the algorithm recombines the structure of the time series of the video to test the change of the subject’s mind. One subject should conduct the test repeatedly until an effective model is acquired for this person, and then subject could be change and the new model trained. The box finally earns the model to analyze the pattern of emotion fluctuation and the event series to reach the aimed emotion. After learning the method to interact, the box is upgraded physically for a better adjustment. This represents the design of the space is based on time series and the human emotion which also suggests the architects don’t have to design the space directly based on the indescribable professional experience but the machine learning can decide the elements of design in a concrete sense. 4. The interactive box shows a potential to skip over the will of designer, construct a bridge between the device and the human and seize the advantage of solving the complex case which needs oversize dataset and comprehensive operation. The aesthetic training for the human race is always criticized for the non-standard voice and the extensive and consistent feedback of space reduces the users decision-making power. But using just their mind to shape the space they use, participants receive the return of the power. Using machine learning in the physiological condition especially the emotion can be fairly demanding for the artificial architecture. 5. And what need to be further assessed is the reliability and validity. Some standard questionnaire should be a decent implement in test of this aspect, before a more precise conclusion could be drawn.
EEG. noun 1. Electroencephalography (EEG) is an electrophysiological monitoring method to record electrical activity of the brain. It is typically noninvasive, with the electrodes placed along the scalp, although invasive electrodes are sometimes used such as in electrocorticography. EEG measures voltage fluctuations resulting from ionic current within the neurons of the brain. 2. In clinical contexts, EEG refers to the recording of the brain's spontaneous electrical activity over a period of time, as recorded from multiple electrodes placed on the scalp. Diagnostic applications generally focus either on event-related potentials or on the spectral content of EEG. The former investigates potential fluctuations time locked to an event like stimulus onset or button press. The latter analyses the type of neural oscillations (popularly called "brain waves") that can be observed in EEG signals in the frequency domain.
The Open-HAPPINESS Project A responsive built environment adapts to emotional state captured with openBCI and supervised machine learning method.
1 Pict.1 the perspective image, with Luo Yueci and Wang Tianjun, by Xu Tongda
The Open-HAPPINESS Project A responsive built environment adapts to emotional state captured with openBCI and supervised machine learning method.
OpenBCI. noun OpenBCI is an open source brain-computer interface platform,[1] created by Joel Murphy and Conor Russomanno, after a successful Kickstarter campaign in late 2013. OpenBCI boards can be used to measure and record electrical activity produced by the brain (EEG), muscles (EMG), and heart (EKG), and is compatible with standard EEG electrodes. The OpenBCI boards can be used with the open source OpenBCI GUI, or they can be
1
2 3 4
Pict.1 the middle-size OpenBCI headset, by Xu Tongda Pict.2 the mech part holding Dry electrodes, by Xu Tongda Pict.3 the board cover, by Xu Tongda Pict.4 the 8-channels OpenBCI development board, Picture from OpenBCI.org
The Open-HAPPINESS Project A responsive built environment adapts to emotional state captured with openBCI and supervised machine learning method.
Machine Learning. noun
1
2
Within the field of data analytics, machine learning is a method used to devise complex models and algorithms that lend themselves to prediction; in commercial use, this is known as predictive analytics. These analytical models allow researchers, data scientists, engineers, and analysts to "produce reliable, repeatable decisions and results" and uncover "hidden insights" through learning from historical relationships and trends in the data.
3
4
5
Pict.1-4 the psychology experiments, by Yang Mingyan Pict.5 the prototype model and CAM layout, by Xu Tongda
Prototype. noun A prototype is an early sample, model, or release of a product built to test a concept or process or to act as a thing to be replicated or learned from. It is a term used in a variety of contexts, including semantics, design, electronics, and software programming. A prototype is generally used to evaluate a new design to enhance precision by system analysts and users. Prototyping serves to provide specifications for a real, working system rather than a theoretical one. In some design workflow models, creating a prototype (a process sometimes called materialization) is the step between the formalization and the evaluation of an idea.
The Open-HAPPINESS Project A responsive built environment adapts to emotional state captured with openBCI and supervised machine learning method.
1
2 3
Back-end. noun In software engineering, the terms front end and back end refers to the separation of concerns between the presentation layer (front end), and the data access layer (back end) of a piece of software, or the physical infrastructure or hardware. In the client–server model, the client is usually considered the front end and the server is usually considered the back end, even when some presentation work is actually done on the server.
Pict.1 the OpenHappiness EEG capture hat, 3D printed and assembled, by Zhang Luojia Pict.2 the backend, programmed with java in processing, with OpenBCI SDK, wekinator and Pixel Flow Lib, by Xu Tongda Pict.3 the special projector, with wide angel, by Xu Tongda
Responsive Architecture. noun 1. Responsive architecture is an evolving field of architectural practice and research. Responsive architectures are those that measure actual environmental conditions (via sensors) to enable buildings to adapt their form, shape, color or character responsively (via actuators). 2. Responsive architectures aim to refine and extend the discipline of architecture by improving the energy performance of buildings with responsive technologies (sensors / control systems / actuators) while also producing buildings that reflect the technological and cultural conditions of our time.
The Open-HAPPINESS Project A responsive built environment adapts to emotional state captured with openBCI and supervised machine learning method.