Game changer

How Datasmith for Unreal Engine has put game engine-driven architectural visualisation within easier reach of boutique 3D studio Line Creative

In the past, it typically took the lenges for Line Creative, which set itself into Unreal, it was already 70% to 80% resources of a very large studio to the ambitious goal of achieving V-Ray or ready to go, with tasks like unwrapping deliver complex immersive render- Corona-like quality photorealistic still handled automatically. Once inside Unreal, ings that visualised built spaces. renders and animations using the tech- Sherf’s team could then tweak materials, But in North London, the small team at nology. “We found that to unwrap hun- lighting, shadows and more live, seeing boutique 3D studio Line Creative is dreds of objects and to reproduce all results in real time, instead of waiting for rewriting the rules, using technology materials and shaders in Unreal from render tests, the time-consuming process borrowed from the video game world. scratch was very time-consuming,” says to which they were accustomed.

At the heart of Line Creative’s new Sherf. “Trying to match the look and feel That freed up time to focus on “creative approach is Datasmith, a new toolkit for of the materials in V-Ray or Corona to scene design, testing and perfecting difreal-time, game-focused creation engine the real-time Unreal shaders was hard ferent elements until we achieved the Unreal Engine. Currently in beta, to achieve and proved to be a labour- desired look,” says Sherf. “Additionally, it Datasmith enables users to easily import intensive process.” was essential for us to have a photoreal and manipulate data and assets from over 20 CAD and DCC sources, including ‘‘ “By exporting the scene via Datasmith scene, and Unreal absolutely delivered.” His team were able to produce fine cine3ds max and Rhino. This enables architectural and design visualisation profesinto Unreal Engine, it was already 70% to 80% ready to go, with tasks like unwrapping matic shots and create the blueprint for an interactive section — all of which they sionals to use Unreal handled automatically were able to learn from Engine more efficiently. With five full-time people, Line Creative is always on the look-out for At that point, he says, the overall pro ’’ Unreal documentation and YouTube tutorials. Datasmith has proved an important tools to improve productivity, but while cess did not seem economically feasible – tool for architectural visualisation artists founder and creative head Eylon Sherf but that all changed when the Datasmith to jump over the “unwrap every object” was intrigued by the real-time visualisa- beta was announced at SIGGRAPH 2017. process and be able to get materials from tion capabilities of Unreal Engine, he was Sherf jumped at the opportunity. 3ds max straight into Unreal Engine – at first hesitant to invest time and money “Datasmith makes Unreal much more and to go from there to visually composin learning how to build materials and accessible by simply moving your scene ing and perfecting the scene, according to shaders from scratch for a whole new plat- into Unreal, as is,” he explains. Sherf. With the capabilities of Datasmith, form. Unreal Engine looked great for he reckons, the freedom that Unreal proarchitectural visualisation professionals, Test drive vides is a “game changer” for arch viz. he thought, but for those used to using Line Creative recently gave Datasmith a traditional AEC tools, the learning curve test drive on a kitchen design project for Line Creative’s video of the kitchen design creatseemed pretty steep. for an architectural client. Built in 3ds ed in Unreal Engine can be viewed at

Early experiments with Unreal max, the kitchen had over 400 objects. tinyurl.com/LC-kitchen Engine resulted in some workflow chal- By exporting the scene via Datasmith ■ line-creative.uk ■ unrealengine.com/beta

1

1 2 Stills from the interactive game engine experience, which allows viewers to navigate the kitchen freely and change materials on the fly 3 4 5 Stills from the cinematic animation, part of a packaged visualisation deliverable for the kitchen, which also includes a walk-through interactive game and virtual reality experience

AR: Vectorworks Nomad

Virtual Reality (VR) may be a hot technology in the AEC space, but Augmented Reality (AR) looks set to be just as big and, thanks to Apple, BIM users are starting to see useful applications hit the market

When Apple introduced its iPhone 8, 8 Plus and X models back in September 2017, the company’s brand-new Augmented Reality capabilities took centre-stage.

These are enabled by the combination of the A11 Bionic processor and the ARKit (Augmented Reality kit) development platform. First shown in June 2017, the ARKit enables developers to display dynamic, high-fidelity 3D models in the real world, viewable onscreen by mixing them with the live image from the camera lens of an iPhone or iPad.

Given the incredible popularity of Apple mobile devices, Augmented Reality (AR) is now within reach of millions of consumers and design professionals. In fact, it has kick-started a rush to develop AR applications.

If 2017 was the year that Virtual Reality (VR) become accessible, 2018 is surely going to see AR, or ‘Mixed Reality’, become a common tool in the building design market.

Vectorworks has been one of the first BIM developers to launch free AR capabilities. Included with Vectorworks Nomad, the company’s mobile viewing app, the new functionality enables the viewing of Vectorworks CAD/BIM models in situ through an Apple mobile device. This could include looking at a BIM model projected on a table top, for example, or the proposed layout of desks and chairs within an office at a scale of 1:1.

AEC Magazine caught up with Alex Nicol, mobile team manager at Vectorworks, in order to discuss the application’s capabilities and to get an idea of where the firm’s AR development is going.

According to Nicol, development of Vectorworks’ AR capability was fasttracked when Apple launched the development kit. Work started in late August 2017 and the product was released in midJanuary 2018.

In the first two weeks of release, over 200 users accessed the AR tools, launching over 1,000 sessions. From this, Vectorworks has already received a lot of positive feedback from users, together with a sizable wish list of suggested new features.

Getting to grips with Nomad To use the AR capabilities in Nomad, you will first need to be a Vectorworks customer, to generate BIM models and then have a Vectorworks cloud services account, which is free. Models will need to be uploaded to the cloud, where they will be processed and ‘thinned out’. This takes between one and three minutes, depending on size and complexity.

The Nomad app running on an iPhone or iPad then connects to the Vectorworks cloud and indexes the processed models, which can then be loaded.

Holding the iPhone at an open space, with a single tap, the Vectorworks model loads into the camera view. At the moment, Apple’s ARkit has the ability to find horizontal surfaces, such as floors or tables. If you want the model on a table top, the system recognises textured/patterned surfaces best and it helps if there is plenty of light.

Apple’s mobile advantage

The new Apple iPhones (8, 8 Plus and X) have a number of new processors with custom silicon to enable workstation-like performance in the palm of your hand. One is a new, highly efficient GPU processor, the A11 Bionic 64-bit processor, which has three cores and is comparable to processors from AMD, Nvidia and Intel. However, Apple not only develops the processor’s silicon but also the highly optimised Metal graphics language which runs on top of it. Metal uses a technique called Tile Based Deferred Rendering methodology, which splits the screen into multiple tiles for real-time analysis of what needs rendering. This in turn optimises GPU time, power and asynchronous operations, dramatically increasing rendering speed.

The A11 Bionic also features a dual-core ISP (Image Signal Processor) neural engine, capable of 600 billion operations per second and specifically tailored to match, analyse and calculate thousands of reference points from the live camera image. It also identifies objects and their position relative to a scene, for tracking and focus.

With so many GPUs and signal processors, all dynamically allocated, the new generation of iPhones is highly optimised for 3D AR experiences, be they for experiencing designs in the field or for gaming. So, while they may be expensive, what’s actually hidden inside that sleek form is the equivalent of a highly optimised, portable graphics workstation.

Hardware requirements The new Vectorworks Nomad AR mode works with Apple’s new iOS 11 operating system and devices that support the ARKit. Users must have one of these iOS devices to be able to run the AR viewer: • iPhone 6s and 6s Plus • iPhone 7 and 7 Plus • iPhone SE • iPad Pro 1st gen and 2nd gen (9.7, 10.5 or 12.9) • iPad (2017) • iPhone 8 and 8 Plus • iPhone X

Once placed, the model remains in place and can be scaled up or down, to appear on a table, or fill the entire room or site. As the user moves around the real-world space, the display updates the model in real time. The speed of the display is also based on the size and complexity of the model, which the user controls. Obviously, the lighter the model, the less processing is needed, so the smoother and quicker the AR rendered objects appear on screen.

Nicol explained that while VR has its uses, users need to factor in the additional cost of buying a dedicated headset, which may not be particularly portable. By contrast, Apple’s iPad and iPhone are pieces of kit that people often already have with them and don’t require any complex set-up, unlike many VR systems. (It’s worth noting here that Apple is allegedly developing an AR headset for 2019 and Nicol mused that, with AR glasses, users could search in context of their location and receive information related to the real-world objects that they view, on demand.)

However, it’s early days and there’s a lot of work to be done. Current limitations with version 1 of Apple’s ARkit mean that it can’t recognise vertical surfaces in a view. And because AR is very demanding on processors, it can’t be run on any iPhone or iPad that uses a processor lower than an A8. In fact, it really works best on an A9 processor.

Performance may also be impacted by what else the device is doing or what is running in the background but, at the moment, the developers don’t have much feedback on that issue. Also, the user experience may vary, depending on model complexity.

Hard-baked models Customers are keen to have more control of their models but for now, the models are hard-baked. In other words, you can’t just add a few additional chairs or objects within the AR experience.

Also, if you bring in a model that has multiple floors, it’s not possible to get off the ground floor or lower the model to match the real world. The good news is the next release of the ARkit, due imminently, will enable verticals to be identified, as well as assist in more accurate placement of models and hopefully the editing of planes. The updated kit will also support the recognition of images within a scene and Nicol reckons that Vectorworks can use this to identify origin points in the real world, to which AR models can map.

Of course, the mobile world comprises more than just the Apple product line-up. Vectorworks is also developing with Google’s ARcore platform, but this is more complicated than the Apple environment, because Android runs on phones from many different manufacturers, all built from different hardware components.

For now, then, ARcore only works on Google Pixel phones and a small range of Samsung handsets. Here, Apple has the advantage of designing most of the silicon, the graphics language and the bespoke accelerometers in its own phones. This will make development and compatibility testing much easier for software firms like Vectorworks.

The quality of the rendered images is not photorealistic but nicely flat-shaded. Colours come through from the Vectorworks model into AR and it supports textures. Nomad also supports models in white, which European users prefer. This will only improve as Apple develops its platform and Vectorworks continues to develop Nomad.

Conclusion The most impressive thing about Nomad’s AR capabilities is that they were developed and delivered in such a short timeframe. That’s especially true when you consider that most firms have been working on VR tools for years.

Nomad is simple to use and the results are impressive. One could argue that iPhones are very expensive, relatively speaking, but for those using the AR capabilities, one has to consider the sheer amount of processing available in such a small device. This comes at the cost. Nicol points out that a decent iPad Pro costs considerably less, has a bigger screen and can still run this augmented reality application.

While VR is exciting and certainly has its AEC uses, we believe that AR based on mobile technology will be the most common way of immersively interacting with BIM models, as every phone and tablet shipped from this point on will be a potential platform for an AR experience.

■ vectorworks.net

1 Nomad supports models in white and can also bring through colours from the Vectorworks model into AR 2 Visualising what an office layout, actual size, might look like in the context of a real office