Inside Qualcomm’s Snapdragon 865

We dive deep inside the capabilities of Qualcomm’s Snapdragon 865 and Snapdragon 765 processors. MARK HACHMAN reports

Qualcomm’s next-gen Snapdragon 865 smartphone chip will support 5G, certainly. But more practical features will probably affect phone users in more immediate ways, such as 200Mp still photos, 4K HDR/8K video capture with optional portrait mode and Dolby Vision support,

FEATURE

76 dynamic lighting options for mobile gaming, and real- time audio translation. Qualcomm unveiled the Snapdragon 855 a year ago, and unveiled its successors – the Snapdragon 865, the Snapdragon 765, and the Snapdragon 765G – in December at the company’s Snapdragon Technology Summit in Maui, Hawaii. Qualcomm dove deep into what phone makers and end users can expect from its new processors. Improvements to each of its cores – the new Kryo 585 CPU, the Adreno 650 GPU, the Spectra 480 image signal processor, the Sensing Hub, and the X55 5G modem – will all add new capabilities to phones.

Many of the most popular premium smartphones are built upon Snapdragon, including flagships from Google, Samsung and OnePlus.

What’s inside the Snapdragon 865 Below is a high-level overview of the Snapdragon 865, which will be manufactured on a 7nm process like its predecessor. (The 865 uses TSMC’s 7nm process, while the 765 is manufactured on Samsung’s 7nm process.) Some of the basics, such as the GPU speed, are still not being disclosed. We’ll go into more of what features these will enable afterward. Keep in mind, however, that some of these capabilities are theoretical. In the case of 5G, for example, certainly don’t expect the 7.5Gb/s download speeds Qualcomm is promising.

A-77 (2.4GHz, performance) + 4 ARM Cortex-A55 (1.8GHz efficiency) Memory support: Embedded LP-DDR5 (2,750MHz), LPDDR4x (2133MHz); up to 16GB Adreno 650 GPU: Displays up to 4K/60Hz, or 3,200x1,800/144Hz; HDR10+ support Spectra 480 ISP: 200Mp still photos; 4K video (with 64Mp stills) or 4K HDR or 4K/120; 8K capture; 720p at 960fps; Rec 2020, 10-bit colour Hexagon 698: Total Harmonic Distortion + Noise (THD+N) Playback: -108dB Connectivity (5G): X55 5G modem (7.5Gb/s down, 3Gb/s up, via 5G); mmWave (800MHz bandwidth, 2x2 MIMO), Sub-6GHz (200MHz bandwidth, 4x4 MIMO); LTE support (CBRS, WCDMA, HSPA, TD-SCDMA, CDMA 1x, EV-DO, GSM/EDGE)

FEATURE

78 Connectivity (Wi-Fi): FastConnect 6800 (802.11ax, 802.11ac Wave 2), 1.774Gb/s peak speeds,1024 QAM, OFDMA; 60GHz Wi-Fi, 10Gb/s peak speeds; always-on ambient Wi-Fi sensing Connectivity (Bluetooth): Bluetooth 5.1, with support for Qualcomm aptX specifications Qualcomm Sensing Hub: Always-on far-field detection and echo cancellation; support for multiple voice assistants Power: Quick Charge 4+ plus Quick Charge AI

Qualcomm is promising the Kryo 585 CPU will deliver more than 25 percent more performance than the processor inside the older Snapdragon 855, as well as 25 percent more power efficiency. The Kryo core uses what you might call a BIG-big-little architecture, with a upclocked ‘prime’ core, three ‘performance’ cores, and four ‘efficiency’ cores to handle low-power tasks.

Qualcomm says the Adreno 650 GPU will deliver 25 percent faster graphics rendering, with a 35 percent power savings over the Adreno 640. The latter figure is optimized for 90 frames per second, not 60. The Hexagon 698, the dedicated AI processor, will deliver 4 times the performance of the Hexagon 690, the first ‘retooling’ of the digital signal processor for AI.

5G While next-gen 5G technology was a controversial subject in 2019, it looks far more viable for 2020, as both carriers and chipmakers move toward the finish line. My colleague Mike Simon does a great job

breaking down what Qualcomm’s X55 modem means in the real world: in a nutshell, integrated LTE and 5G capabilities means that it will save power and switch faster between the two, both benefiting you. The X55 is a standalone chip, however, meaning that there’s still more room to save even more power in the future by combining it with some successor to the Snapdragon 865. For now, however, the fact that it’s a discrete chip means that it can be combined with multiple platforms. It also allows a company like Apple the freedom to buy (or make) its own 5G modem.

Qualcomm decided to make a strategic bet three years ago to keep the 5G modem separate, explained Cisco Cheng, a managing director at Qualcomm. “To pack the amount of gaming, camera, and AI features into the SOC while maintaining all of the awesome features, we have to keep the two separate,” he said.

Keith Kressin, senior vice president of product management for Qualcomm, said both mmWave and sub-6GHz frequencies need to be supported.

Qualcomm also expects the X55 platform to be faster than its predecessor, with up to 7.5Gb/s downloads. Again, you’ll never see those speeds in the real world, but in general more theoretical overhead

FEATURE

means more capability. Finally, there’s support for global multi-SIM, so if you have a 5G phone you’ll be able to roam worldwide with a second SIM, possibly to areas that might have pervasive 5G connectivity before the UK does.

AI Artificial intelligence (AI) is the other key linchpin of the Snapdragon 865, and like Intel’s own AI capabilities, it can be a little hard to define. Qualcomm’s touting its 5th-generation AI Engine as the, well, engine of all of this. It mainly consists of the company’s new Hexagon Tensor Accelerator and Sensing Hub.

The latter’s relatively simple to understand. One of the 855’s new features was dedicated lowpower logic to understand ‘wake words’ like “Hey, Google”. Inside the Snapdragon 865, the low-power

dedicated Sensing Hub does the same, as well as for other assistants. Real-time music identification is also supported, Ziad Asghar, Qualcomm’s vice president of AI strategy, said. There’s also some logic to support contextual AI, so a phone will ‘know’ what you’re talking about.

“We look at AI powering everything we do, and all of the products that we make,” Asghar said.

The Sensing Hub also adds to the traditional sensors (a gyrometer, accelerometer, even a barometer) with voice, data streams, and more, applying things like noise cancellation in real time to improve how it understands your voice.

In the 855, Qualcomm retooled the Hexagon DSP to be optimized for AI. The new Hexagon 698 within the Snapdragon 865 delivers 15 trillion operations per second, more than twice its predecessor, and with 35 percent less power. It’s the engine that SDKs like Qualcomm’s Neural Processing SDK will run on top of, to give app developers access to the AI smarts at the heart of the chip. Snap’s senior director of engineering, Yurii Monastyrshyn, appeared on stage to show that processing Snapchat via the Hexagon is 4 times faster than on the Kryo CPU.

This are two ‘one more thing’ features here: Google and Qualcomm are moving the Google Assistant automated speech recognition from the cloud to the Snapdragon 865 chip, with 30 percent less latency between your speech and a response. There’s a 3X power savings, too.

Qualcomm’s also claiming – and it showed off – the ability to make a phone call, and have your

FEATURE

Real-time translation on a phone call is a heck of a trick to pull off. The Snapdragon 865 can apparently do it, however

82 voice translated into another language, on the fly. Qualcomm’s even claiming that it can maintain the style of your voice, too.

Camera improvements A lot of people buy a phone specifically to take better pictures. For the past few years, Android phones have dominated our camera comparisons, but Apple’s latest iPhones have stolen some of that magic back in our latest smartphone camera shootout.

Qualcomm’s new Spectra ISP has been rearchitected to run much more efficiently. While the previous camera sensor was able to process one pixel per clock cycle, the current Spectra ISP processes four in the same time. Qualcomm didn’t actually announce the clock speed, but the sensor can process 2 gigapixels per second, according

Here’s all the camera improvements being added to the Qualcomm Snapdragon 865

to senior marketing manager PJ Jacobowitz. That simple efficiency helped spur several improvements, including the ability to simply slow down the core’s clock speed, saving power.

But there’s a number of tricks that Snapdragon 865-powered smartphone cameras will be able to do that current phones can’t.

First, the camera will be able to capture a whopping 200Mp still images, which apparently is not a hypothetical number – and it’s not two sensors working together in concert, either, Jacobowitz said. “We’ve been working with a major sensor provider to bring 200 megapixel images, image sensors, to smartphones,” he said. Even better, it should be in place by the end of spring, in 2020, he added.

Judd Heape, who runs the camera business at Qualcomm, said that Qualcomm can now use the

FEATURE

Post-shot bokeh additions sound super cool

84 entire image sensor to generate autofocus points, more than 9X what they had before. The HEIF file format that Qualcomm stores it photos in (introduced first within the 855) now saves the depth map, as well. What this means for you is that you’ll be able to add bokeh, also known as ‘portrait mode’, after you’ve taken the photo.

Morpho also appeared on stage to show of how semantic interpolation could use AI to add back detail that an image either lost or couldn’t capture. ArcSoft also used AI to smooth optical zoom, instead of jerky transitions from one level to another.

Next, the 865’s Spectra core will also be able to capture still photos more effectively while recording

video. Currently, Jacobowitz said, “snapping” a still image while recording video essentially just captures a frame: at 1080p, that’s about a 2Mp image. With the 865, the smartphone camera will be able to capture 64Mp still images while it’s recording 4K HDR video. Snapdragon 865-powered phones will also have the option of capturing 8K/30 video (without HDR), which requires the ability to capture 33Mp per second. “That’s significant, because there are a lot of phones on the market, even in the premium section, that their photos... aren’t even 33Mp,” Jacobowitz said. Then there’s a phone’s slo-mo capabilities, which will also be beefed up. Snapdragon 865-powered cameras will capture 4K video at 120 frames per second, for a ‘4X’ slow-motion option. At a more standard 720p resolution, the Spectra will go much, much further, capturing an amazing 960 frames per second, at what Jacobowitz called “indefinitely”, up to the limits of the available storage. (It does it natively, without frame interpolation, Heape said,) Conversely, if a camera has an advanced 120Hz display, the Spectra inside the Snapdragon 865 will be able to play that 4K video back at 120Hz, too.

Finally, Qualcomm’s Snapdragon 865 plans to increase its HDR capabilities one more time. After the 845 introduced HDR10 video capture and the 855 launched HDR10+, the Snapdragon 865 plans to be the first on the market to capture in Dolby Vision. Normally, this usually requires capturing raw video, which is then taken to Dolby’s labs and then processed, Jacobowitz said. The Snapdragon 865 will be able to do it natively.

FEATURE

Qualcomm introduced a ton of gaming features within the Snapdragon 865

Gaming Mobile gaming has eclipsed movies in terms of revenue, according to Leilani DeLeon, director of product gaming and AR at Qualcomm. Viewership of eSports has exceeded most professional sports leagues, she said.

The bulk of the Snapdragon 865’s gaming improvements will arrive through the 20 percent speed boost in the Adreno 650 GPU. But there’s also several areas that are a bit PC-like, including downloadable GPU driver updates.

Simply put, Qualcomm plans to decouple the Adreno drivers from the overall Android updates, and it will be up to the phone maker itself to validate the update and ship it to users. Qualcomm will write the drivers, Jacobowitz said, but each individual OEM

Game Smoother sounds very much like the desktop PC’s adaptive sync technology for GPUs

will qualify and distribute them. Put another way, you’ll receive an Asus-specific gaming update straight from Asus itself.

Qualcomm also launched Game Smoother and the Adaptive Performance Engine, both to enable mobile gaming as smooth as possible, which sounds a lot like Nvidia’s own adaptive sync technology, G-Sync. The company’s also working with developers to enable high frame rate gaming: 90 frames per second (and even 10-bit HDR) for PUBG mobile, and even with support for 144Hz screens, the same refresh rate as desktop displays.

Qualcomm is also adding support for Game Colour Plus version 2.0, which essentially brings HDR lighting effects into platforms that don’t natively support HDR displays – “not just jacking up saturation across the

FEATURE

‘Desktop-quality’ lighting on display using the Snapdragon 865

88 board, and contrast... but taking select parts of the game and making them look better,” Jacobowitz said. Adreno HDR Fast Blend will also accelerate HDR processing.

Even better, Qualcomm worked closely with Unreal and its Unreal 4 engine to bring what’s called the “desktop forward rendering” to the Snapdragon 865 platform. According to Jacobowitz, “many” of the lighting effects used in the Unreal 4 engine will be supported by the Snapdragon 865, allowing them to be used in games. Examples include desktop motion blur, planar reflections, multiple shadows, and more.

Security Jesse Seed, Qualcomm’s senior director of product, security, also explained that Qualcomm has added

Are digital driver’s licenses going to be a thing?

a protected data path for biometric authentication, protecting it from malware elsewhere in the system. It moves from the Spectra, to the Adreno, to the platform security module, and there to the Kryo CPU. The Secure Processing Unit introduced in the 855 is also in the 865, but with one additional feature: it can replace not only one but two SIM cards, or eSIMs.

Qualcomm also announced support for Identity Credential APIs, supported in Android R: that will allow electronic identification – even your driver’s license – supported in your phone.

Meet the Snapdragon 765G and 765, too There’s another gaming angle that Qualcomm is bringing to the Snapdragon platform, and that’s the Snapdragon 765G. It’s specifically designed for the

FEATURE

emerging market of gaming smartphones such as the Razer Phone 2, which is much more PUBG than Candy Crush.

Qualcomm built the 765G with a pumped-up Adreno GPU that increases performance by 20 percent over the base Snapdragon 765. It also adds 5.5 TOPS of AI performance, Qualcomm said. Both the Snapdragon 765 and 765G were designed as cheaper alternatives to the top-tier 865 chip, keeping the most important attributes – 5G and AI – while cutting a bit from some of the other elements.

The Snapdragon 765 and 765G share the same basic characteristics. Both are paired with the X52 modem, a 5G-capable discrete modem that’s ‘only’ capable of 3.6Gb/s download speeds and 1.6Gb/s up, with support for both mmWave and sub-6GHz

frequencies. Inside them, too, is Qualcomm’s 5th-gen AI engine.

In comparing the specifications of the 765 and 765G, we could only find only one significant difference: The 7nm octa-core Kryo 475 CPU at the heart of the 765 is clocked at 2.3GHz, while the 765G’s Kryo is clocked at 2.4GHz. (Remember, Qualcomm’s not disclosing the GPU clock speed.)

Kryo 475 CPU: Octa-core architecture, otherwise unknown Memory support: Up to 2,133MHz, 12GB total Adreno 620 GPU: Displays up to 3,200x1,800 (QHD+) at 60Hz; FHD+ (at least 1080p) at 120Hz; HDR10+ support Spectra 355 ISP: 192Mp still photos, 36Mp singlecamera with zero shutter lag; 4K HDR video capture; Rec 2020, 10-bit colour depth Hexagon Voice Assistant accelerator: Total Harmonic Distortion + Noise (THD+N) Playback: -108dB Connectivity (5G): X52 5G modem (3.7Gb/s down, 1.6Gb/s up, via 5G); mmWave (400MHz bandwidth, 2x2 MIMO), Sub-6GHz (100MHz bandwidth, 4x4 MIMO); LTE support (CBRS, WCDMA, HSPA, TD-SCDMA, CDMA 1x, EV-DO, GSM/EDGE) Connectivity (Wi-Fi): FastConnect 6200 (802.11ax-ready, 802.11ac Wave 2) Connectivity (Bluetooth): Bluetooth 5.0, with support for Qualcomm aptX specifications Qualcomm Sensing Hub: Always-on far-field detection and echo cancellation; support for multiple voice assistants

FEATURE

Power: Quick Charge 4+ plus Quick Charge AI

Qualcomm hasn’t disclosed its 6-series Snapdragon chips, which are designed for even more inexpensive devices. It’s the Snapdragon 865, 765, and 765G that you should care about, however, as they’ll be powering premium smartphones throughout 2020.