13 minute read
A chip that detects minute actions
Sensors
A chip that detects micro movements without a camera
Advertisement
Feature
GBO Correspondent
Innovation unlocks many new ways for companies to capture new markets, onboard new users, and in turn, improve their bottom lines. And this is why like every year, there was a usual fanfare at the Mobile World Congress event recently held in Barcelona which showcased path breaking innovations. A vivid example is a Metaverse, a whole new virtual world where things work beyond imagination. Apart from this, applications powered by AI (Artificial Intelligence), IoT (Internet of Things), and other emerging technologies surprise us at regular intervals and indicate a more tech-enabled future. In this line, Google has introduced a new technology that can read body language without needing any cameras, and it's called Google's Soli.
Essentially the chip is a purposebuilt chip that tracks body motion at a microscopic scale, with unmatched accuracy making use of a miniature radar to track the movement of the human body in real-time. The chip can track submillimeter motion, no matter how swift it is, with high precision. The size of the chip is just 8 x 10 mm, and it puts a sensor and antenna array together in a single device, which makes sure that this chip can be included in the smallest devices. Since it comprises no moving parts, the energy consumption of this chip is comparatively low. This aspect makes Google's Soli chip the most preferred choice for all upcoming flagship device makers.
Feature \ Sensor Chip
Intending to make a huge leap, Google’s ATAP (Advanced Technology and Products) division is working on a language to facilitate the interaction with the Soli sensor. The goal is to establish a universal set of gestures through which people will instruct their devices (running with a Soli sensor) to perform certain actions.
How Soli tracks movements
According to Google ATAP, the Soli sensor uses electromagnetic waves to identify movements. And whatever information the reflected signal provides like time delay and frequency fluctuations allows the sensor to understand what action needs to be taken.
The remarkable feature about the Soli sensor is, it can sense subtle changes in the received signal, which allows it to distinguish complicated finger movements easily. It understands the gestures by interpreting information in all possible ways, which makes it super precise.
Wearables and other likely applications Google’s Soli is garnering attention from the wider tech world because of its small size and
Sensors
efficiency. Wearables are the most natural choice to apply this technology because such devices usually have small displays, and that’s why technology like the Soli sensor is required to make them feature-rich more than ever.
Let’s take an example of the Apple Watch, which comes with a physical Digital Crown that allows users to interact with the watchOS interface in multiple ways. And Apple can take its game to the next level if it incorporates the Soli sensor into its smartwatch as it will eliminate the need for a digital crown, as users will just need to wave their fingers to get the desired task done.
For instance, they just move their fingers in the clockwise direction to increase the volume, imitate the action of pressing a button to turn on or off their Apple Watch. In
Ripple: An open-source API for Soli
Soli is a miniature radar that understands human motions at various scales: from heartbeats to finger movement gestures to running. To expand the usage of its Soli chips, Google is partnering with many companies across verticals like Ford and Blumio health to change how things are currently done like measuring blood pressure without touching the patient or providing assisted driving technologies. The concept of virtual tools is essential to Soli interactions. The gestures that mimic familiar interactions with physical tools are referred to as virtual tools. This metaphor makes soli interactions easier to communicate, learn, and remember.
Now in order to broad base the use of Soli chips and other similar radar technology, Google has launched Ripple, an open-source API for incorporating Soli chips to other devices in January 2022. Ripple will be accessible to the Consumer Technology Association (CTA) members which host the Consumer Electronics Show every year in Las Vegas.
Ripple participants include Google, Ford, blood pressure sensor maker Blumio, and vendors like Infineon, NXP, and Texas Instruments.
According to a Markets and Markets forecast, this motionsensing technology market will reach $20.64 billion by 2023 by registering a growth of 20% annually.
a nutshell, the sensor can enhance the user experience, make the product look futuristic and justify the premium price tag, and so on.
Applications in the market
The Soli sensor was introduced in the Pixel 4 smartphone. It took the smartphone industry by storm because the customers were able to perform gesture controls like waving hands to skip songs, put their phone on silent, snooze their alarm, etc. Google even announced that these capabilities are just a glimpse of what is coming its users' way. But Google didn’t launch the improved version of the Soli technology in the Pixel 5 series. Despite dropping the idea of using Soli in its smartphones, Google decided to use this technology in its other devices like Google Nest Hub with the objective of giving a whole new experience to its users. The radar sensors are embedded in the second generation of the Google Nest Hub smart display that detects body language and breathing patterns when anybody sleeps close to it. The remarkable fact is that this device observes the sleeping pattern without needing physical contact, unlike wearables.
What’s next for Soli
Other than its gesture-picking functions, Google wants this technology to have other game-changing applications, and that’s why it is using sensors in devices like desktops to recognize users’ everyday movements, to make new kinds of decisions rather than taking some gesture-based actions. This has the potential of revolutionizing everyday tech products. Some of the advanced applications in the pipeline are a thermostat that shares weather reminders or suggests the user take an umbrella before leaving the house, a TV that turns itself off automatically after detecting no movement from the user, a computer cleans the cache without needing a specific command using the keyboard.
Leonardo Giusti, head of design at ATAP, revealed that the major portion of the research revolves around proxemics. In a
Feature \ Sensor Chip
layman’s language, when we come in contact with another person, we expect certain things like engagement. Similarly, the ATAP team has used this concept to establish a connection between humans and devices.
The ATAP team has a vision where machines give immersive experiences to their users. For instance, whenever a computer detects the user is coming closer and entering its personal space, it takes the initiative to perform specific actions like turning on the screen without waiting for any button to be pressed.
But it is significant to understand that proximity alone won’t do the job because there will be scenarios when the machines will perform undesirable actions following proximity cues. This is where the Soli sensor comes into the picture because it closely monitors subtleties in the body movement to conclude. It tries to understand which path the user is going to take next, the direction of the head, among other fine details.
The origins of the chip
The ATAT team had pulled off such solutions after putting a dedicated team to perform a series of choreographed tasks in a living room, using multiple cameras to track movements.
Lauren Bedal, the senior interaction designer at ATAP, has a background in dancing, which is why she was able to explain how choreographers understood a basic movement idea and came up with more variations. She emphasized how it was crucial to observe a dancer managing their weight while changing their body position and orientation. Such studies helped the ATAP team to create a set of movements so that nonverbal communication could take place easily between humans and machines.
She did put some light on a few examples like a computer starts showing unread emails after sensing the user’s presence, pauses a video when no one is looking into the screen and resumes it after sensing the ideal face direction, suggests the user switch to the only-audio mode after sensing a lack of concentration during a video call.
How far is Soli from being a mainstay
After reading this far, it is natural to be curious about experiencing this technology, but it is not ready yet because some challenges are due to be addressed. For example, if multiple people are present in a room, it would be difficult for devices to decide which action they need to take. This is the prime reason why Bedal was putting stress while saying that this technology is still in the research phase, and there’s no point in launching it hastily, as it would end up ruining the user experience and drive unwanted backlash. It’s pretty much understandable because we will not be able to react calmly if our computer deletes an ultra-important file, takes illegal action on the internet, or does anything worse.
This is why the ATAP team has to take every small thing into account before launching this technology globally. The most important thing for them is to zero in on the timing because if a device reacts too early or late, users won’t get a pleasant experience.
Let’s say there is a TV equipped with a Soli sensor. And the user leaves their couch to get some snacks or due to some other reason in the meantime, the TV automatically turns off because it didn’t detect anybody in front of it. Should this be OK? No, of course not, because it would be frustrating to see the TV turning on and off after every few minutes. These kinds of problems are keeping the ATAP team busy in the study phase.
Apart from such complicated challenges, privacy is the major concern because people will hesitate to be present in front of their devices running on the sensor in fear of losing sensitive information.
All in all, we will have to wait a bit longer to see this technology running at its full potential. This technology is still in the research phase, and there’s no point in launching it hastily, as it would end up ruining the user experience and drive unwanted backlash. It’s pretty much understandable because we will not be able to react calmly if our computer deletes an ultra-important file, takes illegal action on the internet, or does anything worse.
Technology
Visa unveils Africa’s Ist innovation hub
Leading payments firm Visa has opened an innovation studio in Nairobi, Kenya, the first in the continent of Africa. The studio was inaugurated by the country’s Central Bank Governor Dr Patrick Njoroge. The innovation studio is poised to upgrade and innovate the banking system, and host an array of subject matter experts in finance and tech domains from across Sub-Saharan Africa. This hub will serve the entire sub-Saharan region and is Visa’s sixth such innovation hub after the likes of London, Dubai, and Singapore. The new center will work towards Visa’s goal of establishing its payments business and introducing newer products and services in the fintech segment. This development comes after Visa last year collaborated with Kenya's biggest telco firm
Twitter currently has 229 million daily users, but the social media giant has been overestimating its user base for three years in a row as it was counting multiple accounts used by the same person as different. Safaricom to permit M-Pesa's 24 million clients and 173,000 nearby traders to be connected to Visa's 61 million shippers and its multiple billion cards. Kenya’s central bank is insistent on launching a national payments strategy to increase inclusiveness and expand the scope of digital payment in the country. In Kenya, before Visa, Cisco and Philips had opened similar development studios. Safaricom to permit M-Pesa's 24 million clients and 173,000 nearby traders to be connected to Visa's 61 million shippers and its multiple billion cards
Twitter overestimates user base
This anomaly was overlooked by the company from Q1 2019 to Q4 2021. These revelations came in wake of the earnings report of Q1 2022. However, this was not the first time that the company was guilty of the same. In 2017 too, the company had overstated its user base by millions for three years by double-counting users who use the platform via third-party apps including its own Tweetdeck.
While this is a big embarrassment for the company listed on the Wall Street, the issue may be a non-matter soon. Once Elon Musk gets control of Twitter as a private company, it will no longer need to disclose its vital metrics to the wider world.
In line with this, the company said that they are not focusing on its previously stated goals. However, the company performed true to its own estimations despite the present global crisis triggered primarily by the Russia-Ukraine war. Both its revenue and operating losses were in line with its quarter-to-quarter guidance.
Microsoft to incubate 10,000 African startups
Leading IT player Microsoft has announced that they will accelerate the growth of 10,000 African startups and fast-track investment in Africa’s startup ecosystem for the period of next five years. As a part of Microsoft for Startups Founders Hub, members get access to tailored learning paths to fill in the gaps in your experience and help you get to the next stage, with learning modules on topics ranging from product naming to raising capital to technical how-to. The company said its Africa Transformation Office (ATO) will be the nodal point for this initiative. The Founders Hub is a self-service hub that provides startups with a wide range of resources, including access to mentors, skilling content, tools like Microsoft Azure and GitHub, and go-to-market and business support. Further, the company said that they are building partnerships with accelerators and incubators across Africa, including Grindstone, Greenhouse, FlapMax, and Seedstars to provide industrybased startups with access to markets, technical skills, and funding opportunities. These partnerships will provide African startups with access to skilling programs, access to markets, including opportunities to co-sell. The world’s richest man Elon Musk, who runs Tesla and SpaceX, has now successfully bought Twitter too. According to Twitter, they have entered into a definitive agreement to be acquired by an entity wholly owned by Elon Musk, for $54.20 per share in a transaction valued at approximately $44 billion. Upon completion of the transaction, Twitter will become a privately held company. This will mean that Twitter stockholders will receive $54.20 in cash for each share of Twitter common stock that they own upon closing of the proposed transaction. The purchase price represents a 38% premium to Twitter's closing stock price on April 1, 2022, which was the last trading day before Mr. Musk disclosed his approximately 9% stake in Twitter. The company said that the deal which has been unanimously approved by the Twitter Board of Directors is expected to close in 2022, subject to the approval of Twitter stockholders, the receipt of applicable regulatory approvals, and the satisfaction of other customary closing conditions. According to the announcement, Musk has secured $25.5 billion of fully committed debt and margin loan financing and is providing an approximately $21.0 billion equity commitment.
Mergers and Acquisitions
Elon Musk buys Twitter
