BREAKING NEWS Oroville man arrested for Sierra County shooting Full Story

How Alexa knows the difference between a breaking window and a wine glass

For Amazon, getting Alexa's new security-guard feature to work meant literally breaking a lot of windows....

Posted: Jan 15, 2019 3:47 PM
Updated: Jan 15, 2019 3:47 PM

For Amazon, getting Alexa's new security-guard feature to work meant literally breaking a lot of windows.

In December, the company started inviting Amazon Echo users to try out Alexa Guard, a new setting that turns the smart speakers into home security devices. It listens for suspicious sounds when you're away and sends a smartphone alert if it detects, say, a window breaking and a possible break in.

Alcoholic beverages

Amazon.com Inc

Artificial intelligence

Beverages

Business and industry sectors

Business, economy and trade

Companies

Computer science and information technology

Consumer products

Food and drink

Kinds of foods and beverages

Technology

Voice and virtual assistants

Wine

According to Prem Natarajan, vice president of Alexa's AI division, Amazon employees had to destroy different types of glass, such as window glass, wine glasses and drinking glasses, with tools like baseballs or hammers to train the technology.

Considering most of us have all kinds of glass things in our homes, it was important for Alexa to learn the difference between a cat knocking over a wine glass and a burglar smashing a living-room window.

"You don't want [Alexa] to respond to any glass breaking," Natarajan told CNN Business.

Machine learning -- a type of artificial intelligence that learns from data and improves over time -- underpins Alexa's ability to respond to a trigger word and command.

Alexa Guard is activated by the spoken command, "Alexa, I'm leaving," which is picked up by the Echo's built-in microphones. In addition to detecting broken glass, the feature lets the Echo keep an ear out for a smoke or carbon-monoxide detector blaring, and can turn on smart lights to make it look like someone is home.

Natarajan said Amazon first tried to train Alexa Guard to recognize window-smashing sounds with audio of glass breaking from movies. But that proved unsuccessful when the software was tasked with sorting through real-world sounds.

However, breaking real windows and dropping glass from different heights allowed Amazon to collect data that showed differences in acoustic characteristics for various objects and scenarios. This data was then used to train a machine-learning algorithm to recognize the right kind of noise.

Alexa Guard is a way for Amazon to differentiate Alexa from Google's Assistant, Apple's Siri, and others in the rapidly growing market for voice assistants. Plenty of home-security systems can detect breaking glass, but they typically require a separate sensor and may only work over a small area.

According to MIT spoken language systems group leader Jim Glass -- yes, that's his real last name -- Amazon should be able to train Alexa to recognize anything that average human can learn to discern with their ears.

"They can use it to try and pick up the sound of a breaking window; maybe they can train it to try and learn when your bathtub is overflowing," he suggested.

But perhaps the team will need to stock up on bathtubs first.

California Coronavirus Cases

Data is updated nightly.

Confirmed Cases: 271035

Reported Deaths: 6441
CountyConfirmedDeaths
Los Angeles1165703534
Riverside20555486
Orange17882366
San Diego16726387
San Bernardino15345269
Imperial7190117
Alameda6855140
Fresno611077
Santa Clara5408164
Kern536982
Tulare5009136
San Joaquin447455
Sacramento423669
San Francisco399250
Contra Costa387885
Ventura378950
San Mateo3599108
Santa Barbara326129
Marin280921
Kings267333
Stanislaus266045
Monterey215115
Solano147625
Sonoma135911
Merced127211
Placer91111
San Luis Obispo7652
Yolo67726
Madera5785
Santa Cruz4593
Napa4364
San Benito2732
Sutter2523
Lassen2420
El Dorado2260
Butte2063
Shasta1544
Humboldt1444
Nevada1291
Yuba1282
Glenn1220
Lake961
Tehama881
Mendocino850
Colusa700
Del Norte581
Calaveras530
Mono471
Tuolumne430
Amador330
Inyo331
Siskiyou320
Mariposa311
Plumas110
Alpine20
Trinity20
Sierra10
Unassigned00
Chico
Clear
73° wxIcon
Hi: 95° Lo: 64°
Feels Like: 73°
Oroville
Clear
76° wxIcon
Hi: 96° Lo: 63°
Feels Like: 76°
Paradise
Clear
73° wxIcon
Hi: 88° Lo: 65°
Feels Like: 73°
Chester
Clear
53° wxIcon
Hi: 79° Lo: 49°
Feels Like: 53°
Red Bluff
Clear
74° wxIcon
Hi: 97° Lo: 69°
Feels Like: 74°
Willows
Clear
73° wxIcon
Hi: 97° Lo: 64°
Feels Like: 73°
More heat and sunshine for our area today, and thankfully weaker wind for our dry region. The highs will get hotter, but the wind will also get stronger late in the forecast.
KHSL Severe
KHSL Radar
KHSL Temperatures

Community Events