• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer
  • Skip to navigation
Close Ad

The Spoon

Daily news and analysis about the food tech revolution

  • Home
  • Podcasts
  • Events
  • Newsletter
  • Connect
    • Custom Events
    • Slack
    • RSS
    • Send us a Tip
  • Advertise
  • Consulting
  • About
The Spoon
  • Home
  • Podcasts
  • Newsletter
  • Events
  • Advertise
  • About

Smart Home

June 26, 2017

The Battle For The ‘Kitchen Screen’ Has Just Begun. Here’s The Leading Contenders

Back in the year 2000, the world’s first Internet-connected refrigerator was introduced. Made by LG, the Digital DIOS came with a webcam, an Ethernet port and perhaps most importantly, an LCD touchscreen.

The fridge was one of the first examples of an appliance with a digital screen created specifically for the consumer kitchen, but with a $20 thousand price tag, consumers stayed away.  Today, nearly two decades after the introduction of the world’s first smart fridge, some of the world’s biggest consumer electronics companies are rushing to put screens back into the kitchen again.

Why now? There are a few reasons, but most come back to one simple truth: today’s kitchen is becoming the home’s central gathering place, where people not only come to make meals but also to hang out with friends, pay bills or do homework. In other words, the kitchen has become the modern home’s ‘everything room’, and unlike the family room where a TV or family computer often resides, there’s no defined product today in the kitchen that’s accepted as the go-to screen for family members to share information, manage home systems, keep tabs on things and communicate with one another.

Not that some companies aren’t trying. Here’s a look at the leading contenders:

Refrigerators

With ample flat surface space and usually centered in the middle of the kitchen, you can see why appliance makers see the fridge as the logical place to put a big digital screen. And unlike past efforts where companies would sometimes slap a screen on a fridge with limited functionality, today’s smart fridges have big, high-definition LED touch screens. The Samsung Family Hub’s screen is 21.5″, while LG’s Smart Instaview refrigerator has a huge 29″ screen.

Pros: The main advantage of having the refrigerator act as a family’s community screen is the simple fact the fridge has long served as the home’s de facto analog bulletin board, where families stick shopping lists, family pictures, and calendars. Given what seems a natural progression for the fridge to become the home’s digital command center, it’s no surprise companies have been pursuing the idea of the smart fridge for two decades.

Cons: The biggest challenge fridges face in becoming the main ‘family screen’ is simple: these are devices that are meant to stay in a house for ten years or more. This long lifespan is much different from traditional computing devices, such as mobile phones or tablets, which typically have much faster replacement cycles.  Consumers plopping down $2,500 for the latest fridge are going to want their new device to last for at least a decade, no matter how smart they are when they purchase them.

Smart Assistants

Though the Amazon Echo is only a couple years old, its success has create a whole new category of devices alternatively called ‘smart speakers’ or ‘virtual assistants’ (for our purposes I’ll call them ‘smart assistants’, since not all are speakers and the hardware part beyond the voice assistant is hardly virtual).

And now, the company’s new Echo Show represents an entirely new and exciting direction, with a 7″ touch screen and a new visual skill API that allows third party developers to create skills that leverage visual information such as live stream video from a networked camera or cooking videos from Twitch.

And let’s not forget HelloEgg, a smart assistant with an embedded visual display designed specifically for the kitchen created by a company called RND64 that is expected to ship this year.

Pros: Unlike a heavy appliance like a fridge, smart assistant products can be purchased and installed anywhere on a countertop.  In a way, they’re like a highly optimized tablet, but instead of being a personal computing device they’re created to act as a shared screen. In many ways, the Echo Show is Amazon’s concept of a kitchen computer.

Cons: The touchscreen enabled smart assistant category is just simply too new to know how well it will do with consumers. While the Amazon Echo and other smart assistant products are no doubt becoming popular, it’s just a little soon to see how popular smart assistants with touchscreen will be.

Kitchen Counters And Flat Surfaces

The concept of using the kitchen counter as a Minority Report like interactive touch screen has been bouncing around in future-forward design studios for much of the past decade and, in the past couple years, big kitchen electronics makers like Whirlpool have even toyed with the idea of the countertop touch screen.

IKEA Concept Kitchen 2025

Pros: First and foremost, the idea of your surface as interactive computing screen is just cool. It also offers an extremely flexible and dynamic format to display information and adjust to specific design needs of a kitchen.

Cons: While the idea has been floating around and touted by such big brands like Whirlpool and IKEA, a projected surface touchscreen has yet to roll out in any significant way in a mass market consumer product.

Kitchen-Centric PCs

For a hot moment back in 2008-9, some in the computer industry decided that since people spend lots of time in the kitchen, they should create a line of Kitchen PCs. The idea wasn’t altogether bad since, in some ways, was a predecessor concept to the Echo Show since these products centered around the early touchscreen Windows PCs. But not surprisingly, the late aughts “kitchen PC” movement fizzled out as quickly as it started.

Pros: The idea of a kitchen computer with a touchscreen is not a bad idea, and lots of people actually have their PCs in the kitchen.

Cons: These devices were just Windows PCs with touchscreens that were very much a product of 2009.

The Microwave Oven

The fridge isn’t the only device where a screen could reside. In fact, a decade ago appliance giant Whirlpool toyed around with the concept of putting a TV screen on a microwave oven. While they never rolled the product out to market, others have since toyed around with the idea.

Games Console Microwave

Pros: Some appliances, like the microwave, are nearly as prevalent as refrigerators. Chances are a touchscreen enabled microwave would likely be much less expensive than a smart fridge.

Cons: At this point, I know of no product company that is considering a smart microwave, perhaps because of the complications of sticking a flat screen computing device on the front of a microwave. Not to say someone couldn’t surprise me, but this one seems to be the domain of tinkerers and video-bloggers at this point.

Bottom line, we’re likely to see many more screens in the kitchen in coming years. Unlike the personal computing devices most of us carry in our pockets or backpacks, these “kitchen screen” will be tailored for shared use and act as a modern equivalent of family bulletin board/digital command center for the modern home.

The only open question is exactly which device will it be.

The Smart Kitchen Summit is around the corner. Get your ticket today before early bird ticket pricing before it expires to make sure you are the the one and only event focused on the future of food, cooking and the kitchen. 

June 19, 2017

Small but Powerful: Automating the Smart Kitchen with the Raspberry Pi

Ever since the first credit-card sized model was released in 2012, the Raspberry Pi line of sub-$100 Linux devices has defied all expectations. Its owners have chained the devices together to construct powerful supercomputers and used single devices to drive home automation and security systems. The Raspberry Pi is also a great way to inexpensively automate a smart kitchen, and there are easy-to-follow DIY recipes for doing so online.

First-generation Raspberry Pi devices were nowhere near as powerful and flexible as today’s models. The first generation had no Wi-Fi capabilities, minimal memory and a mid-range CPU. Fast-forward to today, though, and Raspberry Pi devices are as powerful and capable as many personal computers, but available at a fraction of the cost. Their low cost is partly due to the fact that these devices run free and open source Linux distributions instead of expensive, proprietary operating systems.

The Raspberry Pi community is waking up to the promise of artificial intelligence, as well, which holds promise for smart kitchens. Some Raspberry Pi owners are building their own AI-driven voice assistants, and Google has open sourced its AI-driven Google Assistant SDK, which can be used with Pi devices.

For several years now, Raspberry Pi community members have been publishing their DIY instructions for automating smart kitchen devices and processes. Many of these tutorials are available via video, and here are just a few examples:

Controlling kitchen lights with a mobile phone and the Pi:

Controlling kitchen lights with phone and Raspberry Pi Zero

Automating ambient lighting with the Pi:

Make your own Ambient Lighting with the Raspberry Pi Zero

Using a Raspberry Pi and touchscreen for an eye-level recipe manager

 

On the forums at RaspberryPi.org, you can inquire about the many other smart kitchen concepts that leverage these devices.

Meanwhile, if you want to dive deep into automating the smart kitchen with the Raspberry Pi, a guide called Smart Home Automation with Linux and Raspberry Pi is available. It details how to automate everything from curtains to music to lights working with a Pi device in conjunction with either a laptop or smartphone.

“Aside from the Arduino, the Raspberry Pi probably has the largest community for any single piece of hardware currently on the market,” notes author Steven Goodwin. “The cost of a Raspberry Pi means that it’s no longer unreasonable to have one (or two) computers in every room in the house…It is also worth considering that the Raspberry Pi is easier and cheaper to hack than any existing gadget off the shelf.”

Raspberry Pi devices are now essentially as powerful as fully stocked personal computers, but diminutive in size. One or several of them can give you flexible options for automating processes in your smart kitchen.

June 16, 2017

Why Synthetic Sensors Could Be The Future Of Smart Kitchen Monitoring

Will the smart kitchen of the future be stocked with arrays of distributed sensors or could a single suite of sensors, localized on a credit-card sized housing, plug into an outlet to imbue the kitchen with all the intelligence it needs? According to Carnegie Mellon researchers in the Future Interfaces Group, the latter concept is highly promising.

The Future Interfaces Group has developed a synthetic sensor-based device that can monitor multiple types of phenomena in a room, including sounds, vibration, light, heat, electromagnetic noise, and temperature. This device, featuring nine sensors, can determine whether a faucet’s left or right spigot is running, if the microwave door is open or how many paper towels have been dispensed.

“The idea is you can plug this in and immediately turn a room into a smart environment,” said Gierad Laput, a Ph.D. student in CMU’s Human-Computer Interaction Institute (HCII). “You don’t have to go out and buy expensive smart appliances, which probably can’t talk to each other anyway, or attach sensors to everything you want to monitor, which can be both hard to maintain and ugly. You just plug it into an outlet.”

Machine learning algorithms combine raw data feeds into powerful synthetic sensors that can identify a wide range of events and objects. For example, they can distinguish between a blender, coffee grinder, and mixer based on sounds and vibrations.

The CMU researchers discuss the technology in the following video and have been demonstrating it at recent conferences:

Synthetic Sensors: Towards General-Purpose Sensing

“Smart appliances are expensive and rarely talk to one another,” the researchers note. “We’ve explored an alternate, general purpose sensing approach where a single, highly capable sensor board can indirectly monitor an entire room. We started our research by taking an inventory of sensors used in commercial and academic systems. Our sensor board is plug-and-play, uses wall power and connects to our cloud over WiFi.”

CMU researchers are also expanding the types of data feeds that the sensors work with. For example, the sensors can infer human activity, such as when someone has left for work, and the sensors can be trained to recognize various phenomena, such as the cycling of heating and air conditioning units. In addition, the sensors can be trained to detect many popular devices and brands of kitchen products

Google, through the GIoTTo Expedition Project, has supported the CMU research, as has the David and Lucile Packard Foundation.  Google is also actively pursuing its Tensor Processing Units, or TPUs, which are similar in concept to the general purpose sensors from Carnegie Mellon.

The CMU sensing concepts are, of course, joining many other imaginative new ideas for sensors that could impact smart kitchens. For example, NeOse is a new device that connects to smartphones and databases and can recognize more than 50 types of odors. This smell-sensing device could detect when a food item is spoiled in a refrigerator, when food is being overcooked, and more.

Make sure to check out the Smart Kitchen Summit, the only event about the future of food, cooking, and the kitchen. Use the discount code SPOON to get 25% off of tickets. Also, make sure to subscribe to get The Spoon in your inbox. 

June 15, 2017

Smart Gardens Follow a Familiar Business Path

Entrepreneurs behind the recent raft of smart indoor gardens are following the digital commerce wisdom of those who understand the value of subscription-based businesses. The old, “buy the camera for cheap and we will sell you lots of film” concept has been successful for companies such as Keurig and Nespresso in maintaining multiple revenue streams.

Ava Byte, an Indiegogo project billed as “the world’s best automated smart garden,” may be the most trouble-free indoor growing appliance on the market. The Vancouver, B.C. startup has taken many of the features of its competitors such as Aerogarden and taken them to a new level. For example, the growing pods are soil free and include the necessary nutrients for optimal growth. The kit, with the standard smart garden goodies such as a base and grow light, also has an HD camera to monitor growing and sensors for precise watering. After getting Ava Bytes gardens into the hands of consumers, the company will be able to realize money from purchases of additional pods for about $6 per unit.

AVA Byte: World's Best Automated Indoor Smart Garden. Get #AVAByte Now at AVAgrows.com

Ava Byte also jumps on the voice-based smart home assistant bandwagon by being compatible with amazon’s Echo and Apple’s HomeKit. The company is led by Valerie Song and Chase Ando, a former chef, born out of Startup Weekend Vancouver 2015. Song was frustrated by her inability to keep plants alive in her sunlight-challenged apartment. She teamed up with engineers, designers and horticulturists to develop the smart garden that brings a bit of nature indoors.

Another difference between Ava Byte and others in the market is that it claims to be able to grow more than the usual herbs, lettuces, and small tomatoes. According to the company’s crowdfunding page, it can grow peppers, berries and mushrooms in addition to the standard fare.

The company has surpassed its $30,000 goal by 125% and expects to ship in March 2018.

The smart growing pods are an interesting component of the smart garden space. Even though Aerogarden pods are affordable, there are a number of hacks that show how to inexpensively make replacements pods. Using proprietary growing pods does offer the ability for smart garden companies to license their technology to third parties, but could be a turn off to the DIY crowd.

Going from super high-tech to cool low-tech, another crowdsourced entrant in the indoor garden space is from Urban Leaf and is billed as the world’s smallest garden. The product is a growing pod insert that slips into the neck of a bottle (green or brown preferred). First, the bottle is filled up to the neck with water and the insert is popped in. The pod is filled with additional water and then placed in a sunny spot. An interesting component of this option is that it reuses bottles you already have (wine, soda, etc.) and does not require investment in additional containers.

The company founders are Nathan Littlewood and Robert Elliott. Nate worked in the finance industry before leaving to become a chef and took cooking classes around the world. Rob is a PhD whose focus is on Vegetated Infrastructure. After meeting Nate in 2016, the pair began working on urban food growing systems.

Kickstarter - The World's Smallest Garden

Urban Leaf has an all or nothing goal of $40,000. As of June 14, with less than a week to go, the offering is a little under $7,000 short of reaching its goal.

Make sure to check out the Smart Kitchen Summit, the only event about the future of food, cooking, and the kitchen. Use the discount code SPOON to get 25% off of tickets. Also, make sure to subscribe to get The Spoon in your inbox. 

June 9, 2017

The Smart Home Weekly: HomeKit’s Big Week & The Debut of HomePod

Each week I look at the biggest story in smart home and give context to what’s happening in the connected home around the web.

This was the most important week for HomeKit since Apple announced it in June 2014.

That’s because, on Monday the company announced a host of critical updates to their smart home protocol and, just as importantly, launched their new wireless smart speaker/HomeKit hub, the HomePod.

Long rumored, the HomePod is what most of us thought it would be: a wireless speaker with built-in Siri. But with this announcement, Apple filled in many of the holes and showed us exactly how they plan to fight back against Amazon and Google in the digital home.

One thing is clear: Apple is leading with music, telling us that the HomePod will revolutionize home music. With HomePod and the launch of AirPlay 2 with multiroom audio, Apple is going directly after the Sonos consumer.  The device, which costs $349, is an impressive piece of hardware, with seven tweeters, six microphones for far-field listening and its own A8 processor.

It was also a big week for HomeKit. Apple’s long-gestating smart home protocol had its biggest week since it debuted at WWDC in 2014. And while the HomePod – a dedicated HomeKit hub – was the main attraction of the day, Apple made some important announcements about HomeKit itself:

Software authentication – At WWDC this week, Apple indicated they will now allow HomeKit hardware makers to create products without the dedicated chip. This is important because one of the reasons the slow rollout of HomeKit was the requirement of an MFI security chip in each HomeKit device. All that said, given Apple’s strong focus on security, there’s no doubt that the new software authentication will be very robust and HomeKit partners will have to work hard to get software-based authentication through the HomeKit certification process.

NFC and QR code pairing: Apple wants to make HomeKit set up experience easier. NFC and QR code pairing will go a long way towards doing just that.

HomeKit is opening up to anyone with developers license: Before this move, a company had to be a member of Apple’s MFI third party hardware program. Now, Apple is opening the doors to HomeKit to anyone who is an Apple developer. This will greatly increase the number of smart people innovating around the framework.

The Smart Home Show

This week’s episode of the Smart Home Show is all about Apple’s HomePod and HomeKit. Have a listen below:

New From Around The (Smart Home) Web:

Samsung Combo Wireless Mesh Router/SmartThings Hub Available for Pre-Order: Samsung put its mesh router/Smart Things hub up for preorder. The new Connect Home comes with a built in SmartThings hub with Z-Wave and Zigbee radios and built-in mesh Wi-Fi. At this point, the mesh Wi-Fi market is becoming crowded, but the combo of smart home hub and mesh is a nice differentiator for Samsung and makes them comparable in feature set to to the Almond 3 mesh router/smart home hub.

Unikey Gets More $: One of the original Bluetooth smart lock technology providers, Unikey, has received another round of funding, bringing in $5 million from two private equity firms, adding to other strategic investors such as Samsung Ventures. What’s interesting here is the company looks like they’re going to use the capital to expand further into the pro/commercial lock space and new markets like automotive. When I talked to Unikey CEO Phil Dumas on the very first Smart Home Show, he talked back then about possibly expansion into automotive.

Samsung Rumored To Be Working on Smart Speaker: Of course they are. In a way, the key battle in the digital home is not for the home router or set-top box, but now its for the interface, and it seems the smart speaker is becoming the default form factor and device to act as that key interface. Samsung’s version of a smart speaker will be powered by Bixby, the company’s voice assistant technology. Is this a good idea? In theory. I mean, it makes sense for a company like Samsung to create their own, but as always with Samsung and the connected home its about execution.

Make sure to check out the Smart Kitchen Summit, the only event about the future of food, cooking and the kitchen. Also, make sure to subscribe to get The Spoon in your inbox. 

June 6, 2017

Analysis: With HomePod, Apple May Finally Deliver On The Promise Of HomeKit

After months of rumors, Apple finally introduced a wireless streaming speaker called HomePod this week, their first new hardware product since the Apple Watch debuted in 2015.  The Siri-enabled wireless speaker also doubles as a HomeKit powered smart home hub, giving Apple a new fixed HomeKit control point beyond Apple TV. The HomePod will ship in December and is priced at $349.

There is a bunch to break down here, including the HomePod compares to Amazon’s Echo, but let’s first look at what exactly Apple introduced.

The Hardware

The new HomePod is an impressive piece of hardware. The HomePod includes Apple’s A8 chip, a system-on-chip CPU/GPU that debuted in 2014 with the iPhone 6. It has a six-microphone array with advanced echo cancellation, which Apple says will enable “Siri to understand people whether they are near the device or standing across the room, even while loud music is playing.”  The Siri-powered speaker also features seven beam-forming tweeters, each with an amplifier, and it also includes what Apple calls room-sensing technology that allows the device to optimize its sound based on the specific spatial characteristics of where music is being played.

During the event, Apple made a string of other important announcements that led up to the climactic debut of the HomePod:

AirPlay2

One of the most important foundational technology upgrades announced Monday was AirPlay 2, a much-needed update to Apple’s wireless streaming protocol. With Airplay 2 we finally get multiroom audio support, a huge upgrade that will allow homes with Apple’s HomePod – as well as products from partners like Bose, Bang & Olufsen, Marantz and others – to stream audio wirelessly to different rooms and to multiple speakers. The upgrade puts Apple’s streaming music framework on par with Google’s Chromecast for audio, which already supports multiroom audio.

Apple’s AirPlay 2 Early Partners. Image credit: The Verge

A notable absence from the list of initial partners was Sonos, a company that almost single-handedly created the wireless multiroom audio category.

HomeKit

The release of AirPlay 2 will not only bring multiroom audio support, but it also adds speakers to the list of devices controllable with Apple’s smart home protocol, HomeKit. By adding the speaker category to HomeKit, consumers will be able to control their wireless speakers through the iOS Home app.

The arrival of the HomePod also brings a second fixed smart home hub device into the lineup. Like Apple TV, the HomePod allows for remote access to any HomeKit compatible device through the Home app. However, with far-field listening capabilities and integrated Siri, the HomePod instantly surpasses Apple TV to become Apple’s most capable smart home hub.

What Does All This Mean?

The pricing, capabilities, industrial design and messaging gave us all we need to know to break down Apple’s strategy:

The HomePod Is, Above All, A Music Product: The HomePod is built to be a great wireless streaming speaker. With seven beam-forming tweeters – that’s one more sound driver than the Sonos Play 5 – it’s built to sound great. Sure, the HomePod has built-in Siri, but Apple messaged this as a revolutionary multi-room speaker first and a virtual assistant second.

This Is a Premium Product : The price of the HomePod, $349, may seem fairly affordable when compared to other Apple products, but at roughly double the price of the Amazon Echo and nearly triple that of Google Home, this is a much higher priced than other smart speakers.  It’s clear Apple has Sonos, probably moreso than Amazon or Google, in its crosshairs.

Apple Is Finally Bringing An Upgraded Siri Home: One of the messages from Apple this week is Siri has finally grown up. By adding anticipatory computer features, opening it up further to developers with a year two SiriKit and creating a Siri face for Apple Watch, the company finally feels they have a virtual assistant on par with Google Assistant. And now with HomePod, Apple has a true voice assistant to bring into the home.

Apple Vs. Amazon

Where does this position Apple relative to Amazon and the Echo?

I think given the premium pricing strategy, Apple appears to be ceding the fixed smart speaker mass market to Amazon. By choosing a music-first, premium approach, Apple appears content to let Amazon win the numbers battle with its lower-cost smart speaker.

However, letting Amazon blanket the mass market with $49 Echo Dots does not mean Apple is ceding the virtual assistant market to Amazon. In fact, if we learned anything this week it’s that Apple plans to leverage the hundreds of millions of Siri-powered iPhones, iPads and Apple Watchs in the market as it does battle with Alexa. .

And not only is Apple leading with iOS, but they plan to make it a much more rich and robust platform with new efforts like ARkit, their new augmented reality developer platform. Imagine pairing a well-done augmented reality app with a voice assistant capability in the home, and you might have something pretty cool.

Ok, so while it’s a bit of a risky strategy, it’s probably the right one for Apple. By ‘dancing with one who brought them’ in iOS and augmenting their home strategy with a premium-priced smart speaker/virtual assistant for the home with HomePod, Apple now at least has a strategy to do battle with Echo, even if their new smart speaker is priced out of reach for some consumers.

Lastly, let’s not forget that the HomePod with HomeKit is a true smart home hub, with all the built-in intelligence to make a powerful Apple-powered smart home come to life. While the Amazon Echo has done an good job integrating with hundreds of various smart home devices through its skill platform, it’s limited in its ability to execute on things such as scenes. With HomeKit and a new rev of the Home app for iOS, I think Apple may finally have what it needs with the HomeKit-HomePod combo to deliver on the early promise that had so many excited about HomeKit.

Make sure to subscribe to the Spoon newsletter to get it in your inbox. And don’t forget to check out Smart Kitchen Summit, the only event on the future of the food, cooking, and the kitchen. 

June 3, 2017

The WWDC 2017 Prediction Show (Smart Home Edition)

Are you ready for WWDC?

Apple’s big developer conference is just three days away, and so it’s time to make some predictions. I get together with my old friend Adam Justice from Connectsense to discuss what we can expect this coming Monday from Apple on the smart home front.

Topics discussed include:

  • We speculate whether Apple will release a Siri speaker
  • Possible features of a Siri speaker, such as camera, touchscreen, HomeKit capabilities and more
  • What’s in store for HomeKit
  • Ways in which Apple could improve the Home app
  • What to expect for Siri at WWDC

June 1, 2017

Is Nest’s New Face Recognition Cam A Sign It’s Waking From Its Slumber?

One of the great mysteries of the smart home world over the past few years has been the relative quiet of Nest, the one-time connected home star that burst onto the scene with the launch of its impressive Nest Learning Thermostat and, two years later, a smoke and carbon monoxide detector by the name of Nest Protect.

After Nest got acquired in early 2014, updates slowed to a crawl, and much of the news that did come out from the company during this time was bad. While there was occasional news about Works with Nest and Thread, you were just as likely to read about management dysfunction under Tony Fadell and product recalls. The only wholly new product line introduced into the Nest family during this time was the Nest Cam, a product that, in reality, owes more to Dropcam (another acquisition by Google) than to internal development from Nest.

But now there are indications the company might be waking up from its long slumber. In a recent story in The Verge, Nest product manager Maxine Verson hinted that the rest of 2017 should be busy for the company:

Verge writer Vlad Savov writes, “Veron tells me Nest’s relative silence in recent times is about to be a thing of the past. “I am very excited about the next six months,” he says with a grin, “we’ll talk again soon and you’ll understand why.”

Savov goes on the speculate that the next product might be a cheaper home thermostat. A welcome addition to be sure, but I think for those who witnessed Nest’s early days of innovation, a lower-cost version of an existing product is hardly something to get excited about.

The product I’m excited to see is Nest’s long-rumored home security system. My own sources have confirmed the existence of this long-gestating project and, given Google’s patent filings in the space, I think a Nest home security system could be truly differentiated. Add in the fact they just introduced a camera with facial recognition capabilities – an interesting potential component of a smart security system – and we may be getting close.

Another potential product is a video doorbell.  While the market is certainly crowded at this point, Nest’s brand name and recent development of a Pro group that supports home builders and integrators could help a Nest video doorbell get traction.

Whatever Nest does, chances are it’s been limited to a certain set of products by its parent company. Alphabet/Google has let non-Nest groups develop products in some of the most interesting areas – voice assistants and mesh Wi-Fi for example – while Nest has largely stuck with thermostats and cameras.

One thing is certain: the company’s new Nest Cam itself is a sign of progress. With it, the company has started to integrate image-based AI into its Nest cams, a potential indication that it – like Amazon – sees computer vision as one of the key new frontiers in the smart home.

And who knows? Maybe now – if the new camera and hints being dropped are any indication – maybe Nest truly has something new and interesting up its sleeves.

Make sure to subscribe to the Spoon newsletter to get it in your inbox. And don’t forget to check out Smart Kitchen Summit, the only event on the future of the food, cooking, and the kitchen. 

May 31, 2017

Rubin: Essential Home Will Be The “Bridge” Between Competing Smart Home Ecosystems

Last night Andy Rubin got on stage with Walt Mossberg at the Code Conference to discuss his new company.

The two spent a good chunk of the conversation talking about the Essential Phone, but when they finally got to the Essential Home, they didn’t disappoint.

I wrote yesterday about what we already knew about the Essential Home smart home product, but Andy’s discussion with Walt gave us a better understanding of the company’s strategy for the device.

Rubin and his team have (correctly) identified the main problem of the smart home as one of too many competing ecosystems. The main goal of the Essential Home is to solve for that.

Per Rubin: “One of the problems in the home is the UI problem. There are too many things you have to interact with in your home.”

While we often use that term UI to describe the various consumer interaction layers such as voice, touch or motion, Rubin is using the term more broadly here. He points to a fragmented smart home world with too many competing apps, smart home protocols, and technologies. And, as the guy behind Android, Rubin admitted that in many ways he helped create the problem.

“I feel somewhat responsible. One of things Android helped do make really easy to write a mobile app. the guy building your IoT doorbell, he’s going to write an app.”

According to Rubin, the problem with so many apps and technologies is each time a consumer walks through their smart home, they are walking through a series of competing apps and ecosystems.

“In certain ways,” said Rubin “the industry has recognized what the problem is, which is you don’t want to launch someone’s app when you walk up to your front door to unlock it, where they have their own UI, their own login credentials, and when you finally get through front door and its time to turn on your lights, do the same thing with the guy that built your light bulb.”

He’s right in saying the industry knows fragmentation is the main problem in consumer adoption. In our survey of over 100 smart home execs last December, the number one hurdle to adoption of smart home products identified by industry insiders is confusion over too many smart home platforms.

In other words, fragmentation. Or, as Rubin puts it, “a UI problem.”

Rubin said the solution to the problem of UI fragmentation is to bridge all of these competing ecosystems by working to integrate as many of them as possible together.

“You have to think of it as a UI problem,” said Rubin, “and you have to solve the UI for the home as an interoperability and integration issue. You can’t just support ten devices; you have to support one hundred thousand devices.”

That’s a lot of devices, but Rubin plans to get there by bridging the various ecosystems across the world of Apple, Amazon, Google and more. In other words, he doesn’t want to compete with the giants, but instead wants to connect them to one another.

“You can think of this as everyone is creating an island by creating their own ecosystem, so building bridges is the best way to describe what we’re doing. It has to talk to all these ecosystems, whether it’s Smart Things, HomeKit, or Google Home, or Thread or Weave.”

Rubin didn’t go into the specifics of how he plans to solve the fragmentation issue, other than to say they think they’ve found a way to do it. Whatever the approach is, it sounds like one built from the operating system on up with a focus on security.

“We had to build a new operating system so it can speak all those protocols and it can do it security and privately.”

That operating system is called Ambient OS. It will be part of the new Essential Home which is rumored to ship in late summer.

Make sure to subscribe to the Spoon newsletter to get it in your inbox. And don’t forget to check out Smart Kitchen Summit, the first and only event on the future of the connected kitchen and the future of cooking. 

May 30, 2017

First Look At Essential Home, An AI-Powered Smart Home Platform From Andy Rubin

Anyone who’s followed tech over the past decade knows what a huge role Andy Rubin has played in mobile computing. As one of the principals behind the Sidekick mobile device, co-creator of the Android operating system and the architect of Google’s mobile strategy, it’s not an exaggeration to say Rubin is one of a handful of people who helped shape the face of the modern technology landscape.

So when Rubin left Google in 2013, many of us were curious if he had another big idea. With such a prolific track record, there was a good chance he wouldn’t be content just sitting around. The company he founded next, Playground Global, seemed innocuous enough at first – a venture fund for hardware – but was just shrouded enough in mystery to make one wonder if Rubin and his high-powered team had a surprise up their sleeves.

It turns out they did. That something is Essential, a new hardware company whose first two products are a new phone (called, naturally, the Essential Phone) and smart home platform called Essential Home.

Unlike the Essential Phone, the specifics of the Essential Home are somewhat vague. However, the clues we do have are tantalizing and show promise.

Here are the highlights:

Heavy on Scenes & Context

According to the company, the Essential Home isn’t just another control point for your devices, but instead one that is an “orchestra conductor for your digital instruments – something that can get them to start to work together in new, exciting ways.”

This means that it will likely work to create scenes across devices instead of straightforward device automation. That’s great but not all that different than other smart home platforms out there. However, there looks to be a heavy dose of AI-powered contextual understanding weaved into these scenes:

Essential Home “can take note of your routines and let you know when something feels off or if a light is left on. You can ask Essential Home to play your favorite music and when you start a conversation it will adjust the volume downward so you don’t have to talk over it. When you’re getting ready in the morning, Essential Home can show how long you have until you need to leave and even blink the lights when it is time… The best part? I can ask Essential Home to do all of this without having to fumble with an app.” 

This is not surprising. The era of simply being a smart connector box is so 2014, and today a smart home hub needs to be a virtual assistant that learns from past user activity, understands the physical living space in which it resides, and leverage data streams coming from other devices to proactively provide contextual recommendations.

Of course, anyone who uses anticipatory computing services like Google Assistant knows this all sounds great but can be annoying in practice if not executed well or if they take too heavy a hand in performing an unapproved action, so I am very intrigued to see well this performs in practice.

Light on Clouds

Cloud integration has become a fast and easy way for different smart devices to integrate. Product platforms such as Alexa, Samsung smart home, and others utilize the cloud to integrate with other devices, a much easier route to market than device to device direct integration.

However, relying on the cloud to power your smart home comes with disadvantages, something to which anyone who has had a broadband outage can attest. There are also greater privacy and security risks through relying on cloud services to power your smart home.

“We’ve designed Essential Home to run most things on the device itself, so most data stays in your home where it belongs. Essential Home will directly talk to your devices over your in-home network whenever possible to limit sending data to the cloud.”

By focusing on device-to-device interaction and keeping user data local as much as possible, the company seems to be making consumer privacy and data security a point of differentiation.

The Ambient OS

The introduction to Essential Home makes a bold statement: “The Home Now Has an OS.”

That would sound a lot like marketing fluff were it not coming from the guy who brought us Android. In a blog post by Essential’s head of software development, we get a few details about what this means:

“Ambient OS provides a set of services and abstractions that enable the development and execution of applications that run in the context of your home. With Ambient OS, your home is the computer. Ambient OS is aware of the physical layout of your home, the people that live in it, services relevant to both your home and the people within, and devices.

Ambient OS is the API to your home that enables the creation of applications that extend the reach of a single device. For example, you can setup a timer and have the lights in the livingroom flash when it goes off. With the Ambient OS API, developers have access to available devices, services, and home information and can use these resources as the building blocks of their applications.”

Of course, the devil is in the details, but I like the sound of where they are headed. The approach sounds less heavy than HomeKit, but more deeply integrated than services like IFTTT.

Ultimately, I think success will depend on how easy on-boarding of new third-party hardware will be. If the company takes low-friction approach that Alexa did initially with its Skill platform, they’re likely on the right track.  If they require a business relationship with third party devices to enable interoperability a la HomeKit, chances are it won’t fly. My guess would be it’s more prior than the latter.

Lastly, no one’s really captured the “magic” of the smart home in a way that is enough to propel the overall concept to go mass market. Amazon’s Alexa is the closest we’ve had to a an “iPhone moment” with the smart home. While it’s too soon to say if the Essential Home Ambient OS is another transformative product for the smart home, it sounds like that’s what Rubin’s team is aiming for.

Device Design

Based on the description of the device, obvious interaction methods include voice and touch control. The device description says a “glance” is enough to trigger an action, which could also mean motion sensing or even machine vision (though it doesn’t look like the Home has a camera on the initial product images I’ve seen).

The actual hardware looks pleasing enough, with a circular touch screen display and small, modern form factor. It doesn’t look like it has much in the way of a speaker – though I could be wrong or the device could change as it moves toward production – so I don’t know if it’s much of an Echo competitor.

Pricing is also a mystery. While the Essential Phone is premium priced at $749 (it’s made of titanium, after all), I’m sure the Home will be more affordable. Andy Rubin is speaking at the Code conference today, so we’ll update this post with any further details.

Related: Rubin: Essential Home Will Be The “Bridge” Between Competing Smart Home Ecosystems

Make sure to subscribe to the Spoon newsletter to get it in your inbox. And don’t forget to check out Smart Kitchen Summit, the first and only event on the future of the connected kitchen and the future of cooking. 

May 16, 2017

As Others Play Voice Catch Up, Amazon Turns Sights To Computer Vision

As everyone from Microsoft to Apple rolls out first-generation voice assistants for the home, the reigning voice control champ Amazon has turned its attention to a new area within the smart home AI universe: computer vision.

For evidence of this focus, one needs to look no further than two new products introduced by Amazon in the past month. While both the Echo Look and Show have the same built-in voice assistant power of Alexa as their predecessors, there is one big difference: both new entrants have cameras. And while Amazon hasn’t come out and said these two new devices are the beginning of a new strategic front in the AI-powered smart home, an examination of these products’ capabilities, recent efforts to bolster the AWS AI lineup and recent statements by Amazon CEO Jeff Bezos help to connect all the dots.

Rekognizing A Pattern

So why the sudden interest in putting cameras in the home?  My guess is it’s in part due to what has been a growing emphasis over the past year by Amazon on its own computer vision powered AI capabilities.

That growing interest became more evident a year ago with the acquisition of Orbeus, the company which provided the foundation for Amazon’s current computer vision service from AWS, Rekognition. According to Richard Michael, former COO, Orbeus provided a “proprietary cloud based image analysis solution that makes sense of not just faces, but also scenes and objects”.

By last October, the company had relaunched the Rekognition service as part of its suite of AWS AI products. In a blog post, AWS Chief Evangelist Jeff Barr described how Rekognition could be used:

If you have a large collection of photos, you can tag and index them using Amazon Rekognition. Because Rekognition is a service, you can process millions of photos per day without having to worry about setting up, running, or scaling any infrastructure. You can implement visual search, tag-based browsing, and all sorts of interactive discovery models.

You can use Rekognition in several different authentication and security contexts. You can compare a face on a webcam to a badge photo before allowing an employee to enter a secure zone. You can perform visual surveillance, inspecting photos for objects or people of interest or concern.

You can build “smart” marketing billboards that collect demographic data about viewers.

While Amazon hasn’t come out and announced that Rekognition is being used to power the Echo Look, the company’s “fashion assistant,” the features of the Look tells me it most likely is. The device, which lets users take selfies and build a “style book” which the Look will then analyze to make recommendations, has a feature called Style Check:

Style Check keeps your look on point using advanced machine learning algorithms and advice from fashion specialists. Submit two photos for a second opinion on which outfit looks best on you based on fit, color, styling, and current trends. Over time, these decisions get smarter through your feedback and input from our team of experienced fashion specialists.

This is exactly what the Rekognition API does. By combining machine learning with computer vision, Rekognition is constantly learning, ultimately becoming better and better at analyzing images based on an ever-growing set of data based on those images. For the Echo Look, the end result is better recommendations. And while this is a fashion-centric use case that focused on color, style and fit, there’s no doubt that this technology can be used in a variety of use cases ranging of from home security to analyzing the contents of a refrigerator.

And what about the Echo Show? While Amazon doesn’t highlight the Show’s image recognition capabilities, my guess is that Amazon will give the Show Rekognition-powered computer vision over time to add enhanced functionality.

A “Horizontal Enabling Layer”

Recent comments from Amazon CEO Jeff Bezos helps one understand the company’s ongoing effort to push AI services beyond just Alexa. In a recent interview at the Internet Association gala, he shared his thoughts on AI (per GeekWire):

“Machine learning and AI is a horizontal enabling layer. It will empower and improve every business, every government organization, every philanthropy — basically, there’s no institution in the world that cannot be improved with machine learning. At Amazon, some of the things we’re doing are superficially obvious, and they’re interesting, and they’re cool. And you should pay attention. I’m thinking of things like Alexa and Echo, our voice assistant, I’m thinking about our autonomous Prime Air delivery drones. Those things use a tremendous amount of machine learning, machine vision systems, natural language understanding and a bunch of other techniques”.

“But those are kind of the showy ones. I would say, a lot of the value that we’re getting from machine learning is actually happening beneath the surface. It is things like improved search results. Improved product recommendations for customers. Improved forecasting for inventory management. Literally hundreds of other things beneath the surface.”

While Bezos points to the voice assistant tech in Alexa and Echo, he also gives a nod to machine vision. He describes all of these technologies as a “horizontal enabling layer.” What does he mean by this? In short, he is describing AI as a technology that is broadly applicable to almost every application, whether enterprise or consumer, and how the addition of which can add immense value to the end product.

With Alexa, Amazon was able to show, not tell, about that value of voice control. That is very powerful. I am sure they hope that, in a similar way, the Echo Look and Show can act as ambassadors for computer vision to the broader world. And while we may not witness the same kind of explosive adoption of Amazon powered computer vision AI as we did with Alexa,  in part because there are already a number of products that do basic image analysis using AI (such as Closeli) in the market, I do believe that Amazon can raise the awareness about how image recognition and detection AI enhance a variety of smart home and consumer use-cases.

Can Amazon Overcome The Creep Factor?

One last caveat: inward facing cameras in the home have plateaued in recent years, while outward facing security cameras like the Ring and Arlo have flown off shelves. The reason for this is people want to know what’s going on outside their home, but they don’t want people – including potential hackers – seeing what’s going on inside. With all the stories of security vulnerabilities, who can blame them?

While Amazon seems unbothered by this, it remains to be seen if their new interest in video AI will see any pushback from consumers.

Only time – and maybe Alexa – will tell.

May 9, 2017

Here’s Why The Echo Show Is Amazon’s Kitchen Computer

Two years after rumors first surfaced about a top secret Amazon project to develop a kitchen computer, today we may finally have a hint of what the company had in mind when rumors first surfaced in August 2015.

Not that Amazon is calling the Echo Show a kitchen computer since, after all, the new device can do a whole lot more. With a 7″ touch screen, full microphone array, a camera for machine vision and more, Amazon obviously sees this device as a video, voice and touch enabled Swiss Army knife for most any room in the home.

But let’s be honest, half of Echos ending up in the kitchen, and with the new features offered up by this new video-enabled Echo device, this is the most kitchen-friendly from Amazon yet.

Here’s why:

Video Skills: By adding a 7″ touchscreen and video-enabled skills, the Echo Show finally offers kitchen-centric content creators a medium to delivery visually rich content. The Food Network has already created an Alexa Skill to send recipes from your favorite cooking shows to the Amazon Echo, but I can pretty much guarantee they and other video-centric food content producers are chomping at the bit to create video-enabled skills.

All of which is good because…

Kitchen Use Cases Require Visual Communication: One could argue that outside of the entertainment area/living room, the kitchen is the most visual of all rooms. The combination of voice commands combined with visual display that can surface cooking videos, recipes, shopping lists, food inventories and so much more makes it a natural for the kitchen.

It Can Also See: Much like the Echo Look, the Show has a camera. While obviously for video communication, I also envision the camera being used to read bar or QR codes, identify products by sight, remote home monitoring and even enabling contextual recommendations based on whether its dad or daughter standing in front of it.

Video Communication And Monitoring: The kitchen is the central gathering place in the home, where family entertains, eats and just hangs out. With a built-in video intercom, this allows mom or dad to check in the kids while making dinner, see who is at the door, or even place a phone call to grandma using the built-in video intercom or calling technology.

Bottom line, while it isn’t just for the kitchen, I suspect the Show was made in large part with the kitchen in mind. And while I am not sure if the Show is what Amazon originally envisioned when it was dreaming of the kitchen computer back in 2015, I am pretty sure this is what the original project has become.

Stay tuned for more thoughts on the Echo Home….

Previous
Next

Primary Sidebar

Footer

  • About
  • Sponsor the Spoon
  • The Spoon Events
  • Spoon Plus

© 2016–2025 The Spoon. All rights reserved.

  • Facebook
  • Instagram
  • LinkedIn
  • RSS
  • Twitter
  • YouTube
 

Loading Comments...