Close Ad

The Spoon

Daily news and analysis about the food tech revolution

Alexa

“Alexa, How Can You Be Used in Restaurants?”

There’s a good chance that an Amazon Alexa or Google Home device is on a holiday wish list of someone you know. Consumer Intelligence Research Partners estimates that 15 million Amazon Echo units have been sold across the U.S. (Amazon does not disclose sales figures). As of now, Alexa’s use in dining out is centered more around at-home, consumer experiences. A quick glance through the restaurant related Alexa skills show an emphasis on discovery, information and ordering. Find a nearby restaurant. Order a pizza. Etc.

But is there a bigger opportunity for Alexa and Google Home inside the restaurant?

According to the National Restaurant Association, there are more than 1 million restaurant locations in the U.S. generating $799 billion in sales. One million on its own isn’t huge, but with some creative thinking, you could easily envision multiple devices deployed per restaurant, plus all the data captured from in-store interactions and you can see restaurants becoming a front in the voice assistant battle worth fighting over.

As a fun thought experiment, I put together a few potential uses for Alexa inside dining out:

An interactive table alert. Instead of a dumb, inert buzzer that flashes and vibrates when your table is ready, modify an Echo Dot to be the messenger. Instead of bugging the host, patrons could ask Alexa how much longer the wait time is, and be alerted when they can be seated. If you wanted to get real adventurous, in the right setting, you could even do ongoing interactive trivia games to keep people entertained.

Informed ordering. With its touch screen, an Echo Show would be an excellent way to show menu items, explain more about ingredients, and highlight popular dishes. You could also enable ordering and payment for a more streamlined experience. In a cruel, horrible world, one can imagine restaurants offer a cheaper meal if customers allow ads to be displayed while they’re eating (please don’t do that).

Back of house. Alexa could be used for quick ordering of ingredients, equipment or other sundries which, of course, could be fulfilled by Amazon that day. It could also be used to alert employees about their break times and inform them of any news or specials.

Communication back home. By gathering real time data inside a restaurant, Alexa at home could provide better, more informed real-time decisions about where and when to eat at a particular establishment.

Having said all this, there are some real world limitations to this type of implementation:

There’s a pretty small needle to thread in terms of the types of restaurant voice control will work. Too loud and voice control is useless and you can’t hear Alexa talk. Too quiet and voice control is annoying for everyone else.

It’s hard to imagine restaurants buying and modding Echo devices or writing their own skills. However companies such as Toast or Square could weave Alexa into their platforms and embed them on customized devices that are sold into restaurants.

We are still in the early stages of voice assistants and how far into our lives they will go. But as they get better, restaurant owners may not want to wait until the holidays to get their own.

Have you seen Alexa or Google Home used in interesting ways inside restaurants? Or have a wild idea about how they could? Leave a comment below and let us know what you think.

UK Grocery Chain Morrisons Adds Alexa Voice Shopping

While US grocers are worried about a future that includes direct competition from Amazon in the brick and mortar grocery business, grocery store chains in the UK are starting to partner up with the online retail giant to bring voice assisted shopping to their customers.

Today Morrisons, the United Kingdom’s fourth biggest grocery store chain, announced that their customers will soon be able to shop for groceries via Alexa, Amazon’s voice assistant. The company’s new Alexa skill will enable Morrisons consumers to add items to their cart via Alexa as well as check the status of their order or edit their basket.

Morrisons is the first brick and mortar grocer in the UK to add Alexa. In August, UK online grocer Ocado added an Alexa skill.

In the US, adoption of Alexa has been non-existent among big grocers. Online grocery delivery service Peapod has added an Alexa skill, but so far none of the big grocery store chains have created an Alexa skill. This isn’t surprising given Amazon’s designs on the grocery business. While Amazon has expanded Amazon Fresh to the UK, their grocery efforts in England are not nearly as far along as they are in the US.

As they say, it’s only a matter of time.

Is Amazon Considering Making A Smart Fridge? Probably Not (But Maybe)

Is Amazon working on a refrigerator?

Maybe.

Recent patent applications suggest the company is researching advanced refrigerator technology around spoilage detection while they also expand efforts to help you order groceries and have them delivered inside your home. Taken together with their investment in smart home tech and growing interest in the kitchen, one scenario could have the company creating a smart fridge.

Skeptical? You should be. It probably won’t happen. But there are signals it is at least a remote possibility, so let’s analyze them and speculate about the possibility of an Amazon Smart Fridge.

First the patent applications.

Amazon Files Fridge Patents

In September, Amazon filed two related patent applications that centered around spoiled food detection in refrigerators.  The first patent application, filed on September 14th of this year, is called “Image-Based Spoilage Sensing Refrigerator” and centers around utilizing internal cameras to detect spoiled food. The system would use both infrared and visible spectrum cameras to detect spoilage of food and then send an alert to a mobile device.

This patent application was designed to work in concert with a scent-based sensing system defined in another patent application (also filed on September 14th) called “Scent-Based Spoilage Sensing Refrigerator” that utilizes a variety of sensors to detect gasses emitted from spoiled food and then sends an alert to a mobile device.

Here is a mockup drawing of the fridge included in both of the patent applications that show where gas-based spoilage sensors would be placed in the fridge:

Both patent applications go into a lot of detail about how exactly the systems would work, but the essence of these concepts is that Amazon wants to put digital eyes and a nose into your refrigerator to automatically detect when food is spoiled and let you know.

As with any patent applications, you need to take them with a grain of salt. Amazon files a whole lot of patents these days and more often these do not turn into granted patents. But the very fact Amazon is researching spoilage detection is interesting in itself, even if it’s not enough.

Amazon Investment in Kitchen Commerce

For the last few years, Amazon has invested in kitchen replenishment and ordering platforms. First, there’s Amazon Dash Replenishment Service, the integrated automated ordering system that today is largely about replenishing non-spoilables like coffee filters or printer ink. However, there’s no reason why the same technology couldn’t work in a fridge.

Then there’s the Amazon Echo and Alexa. Over half of all Amazon Echos are ending up in the kitchen, and Amazon continues to build out the capabilities of their Alexa-powered voice assistants to act as virtual grocery shoppers.

We’ve also seen Amazon continuing to invest in their own mobile app to enable new commerce possibilities. Just this week the company announced it had added augmented reality capabilities to its mobile app. One could easily imagine the mobile app getting alerts from a smart fridge to tee up a new set of groceries.

Amazon’s Recipe-Driven Commerce Patent

Amazon’s fridge patent applications are no doubt intriguing, but things get even more interesting when considering Amazon IP such as its patent for recipe-driven commerce. Amazon was issued a patent in 2015 to enable for recipe-driven commerce that breaks down a recipe and inserts ingredients into a virtual shopping cart.

Here’s an image from the patent filing showing a recipe with a commerce/shopping cart component:

The patent application was originally filed in 2011, which shows you how long Amazon has been thinking about food and automated ordering.

Amazon Is Investing in Unattended Delivery

Last week, Amazon revealed Amazon Key, a new initiative centered around unattended delivery. The idea here is an Amazon delivery person would be able to enter your home to deliver a product while you aren’t there. The system utilizes an Amazon smart video doorbell and works with smart lock partners to enable access.

While Amazon Key could be used for pretty much anything Amazon delivers, unattended delivery makes lots of sense for groceries given fresh food needs to be put into a fridge at some point. Of course, an Amazon fridge isn’t necessary to make this all happen, but as long as Amazon is moving down the path of automated ordering, it could be one of many potential scenarios.

Amazon’s Partnership With Kenmore

A couple of months ago, Kenmore made news by announcing it would start selling its appliances via Amazon. It was a big deal since this was the first time in the brand’s century-plus history that it would sell outside of a Sears’ sales channel.

As I wrote here, the deal was a big win for Amazon, while Sears/Kenmore will also benefit from Amazon’s e-commerce capabilities. At the same time, Sears continues to struggle and, long-term, this deal could the first step towards new business models where Kenmore works with other players to help develop partner products. Who’s to say that at some point Amazon doesn’t consider working with Kenmore to make a refrigerator or – as they did with Whole Foods – just buy the company?

Amazon Loves Food

This one might seem obvious, but Amazon loves the food business. If the surprising acquisition of Whole Foods wasn’t enough to convince you, certainly their decade-long investment in grocery delivery, experimentation with new store formats, their drive-through pick up concept, Fresh subscriptions and various other initiatives are signs of how excited Amazon is about the food market. And why not? They know along with Walmart that food is the biggest portion of consumer wallet spend outside of housing and transportation (roughly 13% of consumer household budgets go towards food).

Much how Amazon eventually invested in hardware for entertainment because they saw a huge opportunity for new business models as the living room became digitized, who’s to say they won’t think the same thing about food as the kitchen goes through the same digital transformation?

The Fridge Is The Heart Of The Kitchen

In some ways, one could argue the fridge is the heart of the kitchen. Samsung certainly thinks so, doubling down on a strategy around their Family Hub refrigerator this year and likely continuing to bet on the smart fridge. Rumors have been floating for the last couple years that Amazon was making a kitchen computer – which eventually turned into was the Echo Show – but who’s to say Amazon wouldn’t just consider moving the technology for the Show into the fridge itself alongside all the other tech they are have developed for the kitchen?

All The Reasons They Won’t Make a Fridge

As I said, there are lots of reasons not to make a fridge. One is the company usually invests in smaller, low-cost hardware products in new categories. Another is there’s a good chance that if Amazon wanted inside our fridge, they would simply consider making a retrofit solution similar to the Smarter fridge cam.  And if they wanted to make a home storage device, why not just make a front-door locker system, something akin to an Amazon locker for the front door?

But still…

Conclusion: Gene Munster, My Apologies

The Amazon fridge question reminds me of a few years ago when folks speculated whether Apple would make a TV. One analyst in particular, Gene Munster, seemed to bet his whole career on the idea before eventually admitting he’d been wrong.

Part of the reason Munster speculated for years about an Apple TV was there were lots of signals.  Patent filings, investment in digital entertainment platforms and the recurring pattern of Apple coming up with a new hero consumer product every couple years fed into Munster’s thinking.

So, while I don’t intend to become the Gene Munster of the Amazon fridge and wage a multiyear speculation battle about why its the right thing to do, I figured I’d at least play Munster for a day and ask the question: will Amazon make a smart fridge?

Probably not.

Buy maybe.

Sonos gets Alexa (and soon Google and Siri)

If you’re like me, Amazon’s Echo plays a central role in your kitchen. Player of music, answerer of questions, setter of timers, forecaster of weather. The Echo is super convenient, but the sound quality is definitely lacking.

Since it was announced last year, I’ve eagerly anticipated the marriage of Alexa’s voice control with the room-filling sound of Sonos Play speakers. Today, Sonos announced that Alexa integration is finally here, along with a new Sonos One speaker with Alexa built in — as well as forthcoming Google Assistant and Siri support.

For existing Sonos and Alexa owners, the Amazon connected assistant is available via a Sonos app beta update available today. With it, you’ll be able to control your Sonos speakers with your voice via the Echo and Echo Dot.

With the Sonos One (available October 24), Sonos is vying to become Switzerland of connected home assistants. The $199 speaker sports Alex integration out of the box, with support for Google Assistant and Siri (via iOS) coming in 2018.

This is probably the best position for Sonos to take as it feels the squeeze between cumbersome traditional high-end audio and the more convenient but lower fidelity smart home devices like the Echo. The timing is good too, given that today Google unveiled its beefy Google Home Max smart speaker and the upcoming Apple Homepod bills itself as having superior audio. Being agnostic to your assistant ecosystem of choice could give Sonos an edge and a chance to regain some lustre.

We had three Sonos speakers in our house, and almost immediately stopped using all of them once we got an Amazon Echo. Despite having worse sound, the device was in the kitchen, so it was more convenient to where our family mostly congregates. It’s such a high-class problem, but after experiencing Alexa’s voice control, running to get my phone to control my speaker felt like so much… work.

But was we played more music in the kitchen — whether to cook to, do homework by, or just throw an impromptu dance party — sound quality became more important. My pre-Sonos One solution was to plug an Echo Dot into a Sonos Play:5, but that takes up a lot of counter space, has dangling cords and can make it harder for Alexa to hear my voice. With its smaller footprint and newer technology, the Sonos One becomes an interesting proposition.

The Kenmore-Amazon Deal Examined

Last week, Sears and Amazon announced a partnership that will bring the Kenmore brand of appliances to Amazon.com. The deal, which also brings Amazon’s smart home voice assistant Alexa to the Kenmore lineup of smart appliances, marks the first time in Kenmore’s hundred plus years the iconic appliance brand will sold through a non-Sears channel.

The reaction to this deal was mixed. Wall Street loved the idea of Kenmore tapping into Amazon’s retail savvy and Alexa platform, while others saw the deal as something of a white flag for Sears.

The reality is this deal has many net positives – and a few downsides – for both. Let’s break it down for each side:

Sears/Kenmore

Sears’ struggles over the past few years are no secret, and with more stores closing every year, it’s no surprise that Kenmore’s market share has also been shrinking. By virtue of its up-to-now exclusivity with Sears, the appliance brand has simply been in less storefronts every year, which has meant less opportunity to capture the consumer dollar..

Sears stores 2010-2016. Source: Business Insider

The Kenmore brand has also lost some luster over the past decade, as Gen-Xers and Millennials have looked at new entrants into the appliance market such as Samsung and LG. The brand is, in many ways,  mom and dad’s (or grandma and grandpa’s) appliance brand, so the addition of Alexa smarts could give the brand a well-needed upgrade.

The deal also allows Sears to keep its most popular remaining brand. Last year, the company sold the Craftsman brand to Black & Decker, which gave the company a liquidity lifeline, but also meant it was beginning to cut into bone as it struggled to turn itself around.

Long term, however, the deal still doesn’t seem to change the long-term trajectory for Sears. The company’s existing retail format is expensive and outdated and this does nothing to change that. If anything, it could mean less sales of Kenmore appliances in Sears storefronts as more are sold online through Amazon, which could accelerate store closures long term.

Amazon

The deal for Amazon is almost (but not entirely) net-positive. Not only do they get a semi-exclusive distribution deal as the Kenmore brand’s only non-Sears sales channel, but it also likely locks the Alexa platform in as Kenmore’s primary voice interface.

Long term, it also makes Amazon a bigger player in white goods and appliances. While it’s unclear if Amazon would launch their own brand of appliances – my gut tells me they probably wouldn’t – you can never rule anything out with Amazon.

The biggest downside for Amazon? How this deal could benefit other voice assistant and smart home platforms.

Think about it: For other Amazon appliance partners, the deal probably is a bit of an annoyance. After making much of their CES this year about Alexa integration, Whirlpool probably can’t help but be a little annoyed with this deal. This deal will reinforce the reality that while an Amazon Alexa integration is necessary, it would be wise to not put all your eggs in the Alexa basket.

The deal could also have an upside for Google and Apple. While many appliance companies have already done Nest integrations and have been working on Google Assistant integration, this deal will likely push them to push down on the gas pedal. For Apple, who has been moving fairly slowly with HomeKit and Siri integration, this could serve as an opportunity to evangelize their platforms in the face of growing dominance of Alexa’s voice assistant in the smart home.

If you want to hear the head of Kenmore innovation, Chris McGugan, talk about this deal, make sure to not to miss the Smart Kitchen Summit. Just use the discount code SPOON to get 25% off of tickets. 

I Made Dinner With An Amazon Meal Kit. Here’s My Review

Amazon can be kinda cruel.

Think about it: Blue Apron, arguably the biggest name in meal kit delivery, works for years to create a new way for consumers to make dinner, eventually becoming the most successful meal kit company in a crowded field and, just after they have an initial public offering to pay back investors and employees for all their hard work, Amazon waltzes in with a meal kit service of their own the same exact month to send Blue Apron’s stock tumbling downward.

Brutal. But hey, this is Jeff Bezos we’re talking about.

Bezos Prime

Does that dude look like he means business? Yes. Yes he does.

But Blue Apron’s bad fortune is my luck since I live in the Seattle market, where Amazon tends to roll out new food initiatives first. When I read yesterday the company was already shipping its meal kits, I decided to order one.

So here is my review. Before I start, it’s worth noting I will be comparing my experience with Amazon’s meal kit to that of Blue Apron. Why? It’s what I know. I subscribed to Blue Apron for about seven months last year and, as a result, Blue Apron is my main point of reference when it comes to meal kits.

The Order Experience

When I learned that Amazon is already shipping their meal kits in the Seattle market, I went to the site and checked out the meals available. And while I didn’t expect to eat an Amazon meal kit for dinner last night, when I saw the company offered same day delivery on their meal kits, my dinner plans suddenly changed.

A few observations about the order experience. First, I counted a total of sixteen available meal kits. I liked having the choice of that many meals, something I didn’t get with Blue Apron in a specific week, which gave me the choice of four meals to choose from every week, two of which they would ship to my house.

Second, same day delivery is a big deal. With Blue Apron, I needed to pick my meals roughly a week in advance to give the company enough time buy, prepare and ship the meal to me by early the next week. With Amazon’s meal kits, I ordered that morning before 10 AM, and it was on my porch before 5 PM.

For those of us who often don’t plan that far in advance, this is a nice feature. It also gives me more flexibility since I can order one meal or five meals in a given week. Blue Apron subscriptions offered only two options: a two-person meal plan with three meals per week and the family plan, which is two meals a week.

One advantage of Blue Apron is they offer family meal kits (a serving of four). All of Amazon’s meal kits, at least currently, are portioned to serve two people. While this could be a problem if I want to cook for my family of four, I figure it’d also be easy enough to order two Amazon meal kits for one meal. But more packaging means more mess, so I suspect Amazon will offer more portion options in the future.

Pricing is similar to Blue Apron on a per-meal basis. Blue Apron advertises meals priced at less than ten bucks per person, and that in line with all of the Amazon meal kits, which came in at $8-9 per person.

The Unboxing

This is where things got exciting.

The meal kit arrived at my home in an Amazon Fresh bag, inside of which there was a package wrapped in an insulated bag.

The Amazon Fresh bag with insulated meal kit inside

When I opened the insulated bag, I saw a single box with multiple ice packs.

Inside the Amazon Meal Kit delivery bag

When I pulled the box out of the insulation bag, I was surprised at how small the package was. Granted, it was a serving for two, rather than the family meal four-person servings I would get from Blue Apron, but I was surprised nonetheless at the small size of food box.

Below is a video of my “unboxing” of the meal kit.

Let me emphasize that the packaging and presentation of the Amazon meal kit was probably the most impressive part of the whole experience. I liked that all the food was packed tightly in a well-designed box. Contrast this with Blue Apron, where ingredients are, for the most part, packed loose in the big insulation bags.

Another small observation, but possibly an important one. The chill packs in the insulated bag were fully recyclable. The plastic exterior of the chill packs had a giant recycle symbol. Verbiage below that said the contents inside is plain old water and that I could empty and recycle the bags. I like that idea because other meal kit services (not just Blue Apron) often have some chemical concoction inside that is not recyclable.

Amazon meal kit chill packs are filled with water and are recyclable

The Ingredients

Next, I assessed the ingredients. Much like Blue Apron, the number of ingredients I had to work with always surprises me. I guess this is in part because if left to my own devices, I often cook simple meals and when I do cook with recipes and a bigger meal plan, I find it it’s a lot of work to assemble everything I need. With a meal kit – whether it’s Amazon or Blue Apron – the hard work of shopping and assembling ingredients in the right portions is already done.

You can see below what my unpacked box looked like:

My meal kit ingredients

The main difference I noticed with my Amazon meal kit and a Blue Apron meal kit is Amazon has done more of the work by chopping the vegetables. Blue Apron kits come with whole vegetables, and you chop them according to the recipe instructions. Some meals had me chopping five or six vegetables to prepare a meal. For this meal, which included sweet potato fries, a bacon jam with onions and a cole slaw, all the vegetables with the exception of the pickle were already chopped.

Whether this is good or bad comes down to personal preference. If you prefer whole, fresh food or like doing more of the prep work for your meal, Blue Apron makes sense. If you want to save a little time or find chopping veggies tedious, then I would suggest Amazon’s meal kit service is better in this regard.

Time To Cook

With my ingredients ready to go, it was time to cook.

Much like Blue Apron, Amazon includes a good looking instructions and ingredient card with their kit. The card, with ingredients on one side and cooking instructions on the other, was smaller than the Blue Apron cards.

Here’s the Amazon instruction card for my Wagyu beef burger meal:

The Amazon meal kit recipe card

At first blush, the meal I chose looked really simple. After all, how hard can making a burger be?

And while it was straightforward, I found the extra flourishes Amazon put into the recipe to make this, as they put it, a “burger for a true gourmand,” enjoyable. They had me make a bacon jam with onions and maple balsamic, finish the burger in the oven, and toss the sweet potato fries in a delicious seasoning blend. In general, it wasn’t too much work, but enough to make me feel like I could say I cooked something.

Making bacon jam

And just like Blue Apron, I found the 30 minutes of promised cook time was action packed. Once I finished one thing, I was onto the next and, all along the way, I was using timers (Alexa, naturally) as I orchestrated the cook.

In 30 minutes or so, I had the meal ready to plate.

The Meal

Here’s the plated meal:

The finished meal

I was feeding my son, who isn’t a fan of onions or cole slaw, so his was more basic. Mine was, more or less, as pictured on the instruction card.

It was good. Wagyu is high-quality beef and, add in the artisanal bun, the bacon jam, and the premixed burger sauce, and it was one tasty burger.

It was also a very big burger. The meal kit included a full pound of ground beef for a two person meal. I normally don’t make half-pound burger patties, but I decided to go for it, and it resulted in a very fat burger that was hard to get my mouth around (that’s a good thing).

While I think one meal is too small a sample size to generalize about Amazon’s meal kit portion sizes, if my meal is any indication, Amazon is not scrimping. Blue Apron four-person portions sometimes felt a bit light when it came to the main course, but satisfying.  One thing I will be watching for as I sample other meal kits is if generous portions as part of Amazon’s overall strategy.

Despite the size of the meal, I will say it was good enough to finish the plate in its entirety.

Summary

Bottom line, I was happy with my Amazon meal kit and will be trying other meal combinations and recipes.

Last night’s experience tells me Amazon has put in a lot of time to fine-tune this product. The purchase experience, delivery time, packaging and presentation, cooking experience and quality of meal were all high-caliber.

Combine that with company’s strength in online commerce, customer loyalty, delivery infrastructure and – as of last month- their move into brick and mortar grocery delivery, and Amazon’s move into meal kits should be worrisome for Blue Apron and any other company in the meal kit space.

Join The Spoon editors and folks creating the future of the kitchen at the Smart Kitchen Summit. 

Curious About The Echo Show? Here’s My ‘One Day’ Review

The Echo Show arrived this week. Like many, I was excited to put the latest addition to the Echo lineup through its paces.

Welcome to my one day review.

Why write a review after using a product one day? Doesn’t one need to spend weeks – maybe even months – with a product like the Echo Show to really understand the possibilities of this complicated and interesting new product?

Yes, but here’s the thing: For most products, you also are able to notice things right away. Not unlike a first date when you show up at the restaurant and notice your date for the night has three eyebrows or is a loud talker, there are things you notice right away when you’re around someone or something.

So here goes:

Out of Box Experience

The install experience was painless, quick and well optimized. Once I pulled the Show out of the box and plugged it in, it walked (and talked) me through the installation.

The device found my Wi-Fi network, had me enter my password, and within a minute it had checked in with the cloud and knew this was Michael Wolf’s new Echo Show. The Show started to download a software update, which took about five minutes. Overall, the product was installed and running in 10 minutes.

The Sound

For about five minutes, I thought this device sounded horrible. Then I saw the layer of protective plastic over the speaker.

This is why I don’t write five minute reviews.

Plastic removed, the Echo Show sounds good. Not quite as good as my Sonos Play 3, but it could give my Play 1 a run for its money.  Turned up, the Echo Show is fairly loud.

Volume is controllable via Alexa, but it also has volume up and down buttons on top of the device, which I like. Sometimes you just like old fashioned physical buttons.

The Echo Show Shape and Look

Like many this week, I was surprised at the beefiness of the Show when it arrived at my house. This is mostly due to Amazon’s early press images and videos which showed the the latest Echo mainly from the front of the device. When you actually see the Show in all its glory, it’s a lot deeper than you expect.

So Amazon intended for you to mainly see the Show from one side: its front. This is clear not only because of how deep and heavy the back side of the Show is, but also because the sides of the device are angled inward. It reminded me of those early big screen TVs before everything became ultra-thin.

Because of these angled sides, you can walk from side to side and still have the illusion that this is a thin device. See video below:

Given the shape of the device, it works best against a wall. While I’m sure that with so many of today’s modern kitchens having islands, I’m sure many Echo Shows will end up stranded one one (sorry), but I’d suggest putting it up against a backsplash as it just looks better.

The device’s front screen leans ever-so-slightly backward. When I pushed the device with my hand and tried to tip it over from the front, it stuck stubbornly in place. It’s clear that Amazon gave some thought to how this device would sit on a surface like a kitchen counter as people and things moved around it and possibly bump into it.

Visual Information + Voice = Game Changer

Here’s something I realized right away: By finally giving Alexa a screen, Amazon has opened up immense new possibilities for potential applications and content opportunities.

This may sound like an overstatement, but it isn’t.

The main reason for this is the powerful combination of synchronized voice control/visual information. While the Amazon visual skill cupboard is slightly bare at this point, you can see from what few samples there are that by adding visual information, Amazon’s created a new and exciting direction for the Echo.

I spent the most time with new Allrecipes visual skill. While the skill feels very much like a 1.0 effort (I’ll have a review of the Allrecipes skill soon), but I can nonetheless see the potential. I was able to bring up recipes, pick one I like, browse the ingredients and cooking instructions.

But the coolest feature of the Allrecipes app was the ability to play and pause videos.  This is really important because if you’re like me, you like to watch and rewatch videos as you move through the cook process.

At the risk of being repetitive, let me say it again: it’s this combination of voice search and command with visually rich information in a shared-screen computing device is by far the most exciting thing about the Echo Show.

There are other aspects about having an always on screen that are important. The “sleep screen” info on the Echo Show is unobtrusive, natural and well placed. Maybe because Amazon has had so much practice creating sleep screen content  with the Kindle, but it’s clear Amazon thought about placing interesting and relevant info on a device. With the Echo Show, the device not only shows basic temperature and time info, but it scrolls through headlines, suggestions for using, etc.

The Camera

Of course, the camera’s most obvious benefit is the ability to communicate with others via voice chat. While I haven’t done a drop-in with my own Show yet, I did try it out in store at Amazon Books and the video quality seems really good.

Less obvious is the camera is being used as a sensor. When I turn out the lights the screen soon goes into soft-light mode, which I thought was a nice feature. And while it is early days for the Show, I expect at some point Amazon will unlock other computer vision capabilities that could really unlock contextually relevant information.

“I Would Use That”

When it comes to Alexa and our first two Echo devices, let’s just say my wife Tiffany has been indifferent to annoyed. Sure, she’ll ask Alexa to play music, but for the most part doesn’t see the value.

But after a few minutes playing with Echo Show, she was sold.

She tried out the Allrecipes app. She searched for a recipe and tried the video feature and liked it. She started, paused, played a video of making a strawberry smoothie, something my daughter wanted to make.

After a few minutes, my wife said, “this is something I would use.”

And of course, she then suggested I get rid of another one of my kitchen gadgets taking up counter space in order to put this one in the kitchen.

But hey, progress, right?

Analysis: Here’s Why Amazon & Whole Foods Make Perfect Sense

Blockbuster news this morning: Amazon is acquiring Whole Foods for $13.7 billion.

Needless to say, this is a huge deal. My immediate thoughts are this:

This deal signifies Amazon’s entry into physical brick and mortar in a big way. The company, which has been toying around with future store concepts like its own bookstore and the Amazon Go grocery concept store in Seattle, is betting big on physical store formats in the future.

The company can no longer simply be called an online retailer. They are now truly omnichannel.

This gives Amazon a flagship store network for food (and other products) for pickup and delivery in markets around the country. The company, which has been building out its distributed pickup locker network in places like 7-11 around the country, as well as slowly expanding the reach of Amazon Fresh, now has its own nationwide network of storefronts that they can leverage in the rollout of both.

The combined company also provides an opportunity to experiment with loyalty program benefits for the company’s Amazon Prime members. Imagine Whole Foods promotions for Amazon Prime members and even having special shopping hours for members of its subscription-loyalty club. Amazon can make finally take its loyalty program and extend physical retail benefits, not unlike members of Costco or other membership stores have been doing for years.

Perhaps most importantly, the integration of Whole Foods provides the perfect format for Amazon’s future-forward shopping concepts that they’ve been experimenting with in their Amazon Go concept store in Seattle. While I don’t see Whole Foods going cashier-less anytime soon, I do think IoT-powered shopping could ease buyer friction in the purchasing process. Expect Whole Foods to become sensor-packed stores that analyze and understand their clients better than anyone. I also expect Amazon to integrate its own technologies such as Alexa into the shopping experience and even find ways to promote its own Amazon replenishment platform Dash in-store.

Of course, it goes without saying the Whole Foods customer is not the everyman, mass-market customer. The company, which pioneered the organic grocery movement in the early 1980s, attracts a high-income crowd that is willing to pay a premium for products. It’s not the Safeway or Target customer. That said, this is exactly the type of customer that already probably spends lots of money on Amazon.

It’s a good fit.

Last point: I think this deal is an admission by Amazon that continued high-growth is dependent on further expansion into physical brick and mortar. While online commerce will no doubt continue to grow, after spending a decade experimenting with Amazon Fresh, the company has learned that getting greater wallet share in areas like fresh produce and grocery requires physical store fronts, no matter how much Amazon spends on things like drone delivery.

Want to explore the future of grocery? Make sure to check out the Smart Kitchen Summit, the only event about the future of food, cooking, and the kitchen. Use the discount code SPOON to get 25% off of tickets. Also, make sure to subscribe to get The Spoon in your inbox. 

Analysis: With HomePod, Apple May Finally Deliver On The Promise Of HomeKit

After months of rumors, Apple finally introduced a wireless streaming speaker called HomePod this week, their first new hardware product since the Apple Watch debuted in 2015.  The Siri-enabled wireless speaker also doubles as a HomeKit powered smart home hub, giving Apple a new fixed HomeKit control point beyond Apple TV. The HomePod will ship in December and is priced at $349.

There is a bunch to break down here, including the HomePod compares to Amazon’s Echo, but let’s first look at what exactly Apple introduced.

The Hardware

The new HomePod is an impressive piece of hardware. The HomePod includes Apple’s A8 chip, a system-on-chip CPU/GPU that debuted in 2014 with the iPhone 6. It has a six-microphone array with advanced echo cancellation, which Apple says will enable “Siri to understand people whether they are near the device or standing across the room, even while loud music is playing.”  The Siri-powered speaker also features seven beam-forming tweeters, each with an amplifier, and it also includes what Apple calls room-sensing technology that allows the device to optimize its sound based on the specific spatial characteristics of where music is being played.

During the event, Apple made a string of other important announcements that led up to the climactic debut of the HomePod:

AirPlay2

One of the most important foundational technology upgrades announced Monday was AirPlay 2, a much-needed update to Apple’s wireless streaming protocol. With Airplay 2 we finally get multiroom audio support, a huge upgrade that will allow homes with Apple’s HomePod – as well as products from partners like Bose, Bang & Olufsen, Marantz and others – to stream audio wirelessly to different rooms and to multiple speakers. The upgrade puts Apple’s streaming music framework on par with Google’s Chromecast for audio, which already supports multiroom audio.

Apple’s AirPlay 2 Early Partners. Image credit: The Verge

A notable absence from the list of initial partners was Sonos, a company that almost single-handedly created the wireless multiroom audio category.

HomeKit

The release of AirPlay 2 will not only bring multiroom audio support, but it also adds speakers to the list of devices controllable with Apple’s smart home protocol, HomeKit. By adding the speaker category to HomeKit, consumers will be able to control their wireless speakers through the iOS Home app.

The arrival of the HomePod also brings a second fixed smart home hub device into the lineup. Like Apple TV, the HomePod allows for remote access to any HomeKit compatible device through the Home app. However, with far-field listening capabilities and integrated Siri, the HomePod instantly surpasses Apple TV to become Apple’s most capable smart home hub.

What Does All This Mean?

The pricing, capabilities, industrial design and messaging gave us all we need to know to break down Apple’s strategy:

The HomePod Is, Above All, A Music Product: The HomePod is built to be a great wireless streaming speaker. With seven beam-forming tweeters – that’s one more sound driver than the Sonos Play 5 – it’s built to sound great. Sure, the HomePod has built-in Siri, but Apple messaged this as a revolutionary multi-room speaker first and a virtual assistant second.

This Is a Premium Product : The price of the HomePod, $349, may seem fairly affordable when compared to other Apple products, but at roughly double the price of the Amazon Echo and nearly triple that of Google Home, this is a much higher priced than other smart speakers.  It’s clear Apple has Sonos, probably moreso than Amazon or Google, in its crosshairs.

Apple Is Finally Bringing An Upgraded Siri Home: One of the messages from Apple this week is Siri has finally grown up. By adding anticipatory computer features, opening it up further to developers with a year two SiriKit and creating a Siri face for Apple Watch, the company finally feels they have a virtual assistant on par with Google Assistant. And now with HomePod, Apple has a true voice assistant to bring into the home.

Apple Vs. Amazon

Where does this position Apple relative to Amazon and the Echo?

I think given the premium pricing strategy, Apple appears to be ceding the fixed smart speaker mass market to Amazon. By choosing a music-first, premium approach, Apple appears content to let Amazon win the numbers battle with its lower-cost smart speaker.

However, letting Amazon blanket the mass market with $49 Echo Dots does not mean Apple is ceding the virtual assistant market to Amazon. In fact, if we learned anything this week it’s that Apple plans to leverage the hundreds of millions of Siri-powered iPhones, iPads and Apple Watchs in the market as it does battle with Alexa. .

And not only is Apple leading with iOS, but they plan to make it a much more rich and robust platform with new efforts like ARkit, their new augmented reality developer platform. Imagine pairing a well-done augmented reality app with a voice assistant capability in the home, and you might have something pretty cool.

Ok, so while it’s a bit of a risky strategy, it’s probably the right one for Apple. By ‘dancing with one who brought them’ in iOS and augmenting their home strategy with a premium-priced smart speaker/virtual assistant for the home with HomePod, Apple now at least has a strategy to do battle with Echo, even if their new smart speaker is priced out of reach for some consumers.

Lastly, let’s not forget that the HomePod with HomeKit is a true smart home hub, with all the built-in intelligence to make a powerful Apple-powered smart home come to life. While the Amazon Echo has done an good job integrating with hundreds of various smart home devices through its skill platform, it’s limited in its ability to execute on things such as scenes. With HomeKit and a new rev of the Home app for iOS, I think Apple may finally have what it needs with the HomeKit-HomePod combo to deliver on the early promise that had so many excited about HomeKit.

Make sure to subscribe to the Spoon newsletter to get it in your inbox. And don’t forget to check out Smart Kitchen Summit, the only event on the future of the food, cooking, and the kitchen. 

Rubin: Essential Home Will Be The “Bridge” Between Competing Smart Home Ecosystems

Last night Andy Rubin got on stage with Walt Mossberg at the Code Conference to discuss his new company.

The two spent a good chunk of the conversation talking about the Essential Phone, but when they finally got to the Essential Home, they didn’t disappoint.

I wrote yesterday about what we already knew about the Essential Home smart home product, but Andy’s discussion with Walt gave us a better understanding of the company’s strategy for the device.

Rubin and his team have (correctly) identified the main problem of the smart home as one of too many competing ecosystems. The main goal of the Essential Home is to solve for that.

Per Rubin: “One of the problems in the home is the UI problem. There are too many things you have to interact with in your home.”

While we often use that term UI to describe the various consumer interaction layers such as voice, touch or motion, Rubin is using the term more broadly here. He points to a fragmented smart home world with too many competing apps, smart home protocols, and technologies. And, as the guy behind Android, Rubin admitted that in many ways he helped create the problem.

“I feel somewhat responsible. One of things Android helped do make really easy to write a mobile app. the guy building your IoT doorbell, he’s going to write an app.”

According to Rubin, the problem with so many apps and technologies is each time a consumer walks through their smart home, they are walking through a series of competing apps and ecosystems.

“In certain ways,” said Rubin “the industry has recognized what the problem is, which is you don’t want to launch someone’s app when you walk up to your front door to unlock it, where they have their own UI, their own login credentials, and when you finally get through front door and its time to turn on your lights, do the same thing with the guy that built your light bulb.”

He’s right in saying the industry knows fragmentation is the main problem in consumer adoption. In our survey of over 100 smart home execs last December, the number one hurdle to adoption of smart home products identified by industry insiders is confusion over too many smart home platforms.

In other words, fragmentation. Or, as Rubin puts it, “a UI problem.”

Rubin said the solution to the problem of UI fragmentation is to bridge all of these competing ecosystems by working to integrate as many of them as possible together.

“You have to think of it as a UI problem,” said Rubin, “and you have to solve the UI for the home as an interoperability and integration issue. You can’t just support ten devices; you have to support one hundred thousand devices.”

That’s a lot of devices, but Rubin plans to get there by bridging the various ecosystems across the world of Apple, Amazon, Google and more. In other words, he doesn’t want to compete with the giants, but instead wants to connect them to one another.

“You can think of this as everyone is creating an island by creating their own ecosystem, so building bridges is the best way to describe what we’re doing. It has to talk to all these ecosystems, whether it’s Smart Things, HomeKit, or Google Home, or Thread or Weave.”

Rubin didn’t go into the specifics of how he plans to solve the fragmentation issue, other than to say they think they’ve found a way to do it. Whatever the approach is, it sounds like one built from the operating system on up with a focus on security.

“We had to build a new operating system so it can speak all those protocols and it can do it security and privately.”

That operating system is called Ambient OS. It will be part of the new Essential Home which is rumored to ship in late summer.

Make sure to subscribe to the Spoon newsletter to get it in your inbox. And don’t forget to check out Smart Kitchen Summit, the first and only event on the future of the connected kitchen and the future of cooking. 

First Look At Essential Home, An AI-Powered Smart Home Platform From Andy Rubin

Anyone who’s followed tech over the past decade knows what a huge role Andy Rubin has played in mobile computing. As one of the principals behind the Sidekick mobile device, co-creator of the Android operating system and the architect of Google’s mobile strategy, it’s not an exaggeration to say Rubin is one of a handful of people who helped shape the face of the modern technology landscape.

So when Rubin left Google in 2013, many of us were curious if he had another big idea. With such a prolific track record, there was a good chance he wouldn’t be content just sitting around. The company he founded next, Playground Global, seemed innocuous enough at first – a venture fund for hardware – but was just shrouded enough in mystery to make one wonder if Rubin and his high-powered team had a surprise up their sleeves.

It turns out they did. That something is Essential, a new hardware company whose first two products are a new phone (called, naturally, the Essential Phone) and smart home platform called Essential Home.

Unlike the Essential Phone, the specifics of the Essential Home are somewhat vague. However, the clues we do have are tantalizing and show promise.

Here are the highlights:

Heavy on Scenes & Context

According to the company, the Essential Home isn’t just another control point for your devices, but instead one that is an “orchestra conductor for your digital instruments – something that can get them to start to work together in new, exciting ways.”

This means that it will likely work to create scenes across devices instead of straightforward device automation. That’s great but not all that different than other smart home platforms out there. However, there looks to be a heavy dose of AI-powered contextual understanding weaved into these scenes:

Essential Home “can take note of your routines and let you know when something feels off or if a light is left on. You can ask Essential Home to play your favorite music and when you start a conversation it will adjust the volume downward so you don’t have to talk over it. When you’re getting ready in the morning, Essential Home can show how long you have until you need to leave and even blink the lights when it is time… The best part? I can ask Essential Home to do all of this without having to fumble with an app.” 

This is not surprising. The era of simply being a smart connector box is so 2014, and today a smart home hub needs to be a virtual assistant that learns from past user activity, understands the physical living space in which it resides, and leverage data streams coming from other devices to proactively provide contextual recommendations.

Of course, anyone who uses anticipatory computing services like Google Assistant knows this all sounds great but can be annoying in practice if not executed well or if they take too heavy a hand in performing an unapproved action, so I am very intrigued to see well this performs in practice.

Light on Clouds

Cloud integration has become a fast and easy way for different smart devices to integrate. Product platforms such as Alexa, Samsung smart home, and others utilize the cloud to integrate with other devices, a much easier route to market than device to device direct integration.

However, relying on the cloud to power your smart home comes with disadvantages, something to which anyone who has had a broadband outage can attest. There are also greater privacy and security risks through relying on cloud services to power your smart home.

“We’ve designed Essential Home to run most things on the device itself, so most data stays in your home where it belongs. Essential Home will directly talk to your devices over your in-home network whenever possible to limit sending data to the cloud.”

By focusing on device-to-device interaction and keeping user data local as much as possible, the company seems to be making consumer privacy and data security a point of differentiation.

The Ambient OS

The introduction to Essential Home makes a bold statement: “The Home Now Has an OS.”

That would sound a lot like marketing fluff were it not coming from the guy who brought us Android. In a blog post by Essential’s head of software development, we get a few details about what this means:

“Ambient OS provides a set of services and abstractions that enable the development and execution of applications that run in the context of your home. With Ambient OS, your home is the computer. Ambient OS is aware of the physical layout of your home, the people that live in it, services relevant to both your home and the people within, and devices.

Ambient OS is the API to your home that enables the creation of applications that extend the reach of a single device. For example, you can setup a timer and have the lights in the livingroom flash when it goes off. With the Ambient OS API, developers have access to available devices, services, and home information and can use these resources as the building blocks of their applications.”

Of course, the devil is in the details, but I like the sound of where they are headed. The approach sounds less heavy than HomeKit, but more deeply integrated than services like IFTTT.

Ultimately, I think success will depend on how easy on-boarding of new third-party hardware will be. If the company takes low-friction approach that Alexa did initially with its Skill platform, they’re likely on the right track.  If they require a business relationship with third party devices to enable interoperability a la HomeKit, chances are it won’t fly. My guess would be it’s more prior than the latter.

Lastly, no one’s really captured the “magic” of the smart home in a way that is enough to propel the overall concept to go mass market. Amazon’s Alexa is the closest we’ve had to a an “iPhone moment” with the smart home. While it’s too soon to say if the Essential Home Ambient OS is another transformative product for the smart home, it sounds like that’s what Rubin’s team is aiming for.

Device Design

Based on the description of the device, obvious interaction methods include voice and touch control. The device description says a “glance” is enough to trigger an action, which could also mean motion sensing or even machine vision (though it doesn’t look like the Home has a camera on the initial product images I’ve seen).

The actual hardware looks pleasing enough, with a circular touch screen display and small, modern form factor. It doesn’t look like it has much in the way of a speaker – though I could be wrong or the device could change as it moves toward production – so I don’t know if it’s much of an Echo competitor.

Pricing is also a mystery. While the Essential Phone is premium priced at $749 (it’s made of titanium, after all), I’m sure the Home will be more affordable. Andy Rubin is speaking at the Code conference today, so we’ll update this post with any further details.

Related: Rubin: Essential Home Will Be The “Bridge” Between Competing Smart Home Ecosystems

Make sure to subscribe to the Spoon newsletter to get it in your inbox. And don’t forget to check out Smart Kitchen Summit, the first and only event on the future of the connected kitchen and the future of cooking. 

Five For Food: Cortana Skills Begin To Roll Out, Including A Handful For Foodies

Earlier this month, Microsoft finally debuted its own home virtual assistant/speaker combo alongside a developer platform for third party skills. A couple years behind Echo/Alexa, it’s no surprise the new platform has lots of catching up to do when it comes to third party skills.

But let’s give credit where credit is due: Not only did Microsoft beat Apple to market with a home voice assistant, they also have a decent early slate of skills. Checking in on the Microsoft skill listing, there are a total of 55 total skills as of today, of which five are food related.

Here are the five food skills currently available for Cortana:

Food Network: Like the Alexa skill, this Cortana skill allows users to ask Cortana for a recipe for a meal made on any number of shows. Users can “ask for recipes by ingredient, course or chef. You can also search our TV schedule by show, chef and time/date to find showtimes and episode details.”

Domino’s Pizza: Pretty simple: users can order Domino’s pizza with this Cortana skill. By adding Microsoft’s voice assistant,  Domino’s is available on all three of the big home assistant platforms, including Alexa and Google Home.

Open Table: The Open Table skill is also pretty straight forward: like the popular mobile app, the Cortana Open Table skill allows you to make reservations. To get started, the user has to do a little up front work and fill in their basic contact details such as name, email, phone.

Bartender: This one is a fun but simple skill – you can ask it to give you the recipe for your favorite cocktail and it will walk you through it. This skill is made by BigOven, a Seattle based digital recipe and food content startup founded by ex-Microsofter Steve Murch.

Cook.ai: Of the five Cortana food skills, this is my favorite. While I didn’t try it on Cortana (I don’t yet have a Cortana device), I was able to give it an Alexa version of this skill a test run and liked the concept. The neat thing with Cook.ai is it combines a voice assistant with a web app at Cook.ai to walk you through a recipe. You start by first enabling the skill, then you are instructed to pair a device (I paired my Mac). The skill then takes you through a recipe step by step, showing each stage of the recipe in the web app on the paired device. You give voice commands to move from step to step. Cook.ai is also working iOS and Android apps (and I assume also Windows), though I found the web app worked just fine.