Close Ad

The Spoon

Daily news and analysis about the food tech revolution

Google Home

Five For Food: Cortana Skills Begin To Roll Out, Including A Handful For Foodies

Earlier this month, Microsoft finally debuted its own home virtual assistant/speaker combo alongside a developer platform for third party skills. A couple years behind Echo/Alexa, it’s no surprise the new platform has lots of catching up to do when it comes to third party skills.

But let’s give credit where credit is due: Not only did Microsoft beat Apple to market with a home voice assistant, they also have a decent early slate of skills. Checking in on the Microsoft skill listing, there are a total of 55 total skills as of today, of which five are food related.

Here are the five food skills currently available for Cortana:

Food Network: Like the Alexa skill, this Cortana skill allows users to ask Cortana for a recipe for a meal made on any number of shows. Users can “ask for recipes by ingredient, course or chef. You can also search our TV schedule by show, chef and time/date to find showtimes and episode details.”

Domino’s Pizza: Pretty simple: users can order Domino’s pizza with this Cortana skill. By adding Microsoft’s voice assistant,  Domino’s is available on all three of the big home assistant platforms, including Alexa and Google Home.

Open Table: The Open Table skill is also pretty straight forward: like the popular mobile app, the Cortana Open Table skill allows you to make reservations. To get started, the user has to do a little up front work and fill in their basic contact details such as name, email, phone.

Bartender: This one is a fun but simple skill – you can ask it to give you the recipe for your favorite cocktail and it will walk you through it. This skill is made by BigOven, a Seattle based digital recipe and food content startup founded by ex-Microsofter Steve Murch.

Cook.ai: Of the five Cortana food skills, this is my favorite. While I didn’t try it on Cortana (I don’t yet have a Cortana device), I was able to give it an Alexa version of this skill a test run and liked the concept. The neat thing with Cook.ai is it combines a voice assistant with a web app at Cook.ai to walk you through a recipe. You start by first enabling the skill, then you are instructed to pair a device (I paired my Mac). The skill then takes you through a recipe step by step, showing each stage of the recipe in the web app on the paired device. You give voice commands to move from step to step. Cook.ai is also working iOS and Android apps (and I assume also Windows), though I found the web app worked just fine.

Samsung Adds Bixby AI To Family Hub Fridges

When Samsung debuted Bixby, its AI-enabled home assistant on Galaxy S8 phones, we wondered how well it would do as an Amazon Echo or Google Home competitor. After all, carrying your phone from room to room to control your smart home with voice makes about as much sense as….carrying your phone room to room to control your smart home with an app.

But it didn’t take Samsung long to take Bixby out of the phone and put it in some of its existing smart appliances – namely, the mother of all smart appliances, the Samsung Family Hub 2.0.

The Family Hub debuted at CES several years ago, with a giant touchscreen interface on the front and all kinds of interesting kitchen functions, including grocery ordering and to-do lists for family members. But Samsung clearly had plans to use the technology they were building inside these fridges as more than just glorified tablets.

On Sunday, Samsung announced it will include Bixby’s AI functionality inside Family Hub fridges, allowing users to search for recipes and ask Bixby for news and weather – very similar to competitive AI-powered speakers. But the Family Hub also allows for food ordering through partners such as Nomiku (sous vide company making sous vide-ready meal kits) and Grubhub and with the native voice functions paired with the touchscreen, along with possible connectivity to Samsung’s other smart devices in the home, it makes for an interesting voice solution in the kitchen. Samsung recently invested in Nomiku as they launched their RFID meal kits and laid out clear plans to form a cohesive ecosystem in the kitchen.

According to Pulse News in Korea,

“Bixby’s deep learning will enable the fridge to control temperature automatically, call up recipes based on user’s eating habits or recommend favorite music.”

Samsung recently invested in Nomiku as they launched their RFID meal kits and laid out clear plans to form a cohesive ecosystem in the kitchen. From Mike’s piece on the investment and news, “Fetterman said Samsung plans integrate the Nomiku with their smart home platform, SmartThings….However, the consumer electronics giant has been fairly successful in their effort to integrate SmartThings with their various product lines in the home such as appliances and TVs. While Samsung had previously announced an integration of SmartThings with their own Wi-Fi ovens, Nomiku appears to be the first small precision cooking appliance integrated with the SmartThings smart home platform.”

Current Family Hub users can also get upgraded to include Bixby functionality inside their fridges through a software update – a nice feature for a pricey appliance that we’ve often wondered how appliance giants plan to support with new functionality coming out regularly.

The install of Bixby has just begun and the updates aren’t rolled out yet. But soon, the voice in the kitchen might be your fridge telling you what’s for dinner.

Ok Google, What’s For Dinner?

When Google Home first arrived on the scene, Mike and Ashley speculated on the Smart Kitchen Show about how it would stack up against Amazon Echo. Amazon’s big entrance into the smart home, Echo came with convenient functions like timers, grocery lists, playing on-demand streaming music and radio services and eventually included recipe skills. It was an ideal device to sit on your kitchen counter.

Google introduced its answer to Echo but at first lacked the functionality that Echo has grown to enjoy due to its open API and thousands of skills developed by third parties. One of those skill areas that’s seen growth is in food & beverage, especially recipes. But this week, Google partnered with big food content houses like the Food Network, New York Times and Bon Appetit to give Home users access to over 5,000 recipes that can be read step by step by the Google Assistant.

The interesting thing about Google Home’s announcement is the way Google is adding functionality to its device. Amazon’s Alexa relies on skills developed by other companies – in order to get access to Allrecipes content, for example, you have to enable that skill in your app before you can use it.

Google takes a different approach; if you have a specific recipe you want to look up, you can head to the Google Assistant app on your phone, pick it out and send it to Google Home to walk through. So a component of this feature still involves your phone – unless you want suggested recipes, and then you can just ask “Ok Google, let’s make spaghetti” and Google’s Assistant will suggest a recipe for you. That suggestion feature, enabled without any input on the part of the user, is fairly unique.

The process is a little more intuitive and baked into the platform than Alexa skills, which sometimes can be clunky depending on how the developer choose to integrate. Some skills require you to say “Alexa, ask (brand/company) to XYZ” which is an awkward way to speak and harder to remember.

Google also choose powerhouse brands to partner with for this integration – collectively, Food Network, NYT and Bon Appetit have amassed loads of food content through the years and probably have recipes for just about anything you’d want to cook. In fact, these and other publication and content houses are constantly thinking about how to leverage their digital warehouses of recipes and food knowledge and partnerships like these are easy ways to make money outside of traditional advertising.

According to Google, the feature will start rolling out in the coming days. We’ll finally be able to say – Ok Google, let’s eat.

What Does Samsung’s Bixby Mean For The Smart Kitchen?

If you follow any tech news, you’ve seen announcements in the past week coming out of Samsung around their Galaxy S8 launch. One of the most intriguing parts of the Samsung event was the news around Bixby, Samsung’s AI assistant and answer to Siri, Cortana and Google Assistant. In some ways, it competes with the Amazon Echo too – Bixby is both a voice assistant and a smart home controller as well as an augmented reality camera.

Bixby comes with a range of new functions baked into the Galaxy S8, many of which have some interesting implications in the smart kitchen.

First, Bixby actually gives you virtual control over apps on your phone with your voice. At the moment, that functionality is extended only to Samsung apps – the phone, messaging, email, camera and video, etc – but it opens up the possibility for mobile apps to be “Bixby” friendly. Adding voice to apps that help you in your kitchen could be a unique way to get voice control without a standalone device that sits on your countertop. A recipe app that Bixby could read you the instructions step-by-step would be a quick way to get guided cooking without an extra gadget or device.

The Verge got an up close look at another Bixby feature – augmented reality via the S8’s camera. Point the camera at an object and Bixby recognizes what it is you’re both looking at and identifies it. Though not a new concept (Google Googles, Amazon Flow), it seems like a fairly flawless execution and Samsung is supposedly in talks with folks like Amazon, making it an interesting AR solution for things like grocery shopping. Other interesting applications include a partnership with Vivino that gives you tasting notes when you scan a bottle of wine.

Finally, there’s Bixby Home, which is Samsung’s answer to aggregating your home’s smart devices and controlling them via voice. Similar to the Echo or Google Home, with the difference again being the in phone location as opposed to an external device. If you could tell your phone, which might be in your kitchen as you follow a recipe app, to preheat the oven as you finish mixing cupcake batter, that might be useful. But do users typically carry around their phones from room to room at home? The benefit of an Echo or Google Home is the convenience – walk into a room, issue a command.

It seems like Bixby has some potential benefits, but it remains to be seen if it will work as promised. CNET had some fairly buggy experiences with Bixby though and they point out that Samsung isn’t even committed to putting Bixby on the S8 quite yet. It could appear as a software update later in the year. There are also other AI and machine learning technologies developing in the kitchen that might make a voice assistant on your phone irrelevant in the future. After all, the smartphone is just another pane of glass where information can be consumed and controlled – artificial intelligence can be baked into just about anything.

Want to meet the leaders defining the future of food, cooking and the kitchen? Get your tickets for the Smart Kitchen Summit today.

Anova Rolls Out Alexa and Google Home Integrations With ‘Guided Cook’ Capabilities

If you’re a member of the rapidly growing sous vide community, there’s a good chance you are one of tens of thousands that go online to share recipes and suggestions for taking the craft – and that evening’s meal – to the next level.

And if you’re an enterprising user of Anova’s sous vide circulator who just so happened to hack a custom Alexa skill to cook with your machine, you might just share your idea and get the attention of both the community and Anova itself.

That’s exactly what happened when David Zielezna shared his new Alexa skill on Reddit. After creating a stir in the /sousvide reddit, an Anova community manager reached out to David to put him in touch with the Anova software team. Before long, the sous vide enthusiast from Australia was offered the opportunity to create the official Anova Alexa integration.

And so today Anova is rolling out their new Alexa skill based on David’s work, as well as a new Google Home action that is available to Android customers.

The Alexa skill and Google Home Actions will have what Anova is calling ‘Guided Cook’ capabilities, which allow the user to access the guide information from the Anova app and work through a series of options to optimize and work through a cook. In the same way a person would navigate a branching tree of selections in the app to optimize cooking a meal, the new Alexa Skill and Google Home Action allow users to input the protein type, doneness and thickness via voice in a series of commands.

Here’s an example of how this will be done using Google Home Invocations (commands) within the Google Home Action.

User: Hey Google, tell Anova to help me cook a steak.
GH: Steak has the following choices: A) Porterhouse, B) Ribeye, C) Strip, and D) Tenderloin. Which would you like?
User: Ribeye
GH: How thick is your ribeye in inches?
User: One point five inches
GH: The ribeye steak recipe has the following choices for how you can cook one point five inch thick ribeye: A) Very rare to rare, B) Medium rare, C) Medium, D) Medium well, and E) Well done. Which would you like?
User: Medium rare
GH: The precision cooker settings for Ribeye Steak using one point five inch ribeye cooked medium rare are 129 degrees for one hour. should I start your cooker with these settings?
User: Yes
GH: I told Anova to start a cook for your Ribeye Steak at 129 degrees for one hour. Please refer to this recipe in the anova app for an ingredient list and full preparation steps.

The Guided Cook capabilities are available today with the Alexa Skill, and will be available via an update to the Google Home Action on April 4th.

With over half of Amazon Echos and likely a similar percentage of Google Home products ending up in the kitchen, Anova’s embrace of voice control makes sense. The kitchen has been a fertile area for skill creation over the past year or more, and now with Google Home doing what it can to ratchet up its third party voice interactions, we’ll see even more.

Bottom line, you can expect a lot more people talking to their cooking devices in the coming years.

You can watch David Zielezna’s Alexa skill in action in the video below:

Get the Spoon in your inbox: Subscribe to our newsletter

Want to meet the leaders defining the future of food, cooking and the kitchen? Get your tickets for the Smart Kitchen Summit today.

Turning Text Messages Into Machine Language For The Smart Home

There’s a new race in the smart home – it’s not about who will control your home but rather how. The introduction of voice assistant devices Amazon Echo and Google Home have definitely changed the conversation and the market for how we interact with the tech inside our homes. But if speaking commands to things in the house to turn them on or off or check their status seems unnatural, you could always text instead.

That’s the premise of Unified Inbox, a small company based Singapore that’s developed soon-to-be-patented software that delivers smart home control via text messenger. It’s easy to see the appeal of texting your home – it’s an easy and common way for humans to communicate with each other and it removes the awkwardness of barking out orders to an inanimate object.

The CEO of Unified Inbox, Toby Ruckert, makes the case to Reuters, saying “Think of it as a universal translator between the languages that machines speak … and us humans.” Though the company is small and privately funded, it has companies like Samsung, Bosch and IBM jumping on board to integrate functionality into their own devices. Using Unified Inbox’s platform, manufacturers can add a text assistant to their product, capitalizing on the ubiquity of smartphones in every home.

The API developed by Unified Inbox is called UnificationEngine or UE and works by taking text inputs to a messenger app and translates the human words into machine language. Described as an “IoT messenging platform,” UE was developed to bridge the language gap between people and the things around them.

Credit: Reuters

Text commands such as “turn off the lights,” “start the coffee machine at 6,” and “preheat the oven to 450” can be typed into over 20 different messenger apps along with Twitter and SMS to control a variety of home devices. From ovens and kettles, the platform can work with many appliances and Unified Inbox is testing more including garage door openers and toasters.

But why have “more than half of the world’s appliance makers” – according to Ruckert – signed up to partner with this small startup? Reuters reports that Ruckert and other tech leaders like Mark Zuckerberg see a huge future in text control – and think that big companies are worried about Amazon’s dominance.

“They’re worried the big tech companies’ one-appliance-controls-all approach will relegate them to commodity players, connecting to Alexa or another dominant platform, or being cast aside if Amazon moves into making its own household appliances.”

Check out the full story on Unified Inbox, their API and how machine learning that continues to change how we talk to our things.

Google Home Adds Shopping Feature And Partnerships With National Retailers

When Google launched the Google Home voice assistant speaker, they demonstrated their commitment to the smart home and the growing trend of voice control, a trend so far led by Amazon. Taking aim at the Echo market, Google launched Home with a big vision but not as many features as enthusiasts would have liked.

Still, 2017 is the year that “works with” Google Home becomes the new “Alexa skill” and no one is counting Google out of the game. The one area where Amazon previously had an inherent lead over Google, of course, was in its powerful commerce engine. Alexa makes it easy to order items from Amazon and, if you’re a Prime member, have them brought straight to your door in two days or less.

But news last week changed that. Google announced via a blog post that it has partnered with a number of big name retailers and added the ability to voice shop from them using Google Assistant. Retail Dive has the full story on Google’s new partnerships, with brands like Costco, Walgreens, Whole Foods, Bed, Bath & Beyond and even Petsmart, Google is clearly trying to cover its commerce bases with everything from food and grocery to household and pharmacy.

Google’s blog post on the announcement gives users a quick walk-through of how to get started. With simple commands like “Ok Google, how do I shop?” Google Assistant will walk users through the process. Or you can also just say “Ok Google, order paper towels” and presumably, it will. It’s less clear exactly who you’re getting paper towels from, though it’s likely you have to set up store preferences in your Google Home account. You also have to add a credit card on file to automatically charge upon ordering.

Credit: Google

The blog also says the service is free – for now. After April 30, it appears Google may have plans to create some type of Prime-esque membership for users to be able to take advantage of voice command shopping.

Google’s massive search and data engine give Google Home inherent advantages in the long run over competitive voice assistants like Amazon’s Echo. And with this new shopping feature, they’re looking to grab some of Amazon’s native territory as well.

The 2017 Smart Home Prediction Show

It’s the smart home prediction show & CES 2017 wrap up all in one super-sized episode.

For this episode, we bring back two of our favorite guests: Nate Williams of August Home and Adam Justice of ConnectSense.

We talk Alexa, Google Home, service provider smart home, smart appliances, smart kitchen and so much more.

You can listen Soundcloud above, subscribe in iTunes or download the episode here.

Enjoy!

Smart Home Insiders: Virtual Assistants, Not Kitchen, Story Of 2016

It’s unanimous: virtual assistants and voice interfaces were the smart home story of 2016.

That’s what 138 smart home industry executives told NextMarket Insights in a just-completed survey about the state of the smart home. The virtual/voice assistant category, which includes Amazon’s Echo/Alexa products and Google Home, was chosen as the defining story of 2016 by a large margin, with over 2/3 of respondents (68%) picking the category.

A distant second place was “smart front door”, which includes products such as video doorbells and connected locks, which was chosen by 13% percent of respondents. Smart security and mesh Wi-Fi were both 7%.

Smart kitchen was chosen by only 4% of respondents, which is not altogether surprising given the nascent nature of the category as well as it’s focused nature as compared to a horizontally disruptive technology such as virtual assistants. Technologies like Alexa are seen as having a wide across all areas of the smart home, while kitchen tech impacts a focused area (food and eating).

Even more nascent than the smart kitchen was connected commerce, which includes products like the Amazon Dash button. Only 2% saw this category as the defining story of the year.