• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer
  • Skip to navigation
Close Ad

The Spoon

Daily news and analysis about the food tech revolution

  • Home
  • Podcasts
  • Events
  • Newsletter
  • Connect
    • Custom Events
    • Slack
    • RSS
    • Send us a Tip
  • Advertise
  • Consulting
  • About
The Spoon
  • Home
  • Podcasts
  • Newsletter
  • Events
  • Advertise
  • About

Google Assistant Is Becoming A Guided Cooking Platform. We Talk To The Person Leading The Charge

by Michael Wolf
November 11, 2017June 24, 2018Filed under:
  • Next-Gen Cooking
  • Robotics, AI & Data
  • Video
  • Click to share on Twitter (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to share on Facebook (Opens in new window)
  • Click to share on Reddit (Opens in new window)
  • Click to email this to a friend (Opens in new window)

Back in April, Google’s Emma Persky wrote a post telling the world that Google has been working on a recipe guidance capability for Google Assistant.

At last month’s Smart Kitchen Summit, she gave a little more detail on what exactly the company has been up to.

Persky, who runs point for Google Assistant’s cooking guidance team, told the Spoon’s Allen Weiner how much of the focus has been on building in contextual understanding of recipes.

“We can talk you through step by step how to cook a recipe and answer contextual questions about how to do that,” said Persky. “To do this, we have to build a deep model of what a recipe actually looks like. Have to take the text of a recipe and understand that text so we know what pasta is, we know what type of pasta you’re talking about, we know what the units are, we know the cooking temperature.”

“On the other side, we know what the user is saying. We have a whole bunch of machinery at Google that is able to understand what a user is saying and turn that into a machine question. We have a whole bunch of data about how different people ask these questions, which we use to build a model and understand these types of questions.”

When asked about how Google is utilizing company competencies like search and YouTube, Persky said that while there’s been significant work done here, there’s an opportunity to get better.

“We do a pretty good job now when you ask on your phone or desktop ‘how do I sauté an onion?’ we show you a nice video of how to sauté an onion.”

But, she said, “there’s a lot of opportunity for guided cooking feature to more deeply integrate with this, so when your recipe says sauté the onion, and you don’t know how to sauté the onion, we are able to return these types of video answers on on Google Home platform to help you become a better chef over time.”

Persky also discussed how she thought web content schemas could evolve to create a foundation for richer content through platforms like Google Assistant.

“When it comes to companies that have this kind (recipe) data available to them, there are a lot of opportunity for finding ways to increase the fidelity of the data that we have access to. At the moment we have schema.org markup, which is a good first pass. We don’t have a lot of detail and use machine learning to extract a lot of the context from that. And I think where there’s an opportunity to where a lot of people working on this stuff is to find ways to access more high fidelity data that we could offer to the users as an improved experience.”

When asked by Weiner how schema.org and other web markup languages could improve, she had this to say: “There’s a lot of work we can do to improve the quality of that markup. For example, right now the markup just has one block of text for all the instructions in the recipe, but actually if we could break that down and have a step by step, it would be easier for us to parse that out. Right now we have to apply machine learning across that to do that.”

It’s a really good conversation to understand what Google has been up to as they look to combine recipe content with their voice AI platform. You can watch the full conversation between Allen Weiner and Emma Persky below:

Ed note: Answers in this interview have been edited slightly for brevity/clarity


Related

Hearst Unveils Visual Guided Recipe Skill for Amazon Echo

Alexa, let's have Pancetta Chicken for dinner. Last month, publisher Hearst expanded its Amazon Echo- and Spot-enabled Good Housekeeping skill to include connected recipes. Dubbed Good Housekeeping Test Kitchen, the skill provides simple "meal ideas" that can be thrown together in 30 minutes or less. The recipes will be curated by Susan…

SideChef Launches Guided Cooking Integration With Bixby, Samsung’s AI Assistant

This week, SideChef announced an integration with Samsung's intelligent voice assistant Bixby. The partnership centers around the launch of a voice-activated guided cooking capsule (capsules are Samsung's equivalent to Amazon Alexa skills) which will give users of Bixby-powered mobile phones access to approximately 15 thousand recipes, most with step-by-step video-powered…

KloveChef Opens Up Voice-Guided Cooking Platform to Publishers

KloveChef, the voice-guided cooking startup cofounded by one of India's biggest celebrity chefs in Sanjeev Kapoor, is opening up its platform this month to publishers wanting to add voice-guided cooking functionality to their recipes. The new tool will allow anyone who has recipe content — chefs, cookbook authors, bloggers or…

Get the Spoon in your inbox

Just enter your email and we’ll take care of the rest:

Find us on some of these other platforms:

  • Apple Podcasts
  • Spotify
Tagged:
  • AI
  • data
  • Google
  • Google Assistant
  • Google Home
  • Guided cooking
  • metadata
  • schema
  • schema.org

Post navigation

Previous Video
Next Video

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Get The Spoon in Your Inbox

The Spoon Podcast Network!

Feed your mind! Subscribe to one of our podcasts!

Leanpath CEO Excited For Potential of AI to Drive Action as Fight Against Food Enters Its ‘Second Act’
The Grocery Store is the Food System
Nearly Seven Years After Launching Kickstarter, Silo Finally Delivers Next-Gen Home Food Storage System
What Flavor Unlocks
Starbucks Unveils Green Dot Assist, a Generative AI Virtual Assistant for Coffee Shop Employees

Footer

  • About
  • Sponsor the Spoon
  • The Spoon Events
  • Spoon Plus

© 2016–2025 The Spoon. All rights reserved.

  • Facebook
  • Instagram
  • LinkedIn
  • RSS
  • Twitter
  • YouTube
loading Cancel
Post was not sent - check your email addresses!
Email check failed, please try again
Sorry, your blog cannot share posts by email.