Close Ad

The Spoon

Daily news and analysis about the food tech revolution

Alexa

Bosch Enlists Alexa and SideChef to Teach People How to Use Its Ovens

Ovens are getting fancier with new connectivity and automated cook programs. Someone replacing a traditional oven they’ve had for decades with a newfangled smart oven could be forgiven for not understanding or taking full advantage of all their new device’s automated bells and whistles.

To help with this, and to educate its users, European appliance giant BSH is enlisting the help of Alexa and SideChef. BSH is running a pilot program in the U.K. for Bosch Home Connect oven owners. Users there with an Amazon Echo Show (or Fire TV Stick 4K, Fire HD Tablets) can download the Alexa Home Connect Cooking Challenge skill.

Once downloaded, users can follow one of 25 guided recipes (pizza, pastries, proteins, etc.) created by SideChef. After preparing the dish, users tell Alexa to turn on the oven. The connected oven will then use an automated cook program to, presumably, cook whatever the meal is to perfection.

For food tech fanatics like many Spoon readers, this type of feature may sound a little ho-hum. Alexa already integrates with plenty of appliances. But the goal for BSH is to surface new and interesting capabilities on its devices that their customers might not know about. In addition to automated cook programs, the recipes could introduce people to a steam feature, and the dish being made illustrates how to use that feature.

This is also just the beginning for the Home Connect Cook Challenge skill. I spoke with a BSH representative by phone this week, and they outlined how shoppable recipe functionality is on the product roadmap along with expanding the library of recipes to include any recipe a user finds on Alexa, not just ones from SideChef.

Amazon Alexa Getting Better at Guessing Follow Up Requests

One big area where virtual assistants like Amazon Alexa and Google Assistant fall short of real human assistants is their inability to contextualize and anticipate what you’ll want next.

Currently, requests made to virtual assistants are often siloed, and go something like this:

“Alexa, how long should I steep tea?”

Alexa answers, with something like “Five minutes,” and then:

“Alexa, set a timer for five minutes.”

In a corporate blog post today (hat tip Geekwire), Amazon announced that Alexa is now getting better at bundling those types of requests together. Amazon refers to this as figuring out your “latent goal,” and actually provides tea steeping as an example. Asking Alexa how long to steep tea could have Alexa guess that your latent goal is to make tea. This, in turn would trigger an immediate and automatic follow up response from Alexa like “Would you like me to set a five minute timer?”

While this seems straightforward, as with so many AI-related tasks, understanding what people want isn’t exactly easy. From Amazon’s blog post:

The first step is to decide whether to anticipate a latent goal at all. Our early experiments showed that not all dialogue contexts are well suited to latent-goal discovery. When a customer asked for “recipes for chicken”, for instance, one of our initial prototypes would incorrectly follow up by asking, “Do you want me to play chicken sounds?”

Beyond tea, it’s not hard to think of how identifying latent goals could be useful in a smart kitchen. In the case of asking for chicken recipes, Alexa could follow up with offers to pre-heat an oven, or, more relevant to Amazon, offer to order you the necessary groceries for delivery that day (preferably from an Amazon grocery store).

Amazon says this latent goal capability is available now in English in the U.S. And while it doesn’t require any additional work from developers to activate, they can make their skills more discoverable with the Name-Free Interaction Tool Kit.

FWIW, I tried asking Alexa the tea steeping question, and it did not follow up with a timer suggestion. So its latent goals capabilities seem to still be, well, latent.

Amazon’s Echo Show 10 Swivels to Follow You. That Might be Useful in the Kitchen

Amazon introduced the latest version of its Echo Show at its hardware event today. The new Echo Show 10 features the usual Alexa-powered smart assistant, screen and speakers, but includes one new feature that might be particularly useful in the kitchen: it rotates to follow you around.

Think about how you move around when cooking from a recipe. You shift between your prep area to the fridge to the oven to pantry. Being able to always have the recipe in view means no problem if you forget what temperature to set the oven or how many eggs you need to grab.

Even if you aren’t following an on-screen recipe, the ability for the screen to swing around so you can watch a show as you cook or hold a video call is pretty neat.

We haven’t had a chance to play around with the Echo Show 10 yet, so it may not work all that well in reality. And not everyone will be comfortable with an Amazon device watching you and silently following you around with its camera eye.

But, if you’ve already given in and have an Alexa powered assistant, this seems like it could give you a little more mobility and utility. I mean, it doesn’t seem as strange as the indoor drone Amazon also announced today that pops up and flies around your house acting as a security camera.

The new Echo Show 10 will cost $249.99, will be available in Charcoal and Glacier White. Amazon says it will ship in time for the holidays.

The Food Tech Show: Did The Automat Ever Really Go Away?

In this week’s episode of The Food Tech Show, we talk about those new contactless systems and compare them to a technology from long ago: the automat.

Yep, that old-school idea born in New York City a century ago is back (or maybe it never left?), showing up everywhere from restaurants to condos.

Jenn Marston waxes nostalgic about the automat and other concepts that seem to be getting a second look as the food system looks to reinvent itself in the wake of COVID-19.

We also talk about these stories in today’s podcast:

As always, you can listen to this week’s podcast on Apple Podcasts, Spotify or wherever you get podcasts. You can also download the episode direct to your device or just click play below.

“Alexa, Look Into My Eyes”: New Prototype Combines Human Gaze with Voice Control to Help You Cook

There’s no doubt that voice control interfaces like Alexa and Google have had a huge impact on the way we search for recipes, access our appliances and add things to our grocery lists.

But what if that voice assistant had a contextual understanding of where you where looking when you are cooking the evening meal?

That’s the big idea behind a new prototype from Synapse, a division of Cambridge Consultants. The new Hobgoblin technology concept utilizes machine vision to gather information about where a person is looking when issuing a voice command and applies that information to the cooking experience.

From the project page:

We have been exploring the use of computer-vision based sensing as context, and for this cooktop demonstration we augmented the VUI using gaze tracking to make what feels like a magical interaction. The cooktop infers which burner is being addressed in a voice command by using its camera tracking to know which burner you’re looking at. This way, when the system detects a person standing in front of it looking at a burner, commands can omit the burner designation, e.g. “turn that burner on,” or simply saying a level like “medium high.”

In the concept video, a user is cooking and says “Alexa, turn up the heat.” Using a camera that is built into the cooktop, Alexa is able to infer that the user is cooking because they are looking at the cooktop.

There’s no doubt that the ability to combine contextual understanding of what is happening in a room to power commands given to digital assistants like Alexa could create much more powerful potential “smart kitchen” user scenarios. One could easily imagine combining other information to create more contextually relevant experiences, including facial recognition to, for example, apply a personalized knowledge base that understands a person’s cooking capabilities or their favorite recipes.

You can see the Hobgoblin demo in action below:

Hobgoblin Smart Appliance Interface | This New User-Interface Tech Isn't Just for the Kitchen

KloveChef Opens Up Voice-Guided Cooking Platform to Publishers

KloveChef, the voice-guided cooking startup cofounded by one of India’s biggest celebrity chefs in Sanjeev Kapoor, is opening up its platform this month to publishers wanting to add voice-guided cooking functionality to their recipes.

The new tool will allow anyone who has recipe content — chefs, cookbook authors, bloggers or food retailers — to upload their recipes to KloveChef’s platform via a web interface and it will convert them into a voice-guided recipes.

“We will democratize the interactive recipe creation and distribution,” said Bahubali Shété, KloveChef cofounder and CEO, in an interview with The Spoon.

Shété told me that recipe publishers will be able to use KloveChef to publish their recipes across a variety of voice platforms such as Amazon Alexa, Google Assistant, Google Home and Amazon Fire TV. To do so, they just copy the recipe URL or paste the full recipe into the web interface and KloveChef will convert into a voice-guided recipe.

Shété also said that publishers will have the option of letting users send their recipes posted on other web channels such as YouTube or Pinterest to their voice assistants for guided cooking.

KloveChef is opening up their voice platform after finding some success with their Alexa voice skill targeted primarily at home cooks in India. According to Shété, the guided cooking assistant has a total of 465,000 users and 100,000 monthly active users.

Shété says publishers can make money through KloveChef if the recipe is converted into a shopping list. The recipe-to-shopping list feature, which KloveChef has been testing through its app in India, currently has over 1 million recipes converted into shopping lists via voice search.

I have to admit, I like the idea of self-publishing recipes to voice platforms. It reminds me of the early days of ebooks, when authors would use technology from early pioneers like Smashwords to put their books into the world and on other popular platforms. Perhaps not all that surprisingly, just as like those early days of ebooks, recipe self-publishers are relying on Amazon to reach the end consumer, only instead of Kindle this time it’s Alexa.

It’s too soon to see how successful KloveChef will be in attracting cooks for its voice guided recipe assistant outside of India. In its home market, they’ve been able to leverage the large reach of Kapoor, while here in the states, Alexa tends to favor its featured partners such as Food Network or Tasty. KloveChef will have to compete with the algorithm-favored partners through attracting recipe publishers such as popular food bloggers or food retailers with built-in audiences to accrue a sizeable user base.

Looking forward, the company hopes to also attract users by making the platform better over time. One of the early features will be adapting guided cooking where users can speed up a recipe or slow it down depending on their experience. The company plans to release the new capabilities by mid-August.

KidKraft’s New Toy Features a Smart Kitchen and Market Powered by Alexa and RFID

Perhaps we’ve been going about the roll out of the smart kitchen all wrong. Instead of debuting new, fully functioning–and expensive—smart fridges every year, we should just sit back and let KidKraft work its magic.

Last week at Toy Fair, KidKraft announced its Alexa 2-in-1 Kitchen and Market. That’s right, the wooden kitchen playset filled with wooden pans and fake food you remember from pre-school is getting an upgrade with digital voice assistance and RFID tags.

Like the name says, there are two parts to this playset, a market to buy things and a kitchen. But you actually have to provide your own Alexa device (presumably a cheap one you don’t mind getting banged around).

Alexa will work a little differently in the KidKraft playset. Instead of needing to say “Alexa” (which, if you have a kid and an Alexa, you know can get real annoying real fast), the smart speaker perks up when RFID tagged elements are placed in various places. As CNet reported from Toy Fair, place a hot dog in a pan on the stove and Alexa will respond with cooking noises. Or in another example, if a child “buys” lettuce, Alexa will suggest they make a salad with other ingredients.

The KidKraft playset will also play games and even tell dad jokes, which, as a dad, I am fine with.

There are, of course privacy concerns around bringing a smart speaker directly into the center of your child’s play. Amazon has not always proven to be the best protector of your privacy when it comes to the ubiquitous assistant.

But as with so many things in our connected age, your concern mileage may vary. You also have a more time to think about it as the KidKraft Alexa playset won’t go on sale for $300 on Amazon until next year.

But if you do choose to get one, don’t be surprised when you child starts expecting those same smarts (and dad jokes) in your real kitchen.

Food Tech News: KFC Canada Partners with Alexa, Blockchain and a New Peanut Allergy Drug

Pat yourself on the back — you made it to February. We’re in the thick of winter and here at The Spoon we’re busier than ever reporting on news and prepping for our Customize food personalization summit (you’re coming, right?)

But there’s always time for food tech news! Here are a few interesting stories from around the web this week: an Alexa skill that lets you talk to Colonel Sanders, food safety blockchain, e-grocery funding and a new peanut allergy drug. Enjoy!

KFC Canada unveils new Alexa skill
This week KFC Canada announced a new Alexa skill which allows users to chat with and reorder fried chicken from… the Colonel himself. The fast food chain teamed up with AWS to develop the skill, which uses AI to turn text into speech that sounds like the voice of Colonel Sanders. According to a release from KFC Canada, KFC is the first global QSR to use this text-to-speech technology. 

Photo: Neogen

Neogen partners with riope.io for food safety blockchain
Neogen Corporation, an international food safety company, is partnering with blockchain-for-food startup Ripe Technology (creators of ripe.io). Neogen will use ripe.io to create a blockchain to track food safety diagnostics and animal genomics for their customers. The company hopes that incorporating blockchain will help customers verify the authenticity of their food products and lead to increased transparency and traceability. 

FDA approves drug for peanut allergies
Those who suffer from life-threatening peanut allergies may soon be able to breathe a little easier. US health regulators have approved the first ever drug for peanut allergies. Called Palforzia, the oral drug works by slowly ramping up exposure of peanut protein to desensitize allergy sufferers. It’s specifically meant for children and teenagers.

E-grocery Supermercato24 raises €11 million (~$12.1 USD)
Supermercato24, a Milan-based e-grocery marketplace, announced that it had raised  €11 million (~$12.1 million USD), bringing its total funding to €28.4 million ($31.2 million USD) (via EU Startups). The round was led by DIP with participation from current investors 360 Capital Partners, Innogest and more. On Supermercato’s online platform, users can shop for groceries from local supermarkets, which will then be delivered to their door. With its new funds, Supermercato24 will expand its operations throughout Italy and Poland, where it’s already available, and grow into new countries. 

Amazon: Instant Pots, Avocados and, of course, Amazon Devices are Big Sellers This Year

In what is becoming its own holiday tradition, Amazon sent out a press release this week explaining how Amazon and Amazon devices in particular crushed it this past Cyber Monday.

In Amazon’s typical vague fashion, the company didn’t release any hard numbers, saying only that “Customers purchased millions more Amazon Devices compared to the same period last year in Amazon’s Stores globally and the best-selling items were Echo Dot and Fire TV Stick 4K with Alexa Voice Remote.”

It’s no real surprise that the biggest e-commerce site in the world could pull levers and buttons on its biggest shopping day of the year to generate millions of sales of its own products. But if we look back, during last year’s Cyber Monday holiday weekend, Echo Dot was also a big seller, with millions of Echo devices sold. And in 2017, Amazon said that over that entire holiday shopping season that it had sold tens of millions of Alexa devices.

In short, dominance perpetuates itself, and with Amazon owning 70 percent of the smart speaker market, its dominance doesn’t seem to be going anywhere anytime soon. For the smart kitchen, this means appliance makers will continue to bake Alexa capabilities into their devices, which will beget more sales of Alexa-enabled devices, and the cycle continues.

Quick sidenote: It’s interesting to see Amazon’s wording evolve over the past three years. In 2017 it was “Alexa” enabled devices. In 2018 they were “Echo” devices and this year they are “Amazon” devices. This evolution is a reflection of how Amazon has broadened its first-party offerings with items like the Fire TV devices and Ring connected doorbells and lights.

But it wasn’t all Amazon, Amazon, Amazon this holiday season. The company also announced its “Best of Prime 2019” this week and among the winners were Instant Pot and… avocados.

The Instant Pot (which merged with the maker of Pyrex earlier this year) is indefatigable. Amazon said it has been a top seller for the past three years, and the Instant Pot DUO60 was among the most gifted items by Prime members this year as well.

And while it really didn’t provide any other context or numbers, Avocados were also a big seller throughout 2019 for Amazon Prime members as well.

OK. Sure.

This is just the first round of Amazon’s “Aren’t We Great?” press releases. Expect another after Christmas as well, telling (in vague terms only) how many millions of devices it sold throughout this holiday season.

Alexa Adds Thousands Of Buzzfeed Tasty Recipes To Echo Show

This week Amazon and Buzzfeed announced a partnership that brings thousands of Buzzfeed Tasty’s famous quick-play social videos to Amazon’s video-enabled digital assistants.

According to email sent to The Spoon, here’s how it works: First ask Alexa to find a recipe by saying something like, “Alexa, find pork recipes from Tasty.” Alexa will then show you options, and you can tell the device which recipe to select by saying something like, “Alexa, select recipe number three.”

From there, say, “Alexa, start recipe” and Alexa will read off each step in the recipe as well as list them on the left-hand side of the screen of the Echo Show. It will also show a looping video of the recipe on the right. You can also ask Alexa to read off ingredients by saying “Alexa, read ingredients” and add it to a shopping list by saying “Alexa, add to shopping list.”

I wish I could tell you how well it works, but at the time of this writing I couldn’t get either of my Echo Show devices to actually find Buzzfeed Tasty recipes. The new feature is supposed to be available to anyone in the U.S. with an Echo Show as of this week, so I assume I will be able to access the program over the next few days as the kinks are worked out.

Too bad, since I am very curious about how well turning a Buzzfeed Tasty recipe into a more instructional/step-by-step format on a screen will work. Like many, I’ve watched a lot of Buzzfeed recipes online but have never actually cooked to one of them, in part because they seem designed more for entertainment than to be functional. Putting them onto the Echo Show could change that, so I’ll update this post once I can actually cook with one.

One thing that struck me about this integration is that it is simply turned on and available to work (once it works) for anyone with an Echo Show. This is different from earlier Alexa Echo Show integrations like that of Allrecipes, which required the user to add as an Alexa Skill.

My suspicion is that Amazon is having trouble getting people to add new skills to their voice assistants, so at this point the company is, in some cases, just doing it for the consumer. Makes sense, actually, since a “cloud computer” like Alexa isn’t exactly short on storage. That and it just seems a bit more magical if you one day could just ask Alexa to do something and she does it rather than going through an “add skill” extra-step.

I am also curious how the “add to shopping list” feature works. This news follows an integration with Walmart (via shoppable recipe platform Northfork) that allows Tasty app users to make recipes shoppable by adding them their Walmart shopping lists and online grocery carts. The Alexa/Tasty integration doesn’t quite look like it takes recipes all the way to the Amazon cart, but if I know Amazon, I expect that will eventually change.

SideChef Launches Guided Cooking Integration With Bixby, Samsung’s AI Assistant

This week, SideChef announced an integration with Samsung’s intelligent voice assistant Bixby. The partnership centers around the launch of a voice-activated guided cooking capsule (capsules are Samsung’s equivalent to Amazon Alexa skills) which will give users of Bixby-powered mobile phones access to approximately 15 thousand recipes, most with step-by-step video-powered cooking instructions.

From the news release:

“Users can hone in on the exact recipe they would like by adding natural language constraints, such as dietary restriction, cuisine type, and even specific ingredients. Once a recipe is selected, SideChef provides video instruction through Bixby to guide home cooks through the entire recipe preparation process, from start to finish.”

While Samsung’s voice assistant doesn’t quite have the same degree of loyal usership as, say, Google Assistant on mobile phones or Amazon Alexa in the home, it is installed on a whole lot of Samsung products. Last year Samsung CEO D.J. Koh declared that the company’s AI assistant could reach a total of 500 million devices if it were to be installed on every Samsung device.

Of course, to reach that massive audience, SideChef’s new capsule would then have to be installed by the consumer, who will be able to find it on the Bixby Marketplace (Samsung’s “app store” for Bixby Capsules). Samsung launched the marketplace in mid-2019, and the newness of the store may actually play to SideChef’s advantage as theirs is probably one of the few recipe-centric voice apps and most likely the only guided cooking capsule on the still relatively bare shelves of the Bixby marketplace.

This move comes a year after SideChef launched on Amazon’s video-enabled Alexa devices, the Alexa Echo Show and Echo Spot, and just a couple months after the smart kitchen software startup announced an integration with Haier’s smart fridges at IFA 2019. While it isn’t immediately clear if the Bixby integration will put SideChef on Samsung Family Hub refrigerators, I would expect that will happen sooner rather than later.

Finally, while SideChef continues to rack up appliance partnerships, the company is also beginning to explore partnerships with big CPG brands. Last month the startup partnered with Bacardi through its Alexa integration to enable step-by-step drink mixing.  This trend of food brands integrating with smart kitchen software platforms isn’t limited to SideChef, as SideChef competitor Innit announced a partnership in September with Mars through a Google Lens integration that will enable both guided cooking and personalized meal and nutrition recommendations.

How Sevenrooms Is Making Voice Tech the Centerpiece of Restaurant Operations

If you are a restaurant in 2019, one of your most valuable assets is your customer data: what they order, how much they spend, whether or not they hate parsley. There are numerous tech platforms nowadays to help restaurants access this mountain of information, but historically that’s meant handling a tablet or mobile device along with all the other items restaurant staff juggle.

Guest-management platform Sevenrooms wants to change that by making it possible to access vital customer information using your voice.

The NYC-based company’s software platform already lets restaurants track customer data points in real time and access that information quickly to provide guests with more personalized service. Now the company is doubling-down on voice tech, which it believes will be the key tool for collecting and inputing customer data into restaurant systems of the future.

The company, who has raised $21.5 million to date, received an investment for an undisclosed sum from the Amazon Alexa Fund in late 2018 and has been working on an Alexa skill ever since to help restaurants access customer data faster and more seamlessly, and without having to use their hands.

“That’s a thing that would have originally required a GM to be looking down at a tablet or some form of screen,” Allison Page, Sevenrooms’ cofounder and Chief Product Officer, says over the phone of getting customer data. “And Alexa’s going to make it so much easier to get [that information] hands free in the middle of service so they don’t have to interrupt that hospitality they’re providing.”

So long as a guest’s information is stored in the restaurant’s system (via, for example, a loyalty program), Alexa can access that information with a simple voice command. For example, a GM could ask Alexa who is sitting at Table 5 and be told it’s a local customer who’s spent a total of $5,000 at the restaurant over the course of time and is celebrating an anniversary that night. The GM could then send over a giftcard, dessert or some other token of appreciation for the guest that would both personalize their experience that night and, hopefully, keep them coming back.

In certain settings, it might seem superfluous to add a voice layer to a system. But restaurants are inherently chaotic settings where multitasking reigns supreme and staff quite literally have their hands full most of the time with trays of food that could easily be spilled and damage a touchscreen device. Going hands-free with voice-enabled technology is potentially a far more seamless way of integrating guest management into a restaurant’s system. Page says the skill can also tell a user things like how much revenue a restaurant has booked that night and how that number compares to previous nights, if a guest has dietary restrictions, and even if they wrote any recent reviews of the restaurant.

The system also works the other way around. If a server or GM learns, for example, that a guest just moved to the neighborhood, they can tell Alexa to input that data into the guest’s profile to store as information for future visits.

All of this can be done without the user ever having to log into the Sevenrooms system, and that’s at the heart of Sevenrooms’ Alexa integration: bringing tech into the restaurant without letting it take over a la tablet hell.

Page demonstrated this at the 2019 NRN show by donning a pair of Alexa-enabled glasses and showing the audience how she could ask the skill questions about a restaurant guest and have the information appear right on the lens.

Whether its glasses, watches, or some other wearable device that’s the future of voice tech is yet to be determined. While voice tech in the restaurant has gotten a lot of press lately thanks to McDonald’s acquisition of Apprente, it’s still early days for the technology’s place in restaurants, and there are still challenges to work through. For example, Page says one of the current hurdles for Sevenrooms is getting Alexa to properly understand voice commands and questions in the middle of a noisy dining room. The company is currently working with Amazon on solving this issue.

There’s also the question of whether restaurants will sign up for yet-another piece of tech, and one they can’t even put their hands on. Page doesn’t seem terribly concerned about this, however. As she sees it, the benefits of “not having to take your eyes off the dining room and not having to take your eyes off the guest” will prove valuable enough to the customer to justify making voice tech a central part of a restaurant’s guest management system.