Close Ad

The Spoon

Daily news and analysis about the food tech revolution

AI

Fresco Locks Up Deal To Bring Kitchen OS to Middleby Consumer Kitchen Brands

This week, smart kitchen startup Fresco announced it had struck a deal with Middleby to integrate the Fresco Kitchen OS platform across the cooking equipment giant’s residential portfolio, starting with high-end kitchen appliance brand Viking.

The first Middleby product line to incorporate the Fresco Kitchen OS platform will be the Viking RVL Collection. The RVL line, a new collection introduced this week that is more modern and tech-forward than traditional Viking lines, will incorporate the Fresco OS via a firmware agent residing on an integrated system-on-chip. In addition to the built-in Fresco firmware, which will power the connectivity to other Viking and non-Viking brands that use Fresco technology, the smart kitchen startup is also providing the appliance brand with a white-labeled Viking app. According to Fresco, they will also work on a smart recipe app for another Middleby brand in AGA(Middleby acquired AGA in 2015 and acquired Viking in 2012).

The move is a nice win for Fresco, in part because it is a validation of its revamped kitchen OS, which the company announced a year ago. The deal also adds a premium built-in appliance brand in Viking to its growing list of customers. The Irish/US startup, which got its start a decade ago with the launch of its connected kitchen scale, has been steadily chalking up wins over the past few years, including with Japanese microwave maker Panasonic and the once white-hot Instant Brands.

Middleby is interesting because it represents many other potential product lineups for integration. Not only are there other built-in appliance brands like AGA, La Cornue, and Rangemaster for Fresco to expand to, but the company also has a couple of outdoor grills as well as a countertop cooking brand in Brava. For its part, Brava was not mentioned as an initial target for the Fresco technology, but my guess is that has as much to do with the complex and fairly unique commands associated with the Brava light-cooking technology as anything.

I asked Fresco CEO Ben Harris how his company has continued to grow its partner list in the connected kitchen space, and he pointed towards the system-on-chip in his hand, which featured an Espressif ESP 32 DSP. According to Harris, Fresco’s hardware engineering and silicon understanding, born almost a decade ago when the company introduced the Drop scale, has helped them win customers looking to take advantage of their technology and their knowledge in this space.

Harris said that having on-chip, on-board integration of a kitchen tech stack via their kitchen OS SoC module is not only a good way to on-board a customer like Viking, it also results in a faster system. Harris said that in the early days, when they went from building cloud-to-cloud integration between smart kitchen equipment from different manufacturers to integrating their own SoC with built-in firmware, the quickly saw how much more responsive and fast the system performed.

“It was like that, in an instant,” said Harris in an interview with The Spoon at KBIS. “It definitely feels like it’s an extension of the appliance, and it makes a big difference in the engagement of the user.”

In addition to partnering up for a product integration, the two companies also announced that Middleby will become an investor in Fresco. In this sense, the deal is somewhat reminiscent of the Instant Brands partnership, which had the pressure cooker maker investing in Fresco at the time of the deal.

You can watch my interview with Harris at KBIS below:

Interview With Fresco's Ben Harris on Connected Kitchen Technology at KBIS 2024

Check Out NXP’s Presence-Sensing Cooktop Demo Powered by On-Chip AI

We’re still sifting through some of the cool product demos from CES last month, and one that caught my eye was the demo by NXP of a presence-sensing cooktop powered by an embedded MCU. According to the company, the system used a Neural Processing Unit that runs the machine learning and facial-recognition algorithms within the system rather than relying on a cloud-based compute. The demo featured a device control interface from Diehl Controls.

As can be seen in the video below (taken by TIRIAS Research Principal Analyst Francis Sideco), NXP spokesperson Thomas Herbert shows that you can turn on the burner with either touch or motion sensing (including motion sensing with cooking mitts on). From there, the system is using facial recognition to detect if a person is within local proximity of the cooktop. According to Herbert, presence detection comes into play in a scenario where there is a critical state, such as the pan getting too hot and there is water boiling over. If the system detects a critical state and no one is standing around the stove, it will shut off the heat and can send an alert to the person via a Matter (an open-source smart home connectivity standard) enabled device to alert the cook that the system has intervened on their behalf.

CES 2024 - INVITE ONLY- Part 3 of 3 NXP Autonomous Home Showcase Based on Matter

The demo is interesting to me in a couple of contexts. One is that, as we’ve written about here on the Spoon, the number one reason for fires in the home is due to cooking mishaps, and enabling your stovetop or other cooking appliances to recognize both anomalies as well as the presence of someone could be a real gamechanger, akin to the dip in automobile accidents in recent years due to the widespread prevalence of blindspot detection systems in modern cars.

The second context that’s interesting is that it could become a significant technology in assisting aging-in-place scenarios, particularly for seniors who become a little more forgetful as they age. One of the key determinants of whether folks can continue to live independently is their ability to feed themselves, and by providing “blind spot” detection like this, my guess is this could extend many seniors’ ability to live independently for years.

Chris Young: Generative AI Will Provide Big Payoffs in Helping Us Cook Better, But Overhyping It Will Burn Some Folks

Chris Young has never been shy about providing his thoughts about the future of cooking.

Whether it was on stage at the Smart Kitchen Summit, on his YouTube channel, or a podcast, he’s got lots of thoughts about how technology should and eventually will help us all cook better.

So when I caught up with him last week for the Spoon Podcast, I asked him how he saw things like generative AI impacting the kitchen and whether it was necessary for big appliance brands to invest in building out their internal AI competencies as part of their product roadmaps for the next decade. You can listen to the entire conversation on The Spoon podcast.

I’ve excerpted some of his responses below (edited slightly for clarity and brevity). If you’d like to listen to the full conversation, you can click play below or find it on Apple Podcasts or wherever you get your podcasts.

On the resistance by some to using advanced technology to help us cook better:

Young: “A lot of people are focused on going backward in the kitchen. They want to go back to cooking over charcoal and cooking over fire. That can be fun, but if you look back at what it was really like in the 19th century, the kitchen was not a fun place to be.”

“The modern kitchen is much healthier and much safer. And it does a better job of cooking our food. But we’ve kind of stalled, in my opinion, for the last couple of decades of really innovating and creating a compelling vision of what the future of the kitchen can be. I think the idea that our appliances are too stupid to know when to turn the temperature up or down to cook my food correctly is bizarre in the modern world where sensitive, high-quality sensors are cheap. And we have unlimited compute and AI now to answer a lot of these questions that humans struggle with, but I don’t see the big appliance companies or the incumbents doing this on their own. So, my small contribution was to create a tool that measures temperature and makes it very easy for people to do things with those measurements.”

On why it’s important to create a vision for the future of a technology-powered kitchen:

Young: “My criticism with a lot of people in this space is they haven’t sold a vision of what the future of that your kitchen could be like that resonates with people, that feels human, that makes it a place I want to go that is forward-looking rather than backward-looking. The kitchen of the 1950s, the kitchen of the 1920s, feels more human, feels more relatable, and I think people want that. It’s not to say you can’t create a forward-looking vision of a kitchen where it’s easier to cook food, it’s easier to bring people together and have everything work out right, but nobody’s really creating that vision.”

Combustion’s thermometer runs its machine-learning calculations on the chip within the thermometer rather than in the cloud where many AI compute happens. Young explains how – and why – they made that possible:

Young: “One of the crazy challenges was this is some pretty hardcore math. I think even we initially thought, ‘Oh, we’re gonna have to run this on the cloud, where we essentially have unlimited compute to run these fairly sophisticated algorithms.’ But we have some very clever software and firmware people on our team who have a lot of experience doing these kinds of hardcore machine-learning algorithms. And we were able to basically figure out some clever trick techniques to get the stuff running on the thermometer. The benefit is that it means the thermometer is always the ground truth; if you lose a connection, if you walk too far away, or if Bluetooth gets interrupted, or if any of that happens, the thermometer doesn’t miss a beat. It’s still measuring temperatures, it’s still running its physics model. So as soon as you reconnect, the results are there, and nothing has been lost.”

Young on the benefit of generative AI:

Young: “In the short term, AI as it’s being marketed is going to be disappointing to a lot of people. It’s going to burn some people in the way that IoT burned some people. But there’s going to be meaningful things that come out of it.”

“…When I was playing with ChatGPT 3.5 and I would ask it cooking questions, the answers were mostly garbage, as judged from my chef perspective. When GPT 4 came out, and I started asking some of the same questions, the answers were actually pretty good. I might quibble with them, but they wouldn’t completely fail you and they weren’t garbage. And if you modified the prompt to rely on information from Serious Eats, ChefSteps, or other reputable sources, all of a sudden, I might have given you a different answer, but it’s not necessarily better. And in many cases, what people want is a good enough answer. Building those kinds of things into the cooking experience where, when you run into a problem, or you’re confused about what this means, something like the Crouton app, or the Combustion app, or a website can quickly give you a real-time good enough answer, that actually solves your problem and keeps you moving forward and getting dinner done. Those I think will be really, really big payoffs, and that stuff’s coming.”

Young on whether big food and appliance brands should invest on building their own AI internal competency:

Young: “It’s hard to give advice when that’s not my business. But I have a few observations from having worked with these companies. It’s very hard to sustain a multi-year effort on something like an AI software feature. For these companies, that culture doesn’t exist, the way of thinking about the long term payoff of software tends to not be a strength of these companies. And so while they have the resources to go do this, the willingness to make those investments and sustain them, for years and years and years, and learn and iterate, that hasn’t proven to be their greatest strength.”

“I think that is kind of why there was an opportunity for Combustion, and for a company like Fisher Paykel (ed note: Fisher Paykel has integrated the Combustion thermometer to work with some of their appliances) to recoup the millions and millions of dollars, we’ve invested in the AI in our algorithms team. (Fisher Paykel) could maybe build the hardware, but doing the software, investing in the hardcore machine learning research, I think it would be very hard for them to sustain that effort for three or four years when they’re only going to maybe sell 12-25,000 units a year. We’re in a much better position because we can spread it across the entire consumer base.”

“And so I think you’re going to see more partnerships emerging between the big appliance companies that can provide the infrastructure, the appliance that’s got ventilation over it, that’s plugged into a 240 volt, 40 amp or 50 amp circuit. They’re going to be very good at that. If they basically open up those appliances as a platform that third-party accessories like the predictive thermometer can take advantage of, I think over the long term, they actually take less risk, but they actually get a market benefit.”

“Because as more small companies like Combustion can get wins by integrating with these appliances inexpensively and easily, making our products more useful, I think you’ll start to get a lot of things like the rice cooker no longer has to be a dedicated appliance that you put in a cabinet. Instead, it can be a special pot that goes on the stove. But now it can communicate with the stove to do what a rice cooker does, which is turn the power on and off at the right time. And now a lot of these small appliances can migrate back to the cooktop, they can migrate back into the oven.”

If you want to hear the full conversation with Chris Young, you can click play below or find the episode on Apple Podcasts or wherever you get your podcasts.

Jersey Mike’s Jumps on the AI-Voice Order Bandwagon as it Deploys Soundhound to 50 Locations

The AI-voice bot customer service wave is coming at us fast, and the latest chain to roll out the technology is the sub-sandwich chain Jersey Mike’s.

Soundhound announced this week that Jersey Mike’s will deploy its voice AI ordering system to allow customers to place orders by phone. According to Soundhound, the AI has been trained on the entire Jersey Mike’s menu and can handle order placement and answer queries about menu items, specials, store information, and more, all while ensuring orders are taken accurately and efficiently.

The video below shows Soundhound’s Jersey Mike integration in action.

DEMO: Jersey Mike's Automated Phone Ordering System - Powered by SoundHound AI

Like many voice AIs, it sounds about 90% natural in action, but there’s still something of an Uncanny Valley stiltedness to it. Listening to the order, it seems to handle the natural conversation flow deftly, but I have to wonder just how nimble it is with various dialects and slang, which can be a natural part of incoming phone orders.

Soundhound, a company that’s been around since the mid-aughts and had focused on auto installations and music until its move into customer service interaction layers for restaurants and retail over the past couple of years, announced the acquisition of SYNQ3 Restaurant Solutions last month. At the time of the deal, Soundhound said the merger extended “its market reach by an order of magnitude to over 10,000 signed locations and accelerating the deployment of leading-edge generative AI capabilities to the industry.”

Soundhound isn’t alone in chasing fast food chains to provide voice AI customer service platforms. Par Technologies, ConverseNow, and OpenCity also offer third-party solutions, while some players, like McDonald’s, have brought voice AI in-house through acquisition.

After a decade of pushing towards digital ordering kiosks and new ways to serve customers in-store and through apps, AI-powered customer service layers have moved to the top of the list for many big chains, including Jersey Mike’s.

Dodo Pizza Trials ChatGPT-Powered Flavor Generator in App

Dodo Pizza, a thousand-store pizza chain that’s built a name for itself by experimenting with different types of technology, announced last week that it was trialing a new “In-App Flavor Generator” powered by ChatGPT. The new generator, which is only available for now in the Dubai market, allows customers to create personalized pizza flavors from 35 different ingredients.

Here’s how it works: The app’s flavor generator, which uses generative AI technology, presents users with a choice of ingredients, all of which can be combined in different ways, which Dodo says can result in up to 30 million potential flavor combinations. This feature is designed to cater to individual preferences and moods, enabling customers to experiment with unique pizza creations.

For the launch, Dodo Pizza expanded its ingredient list with 17 new items, including some pretty weird flavors like popcorn, duck, guacamole, melon, fruit loops, falafel, and pumpkin seeds. The app’s interface queries the user’s mood and preferences, with options like “movie night,” and from there, users can customize their pizzas by specifying dietary restrictions or ingredient exclusions, such as vegetarian-only options or the omission of onions, pineapple, or spices.

The company, which was founded in Russia and originally grew to become Russia’s biggest pizza chain (but now is headquartered in Dubai), recently brought on a new CEO in Alena Tikhova, while company founder Fyodor Ovchinnikov has moved into the executive chairman role. Under Ovchinnikov, the company gained a reputation for embracing technology early on (Dodo was the first pizza chain to experiment with drone delivery), and this latest move continues that trend.

According to Dodo, early trials have piqued customer curiosity. The company says the AI “pizza card” generates about three times the clicks of other menu positions. Dodo says they plan to roll out the AI pizza generator in other regions this year, including Southeast Asia and Africa.

January AI’s New App Uses Generative AI to Predict How Food Will Impact Your Blood Sugar

If you’ve been diagnosed with a metabolic health issue, you might have used a continuous glucose monitor (CGM) at some point to track the impact of your food intake on your blood sugar. However, as of March 2023, only 2.4 million people used a CGM in the U.S., and because of the relatively small adoption rate of this technology, the vast majority of folks with diabetes or who are in danger of metabolic health issues may not have access to real-time insights into what the impact different foods may have on their glucose levels.

January AI aims to change this with its latest innovation: a free app that performs predictive analysis on the impact of various foods on blood sugar. The company, which unveiled its newest tool at CES last week, has developed an AI-powered app that analyzes meal photos and offers users immediate feedback on glucose impacts, macros, and healthier meal alternatives.

January says its app uses generative AI to automatically generate accurate food titles and estimates of ingredients and ingredient quantities within complex meals.

“It uses three kinds of generative AI to tell you your blood sugar response,” said Noosheen Hashemi, CEO of January, speaking at The Spoon’s CES Food Tech Conference last week. “It uses our own generative AI for glucose, and then it uses a vision generative AI to pick what’s in the food, and then it uses that language model to give it a title.”

According to the company, its AI-driven predictions are based on millions of data points, including wearable data, demographic information, and user reports. The company says this approach enables the app to provide personalized glucose level estimates and insights, making metabolic health management more accessible and actionable.

“It’s as simple as scanning a food,” said Hashemi. “You can also scan a barcode. You can also do a search. And we can tell you all the macro, its total calories, how much fiber, protein, fat, and carbs it has. And we can also show your blood sugar.”

According to Hashemi, the company’s platform can be customized and trained for specific users by taking data from a wearable such as a smartwatch, a person’s glucose monitor, or even food logs. With that data, the app can create highly customized predictions around a person’s biomarkers and dietary preferences.

“One out of three people in America has pre-diabetes, and 90% of them don’t know it,” said Hashemi. “And one out of nine people has diabetes, and 20% of those people don’t know it. So blood sugar is something we should all be managing, but we just don’t know that we should.”

Given the increasing popularity of GLP-1 medications, my guess is that more Americans will start to consider how their diet affects their blood sugar in the coming years. And, even if they don’t use a glucose monitor or get a prescription for a medication like Ozempic, increased awareness will push many to use apps like this one to help them better understand how a given food will impact their blood sugar and overall health.

You can hear Hashemi discussing the app and showing a demo in the video below.

January AI CEO Talks About New Generative AI App at CES

Key Takeaways From The First-Ever Food AI Summit

Last week, we convened some of the leading voices in AI and food at the inaugural Food AI Summit in Alameda, California, to discuss how this technology is transforming the food industry.

The conversation spanned the entire food system, examining the impact of AI on farming, food development, restaurants, personal nutrition, and household use.

It’s All About The Data

Throughout the day, it became clear that one of the most significant drivers for achieving highly functional and powerful AI systems is building them around the right data. Once you’ve trained the AI on good data, the insights derived from these platforms will far surpass what was previously possible.

Erica Bliss, the Chief Operating Officer of Mineral, believes where AI will really excel is in aggregating ‘multimodal’ data into a unified, synthesized analysis.

“It’s about integrating satellite imagery, soil data, weather data, historical yield data, camera data, and scouting notes from someone walking the field. The real power is in aggregating diverse and complex data types,” she said.

The Biggest Advances Will Come From a Combination of Human Knowledge with AI

The question of whether AI can replace human knowledge and innovation was a recurrent theme throughout the day. Oliver Zahn, the CEO of Climax Foods, believes that AI will not replace human knowledge. Instead, he sees the combination of technology and humans as a game-changer.

“People have this romantic notion that we have an algorithm, and you just tell it to make whatever cheddar, egg scramble, and then it will just tell you exactly how to make it,” said Zahn. “It’s vastly more complicated than that. In many cases, the humans are actually much better than the algorithms. And in real life, I don’t think anybody will ever write an algorithm and create a data set that is rich enough to do that. The algorithms give us a little bit of an edge over traditional food science companies, and in some cases, they give us a bigger edge.”

Erica Bliss believes that while AI will increasingly help farmers at both a systemic and individual farm level, it will be the combination of AI and human knowledge that will form the “Iron Man suit” amalgamation of capabilities that will lead to transformational outcomes.

“There are things that humans are incredibly good at that AI is not good at,” said Bliss. “And so if you’re aiming to get the best yield forecast, it is really the human plus machine that’s driving a far better outcome.”

AI Will Power Much More Personalized and Accessible Health and Nutrition Advice

Noosheen Hashemi, CEO of January, which offers a personalized nutrition and glucose tracking platform, believes AI will empower individuals with chronic conditions like type 2 diabetes to better monitor and anticipate the effects of their diet.

“There are things we have done you simply cannot do without AI,” said Hashemi. “We can build a digital twin of a person using wearable data and user-reported data. We’re then able to predict their glycemic response to any of the foods in the 32 million food database. With AI, we can also give counterfactuals like ‘you ate this, but if you had eaten this, this would have been your response.'”

Looking forward, Ari Tulla of Elo Health thinks AI-powered coaches could make healthcare much more personalized and accessible.

“Today, we live in a world where a doctor has 10 minutes to half an hour a year for you,” said Tulla. “What if you could have a bot or somebody that can talk to you like your personal trainer at the tune of 30 to 50 hours a year? That could have a very big impact.”

AI Will Have An Impact at the Macro and Hyperlocal Levels

David Lee, the CEO of Inevitable Tech, believes that AI will not only address the challenges of increased production due to a rising global population and climate change but also aid in making individual farms more financially sustainable.

“Around forty percent of farms break even or do any kind of variable profit, which means most farms operate at a constant loss,” said Lee. “AI isn’t just about serving these big global problems like food security. I can also address the very individualistic, local problem, which is to create financial sustainability, local and specific, to the unit of a farm anywhere in the world.”

The First-Ever Food AI Summit Could Be The Start of Something Big

During his comments, Ari Tulla commented on the event itself, believing it could be the beginning of something big.

“I’ve been at those events where there are a hundred people in the room, and you know this is the beginning of something,” said Tulla. “Ten years from now, some of us will look back and say, ‘I was at the first Food AI Summit.'”

We sure hope so! Thanks again to our speakers, sponsors, and attendees for making the first Food AI Summit a huge success!

Yummly App Adds New Features, Reminding Us It’s Still Around Six Years After Whirlpool Deal

Today, recipe and guided cooking app Yummly announced a refreshed set of features, including what it describes as AI-powered recipe recommendations, an improved meal planner feature, and integration with an upgraded Yummly thermometer.

Since Whirlpool acquired Yummly, the recipe recommendation and cooking guidance app has largely flown below the radar while adding periodic incremental improvements over the years. And as far as I can tell, the announced improvements are par for the course.

This includes the new and improved “AI-powered recipe recommendations,” which sounds a lot like the things the company was promoting almost five years ago when they were touting “AI-powered personalization.” It’s not immediately clear how these AI-powered recommendations differ from previous AI-enabled recommendations, but we’ll have to take the company’s word for it.

The app’s improved meal planner function looks like it’s primarily focused on further building out a shoppable recipe function, something that has become relatively common in recent years for many recipe apps as a way to monetize through affiliate marketing commerce. The Yummly meal-planning shoppable recipe meal planning capability is a premium feature for users through a monthly subscription.

Whirlpool is hardly mentioned in the release (outside of the About Yummly boilerplate at the bottom), and the only real evidence of the company’s influence is the integration with an improved Yummly Thermometer, which is a product that Whirlpool has gone through pains to integrate with a number of their appliances. According to the announcement, the new Yummly thermometer now has three sensors, up from the two sensors in the previous generation.

While Whirlpool seems content to let Yummly operate mainly as a standalone app with its own brand, it seems a far cry from when the company acquired the app and saw it as driving the digital transformation of the appliance giant’s product lineup. Outside of a big splash at CES 2019, which the company described as a “roll-out across multiple Whirlpool brands,” the app hasn’t added all that much in terms of feature sets beyond what it had five years ago, and there’s been scant evidence of any further integration – thermometer notwithstanding – with the broader Whirlpool family.

One reason the app has become something of an afterthought in Whirlpool might be that many of the original stakeholders have moved on. Yummly founder Dave Feller left soon after the deal was done, and Brian Whitlin, who drove much of the product innovation, left in 2021. Add in the fact that the acquisition’s primary champion within Whirlpool, Brett Dibkey – who drove much of Whirlpool’s digital transformation – left in 2020, and the company’s current caretaker mode makes sense.

Scentian Bio Raises $2.1M for Tech is Says Can Replicate Insect Smell Receptors

Scentian Bio, a biosensor startup that claims to have blended nature and technology by leveraging the olfactory capabilities of insects to develop a powerful new sensory tool, announced a $2.1 million seed funding today according to a release sent to The Spoon. The company’s new investors, which include Finistere Ventures and Toyota Ventures, will join the Bill and Melinda Gates Foundation, bringing their total backing up to $4.4 million.

Scentian says their technology relies on virtualizing insect olfactory receptors (iOR), using AI to process and interpret signals from its biosensors to replicate an insect’s neuronal network to interpret smells. According to Scentian, their sensors are a thousand times more sensitive than a dog’s nose and have dozens of unique receptors that effectively recognize millions of virtual organic compounds or VOCs.

The company says they’ve been running a trial with a large unnamed food brand, and based on its early success in this trial, the company plans to focus on quality control for the food industry initially. This company’s first digital biosensor, which is expected to launch commercially at the end of 2024, will provide quality control of key food ingredients’ smell and taste attributes. The company will focus on essential oils and expand later to other ingredients.

The pitch is compelling, but the company doesn’t explain precisely how their technology replicates insect smell detection. It says they combine “insect smell receptors” with sensing surfaces that create “the most sensitive digital fingerprint for smell.” It sounds good, but I have to wonder if it’s just a colorful way to describe a really powerful electronic nose.

ScentianBio - Unlocking the Language of Life

Amazon Details Usage of Generative AI-Created Synthetic Data to Train Just Walk Out Technology

For a while now, we’ve known the basic gist of how Amazon’s Just Walk Out technology works: A combination of computer vision, machine learning, and other sensor data helps enable a friction-free shopping experience in which customers pick items off the shelf and walk out the door without ever having to stop at a cash register.

But in a recent blog post by Amazon’s retail technology team, the company explained how it all worked in greater detail than we’ve seen in the past, including how the company has been using generative AI to train its Just Walk Out platform for long-tail cases that are rare but entirely possible in the unpredictable environment of retail.

According to Gérard Medioni, vice president and distinguished scientist at Amazon, the company uses a generative AI called a generative adversarial network (GAN) to create synthetic data for training Amazon’s Just Walk Out technology. The Just Walk Out team used datasets from millions of AI-generated synthetic images and video clips mimicking realistic, and sometimes rare, shopping scenarios, including variations in lighting, store layouts, and crowd sizes. According to Amazon, this training using generative AI-created synthetic visual data enables Just Walk Out to recognize and properly interpret millions of customer actions.

“When the customer exits, having an accurate account of their purchases is critical,” Medioni said.

The company also went into detail about how Just Walk Out and its Amazon One palm-based bioauthentication technology does – and don’t – work together. According to Amazon, the two systems operate independently of each other, keeping a person’s biometric information associated with their payment separate from Just Walk Out. When a shopper enters the store, the Just Walk Out system assigns the shopper a temporary numeric code, which serves as their unique digital signature for that shopping trip. When a shopper exits, the code disappears. When they come back, they get a new code.

Medioni says that Just Walk Out associates a person’s “pixels” to the one-time payment code assigned for that trip and the products they pick up off the shelf.

“Just Walk Out tech doesn’t collect any biometrics. All we need to know is where that person is on the floor, and where their hands are in relation to the store’s merchandise.”

According to Medioni, the system is sophisticated enough to track groups of shoppers assigned to a single payment instrument, and the system can create a single receipt for a group shopping trip.

“We had a tour bus that came in one day, and they had 90 people all paying with a single credit card,” Medioni adds. “Even if people leave the store separately and we can still keep track of the group’s purchases.”

While Amazon has shown mixed signals regarding its retail footprint, the company appears to remain interested in developing its technology platform for usage by other retailers. My guess is they’ll likely see some smaller retailers and non-grocers (like stadiums/sports venues) adopt the technology, but larger grocers will remain reticent to jump on board with technology developed by a competitor.

If you’re interested in how generative AI will change food retail, join us at the Spoon’s Food AI Summit on October 25th in Alameda!

Meet The Dutch Robotic Kitchen That Makes Five Thousand Meals Per Day

Last month, a Dutch startup named Eatch announced they had built a fully automated robotic kitchen that makes up to five thousand meals per day. The company’s new robot, designed to work in a high-production centralized kitchen, has been making meals in the Amsterdam market for food service and catering giant ISS for the past four months.

The Eatch robotic kitchen platform handles the entire meal production flow. It oils the cooking pans, dispenses refrigerated ingredients, adds spices, plates the food, and cleans the cooking pans when everything is done.

You can watch it in action in the video below:

Eatch - World's First Robotic Kitchen for Large-scale Cooking - Up to 5.000 meals per day

Eatch’s robotic kitchen uses a pot system similar to those we’ve seen in the Spyce kitchen, Kitchen Robotics’ Beastro, and TechMagic’s pasta robot in Tokyo. The Eatch’s tilted pans rotate and toss the food inside, using an internal peg to push the food into a rotation and then drop from the top, creating a toss fry cooking motion common in stir fry kitchens.

What’s most impressive about the Eatch is the throughput, creating five thousand daily meals (and the company says it has the potential to produce up to 15 thousand per day), handling the entire production flow. Most robotic kitchens we’ve seen have production volumes much lower than this and often don’t incorporate plating and pot cleaning in the automation flow.

Company CEO Jelle Sijm told The Spoon that the company has approximately 10 employees and has raised €4.5 million. The company expansion plan includes working with partners who can handle the daily operations, and Eatch will provide the automation technology, software, and recipes. Sijm sees Eatch working with partners to produce food in centralized kitchens for contact caterers. Sijm says they are eyeing an American market entry and says the company is currently in talks with some grocery chains and contract caterers in the US.

With the Launch of Samsung Food, Samsung Hypes AI & Consolidates Food Features Acquired Over the Years

Over the years, Samsung has acquired and launched several products in an effort to become the king of the tech-powered kitchen.

First, there was the launch of the Family Hub refrigerator, the company’s attempt to create a smart fridge built around the company’s own operating system and packed with technology like fridge cams to identify food and help you with your shopping.

Then, there was the acquisition of Whisk, an intelligent food and shopping app that helped pioneer the shoppable recipe space. Whisk had not only amassed an extensive food database, which would ultimately become a foundation for some of Family Hub’s (now Bespoke Family Hub) shopping and recipe capabilities, but it also served up the foundational ‘Food AI’ that is now being pushed to the forefront by Samsung.

Then, there were various attempts to use AI through automation in the kitchen, as the company announced (and never released commercially) different cooking and kitchen-task robots at CES.

And we can’t forget that Samsung also took some of the smart home technology from its SmartThings smart home group (another Samsung acquisition) and paired it with Whisk’s recipe intelligence to create SmartThings Cooking, a guided cooking app.

This leads us to this week, in which Samsung announced what amounts to packaging up this collected knowledge and technology – save for (at least for now) the robotics – into a newly expanded app and platform called Samsung Food. Samsung Food, which the company describes as “a personalized, AI-powered food and recipe platform,” looks like a significant step forward for the company’s efforts to build a centralized digital food management app. It also is a logical move to consolidate much of the collected efforts under the Samsung brand after the company had collected a variety of platforms that served as a foundation for what we see today.

Let’s take a look at precisely what the company unveiled. In the announcement, Samsung detailed four primary areas of activity for Samsung Food: Recipe Exploration and Personalization, AI-Enhanced Meal Planning, Kitchen Connectivity, and Social Sharing.

For recipe exploration, Samsung looks like it’s essentially using what was an already somewhat evolved feature set in Whisk. Samsung says that it can save recipes to a user’s digital recipe box anytime and from anywhere, create shopping lists based on their ingredients, and is accessible via Family Hub. In addition to mobile devices, users can access Samsung Food with their Bespoke Family Hub fridges, which will provide recipe recommendations based on a list of available food items managed by the user and shoppable recipe capabilities.

With the Personalize Recipe function, Samsung Food looks like it builds on the personalization engine created by Whisk and plans to take it further through integration with Samsung Health. According to the announcement, by the end of this year, Samsung plans to integrate with Samsung Health to power suggestions for diet management. This integration will factor in info such as a user’s body mass index (BMI), body composition, and calorie consumption in pursuit of their health goals and efforts to maintain a balanced diet.

The AI-Enhanced meal planning feature looks like a longer-view planning feature that consolidates personalized recipe recommendations, and it will no doubt similarly benefit from the integration of Samsung Health.

With Connected Cooking, Samsung has rebranded and extended the features of the SmartThings Cooking app, adding new devices like the BeSpoke oven and incorporating some of the same guided cooking features.

And, of course, a consolidated food-related platform from Samsung wouldn’t be complete without a social media component. My guess is the Social Sharing feature – which will allow users to share with their community – is the least necessary addition to the app and will ultimately not be all that successful, as consumers will continue to use mainline social apps (TikTok, Instagram, Facebook) for their food-related social sharing.

The company also teased expanded computer vision capabilities in 2024 in the announcement. The company’s Vision AI technology “will enable Samsung Food to recognize food items and meals photographed through the camera and provide details about them, including nutrition information.”

Overall, I’m impressed with the overall cohesiveness and trajectory of what I see in Samsung Food. I think it’s a sign that Samsung – despite having the occasional misstep and strategic vagueness around their food vision – looks like they remain committed to becoming the leader of the future kitchen, something that they started way back in 2016 with the launch of the Family Hub line.