Close Ad

The Spoon

Daily news and analysis about the food tech revolution

Simbe Robotics

Grocery Robot Specialist Simbe Robotics Patents System to Detect Produce Freshness

Whether it’s to carry groceries around the store or to deliver them to our front door, it won’t be too much longer before everyday shoppers see robots both in and around the grocery store.

But one potential interesting new use-case for in-store robotics we haven’t heard much about is for detection of produce freshness. That may change soon, as Simbe Robotics, the maker of the Tally 3.0 robot, has just been issued a patent for spectral imaging of produce and meats and detect how fresh they are.

The US patent, which is number 11,200,537 and titled “Method for tracking and characterizing perishable goods in a store,” uses computer vision to record images across a period of time and derive a set of characteristics specific to the type of food. For produce, it can assign a percentage of ripeness, determine whether it is under, over, or at peak ripeness, and determine if there is other biological matter such as a contaminant on the food. It can also determine whether a fruit or vegetable is rotten, damaged, or bruised.

Figure from Simbe Robot’s New Patent

From the patent:

The computer system can access and implement hyper-spectral template histograms or template spectral profiles for “underripe by three days,” “underripe by two days,” “underripe by one day,” “ripe,” “overripe by one day,” “overripe by two days,” “spoiled or rotten”, and “moldy” for specific varietals of fruits and vegetables or for fruits and/or vegetables generally. Similarly, the computer system can access and implement hyper-spectral template histograms or template spectral profiles for “fresh,” “rancid,” “low-fat,” “moderate-fat,” “high-fat,” “low-water content,” “moderate-water content,” and “high-water content” for specific varietals of meats or for meats generally.

For those unfamiliar with the Tally 3.0 robot, the company first unveiled its latest in-store mobile grocery robot in October of 2020. The robot, which wanders grocery store aisles to monitor product levels and detects misplaced items, utilizes computer vision and AI algorithms to capture and provide data to store managers more quickly without needing to send as much information to Simbe’s cloud platform.

This type of mobile inventory checking technology is valuable enough, so much so that grocers like Schnucks have already started deploying the robot across the entire chain of stores. Others, like Hy-vee, are in trials with the Tally 3.0 and likely will expand their fleets over time.

As Simbe’s robots add the capability to help grocers fight food waste – one of the most significant cost drivers for the notoriously thin profit margins in the grocery business – chances are we’ll see more grocers adopt in-store inventory robots en masse.

Schnuck Markets to Deploy Simbe Shelf Scanning Robot to All of its Locations

Schnuck Markets announced today that it will be deploying Simbe Robotics‘ Tally shelf-scanning robot to all of its 111 locations across the U.S. This builds on the existing agreement between the two companies, which currently has Tally bots in 70 percent of Schnucks stores.

Simbe’s Tally robot is an autonomous shelf-scanning robot used to monitor a stores inventory. The robot traverses up and down aisles, using computer vision and AI to scan shelves and detect when a product is running low or has been misplaced. Tally can also monitor other issues such as pricing to ensure that sales and promotions are being executed properly.

Validating in-store inventory is more important than ever as people continue to shop for groceries online. Stores need to be more aware of what is in stock to accommodate both in-store shoppers, and customers selecting items online (where they can’t physically see store shelves or ask staff if there is more in the backroom). By automating inventory checks, Simbe says that retailers can get more accurate data and act faster to prevent out-of-stocks. In the press announcement today, Simbe said that Tally enables a 20 – 30 percent reduction in out-of-stock items.

Worth noting is that Schnuck Markets is expanding its use of shelf-scanning robots almost a year after Walmart gave up on them. Last November Walmart made headlines when it announced it was no longer using Bossa Nova’s robots to manage inventory. It was reported at the time that Walmart had found what it considered easier ways of managing inventory than using the robots.

Other retailers, however have put in-store robots to use. Giant Eagle was trialing Simbe’s Tally as well, and Woodman’s Markets was testing Badger Technologies’ robot at its stores across the Midwest.

Simbe Robotics Announces New Tally 3.0 Shelf-Scanning Robot

Simbe Robotics today announced the Tally 3.0, the company’s latest generation of inventory management robot that now features better optical capabilities and more computing power on the edge.

Simbe’s Tally is an autonomous robot that wanders grocery store aisles to monitor product levels and detect misplaced items. By automating this task with robots, Simbe says stores get a more accurate, closer-to-real time snapshot of on-shelf inventory to make more informed stocking decisions.

Improvements to the Tally include added Intel RealSense depth and RGB cameras to help the robot “see” more products on shelves and stacked in coolers. The new camera system can read data from up to 30 inches away, which, according to the press announcement, brings the robot’s recognition accuracy to almost 99 percent without needing to slow down.

The Tally 3.0 has also pushed its computer vision and AI algorithms to the device itself. By running this additional processing on the edge, the new Tally can capture and provide data to store managers more quickly without needing to send as much information to Simbe’s cloud platform. This can be especially helpful for stores that may not have a lot of internet bandwidth at their location.

Simbe claims that its Tally detects up to 10x more out-of-stock items than manual audits, and averages a 20 percent reduction in out-of-stock items at the store level.

Brad Bogolea, Simbe Robotics Co-Founder and CEO,told me by phone earlier this month that his company saw a massive uptick in interest around August and September, spurred in part by the COVID-19 pandemic and subsequent panic buying outages. As Bogolea explained to me during an interview in August, stores experienced those outages because of bad supply chain data. As we wrote then:

The bad supply chain data, according to Bogolea, is a result of the manual inventory checks that stores currently carry out. If robots are used, shelf inventory count is more accurate and up to the minute (basically) because the robots can run multiple shelf audits throughout the day. More accurate data means that stores can respond faster when there is a sudden run on particular products to speed up replenishment.

While Bogolea obviously has a horse in this particular race, we’ve definitely seen broader adoption of robots to help maintain retail inventories. Bossa Nova’s shelf-scanning robot is being deployed to 1,000 Walmart locations, and Badger Technologies’ robot is being used at Woodman’s Markets across the Midwest.

Schnucks Markets recently announced that it expanding the use of Simbe’s Tally to 62 of its locations, and Giant Eagle is trialing Tally as well. Simbe offers the Tally for a monthly subscription costing between $2,000 and $4,000 a month per store, depending on the number of stores. Though when I spoke to Bogolea this month, he said that through better sensor technology and improved manufacturing, the company is continuing to bring that cost down.

Schnuck Markets Expands Use of Tally, Simbe Robotics’ Shelf-Scanning Robot

Missouri-based regional grocer Schnuck Markets announced today that it is expanding its use of Simbe Robotics‘ shelf-scanning Tally robot. Tally will be rolled out to an additional 46 stores, bringing the total number of Schnuck locations using the robot to 62.

Tally is a tall, autonomous robot that roams store aisles and uses a combination of computer vision and RFID to analyze on-shelf inventory. Simbe says that Tally is 14x better at detecting out-of-stock items than manual auditing, which results in a 20 percent reduction in out-of-stock items.

Schnucks first started using Tally in the summer of 2017 and expanded that pilot in 2018. It takes Tally about three hours to scan the roughly 35,000 products per store, but it helps give store managers a closer-to-real time assessment of store inventory throughout the day.

In-store inventory accuracy is perhaps more important than ever. The early stages of the COVID pandemic and subsequent panic shopping meant staples were out of stock at stores across the country. Even though those dark times passed and stores are back to being fully stocked, grocers are girding for the holidays and potential a virus resurgence over the coming months by stocking up.

When I interviewed him in August, Brad Bogolea, Co-Founder and CEO of Simbe Robotics, said that Tally can not only help with shocks to the system like what happened with the pandemic, but can also help provide more accurate inventory data for the increase in online grocery shopping. As anyone who has shopped for groceries online can attest, a big gap in inventory data means what you order may not actually be in stock when you pick it up at the store or it arrives by delivery.

Schnucks isn’t the only market that’s investing automation. Walmart is adding 1,000 Bossa Nova shelf-scanning robots to its workforce, and Woodman’s Markets is using Badger Technologies robots throughout the midwest.

In addition to Schnucks, Simbe is also working with Giant Eagle supermarkets here in the U.S. After an initial set up fee, Simbe makes its money by charging between $2,000 – $4,000 per month per store, depending on the size and number of stores.