This past week in Japan, Sony unveiled a project they’ve been developing in secret called Roku Shoku, a culinary recording system designed to capture exactly how a chef prepares a meal. The system also serves as a guidance tool, helping casual or inexperienced cooks create dishes with the precision of an expert with years of training.
Sony has been working on this project, which stands for “Record” (Roku) and “Cooking” (Shoku), for the past five years. Last week, the entertainment and consumer electronics giant held the first-ever press demonstration of the recording studio for The Spoon team.
“We have a recording studio here in Tokyo,” said Tomoko Nomoto, Project Leader for Roku Shoku. “We invite Michelin-starred chefs, or even grandmothers, to the studio and ask them to cook with our system. We then record their culinary data, including temperature, steam levels, and the entire cooking process.”
The project is led by a Sony R&D team out of Tokyo and is separate from research in the area of gastronomy that has taken place at Sony’s AI Research division Sony AI (the formal Gastronomy program announced in 2020 has been sunsetted, but Sony continues to work on gastronomy-related projects). Since launching the Tokyo recording studio in 2021, the team has captured thousands of recipes across a range of cuisines, including Japanese, Chinese, French, Italian, and Thai.
The Roku Shoku system features induction cooktops with temperature sensors, scales to monitor and weigh ingredients, cameras to capture a chef’s movements, and an off-the-shelf game controller made by Steam to control the setup.
Nomoto shared that users can replicate meals precisely as chefs cook them, a claim I tested myself. You can watch me trying it in the video below.
According to Nomoto, the goal is to use Roku Shoku both to document recipes for restaurants and food service locations and to preserve culinary creations for future use.
“The first step will be to work with restaurants that want to share a consistent experience worldwide or recreate dishes that are no longer available, like when a chef passes away or retires,” said Nomoto.
Spoon readers might recall Cloudchef, another system that records chef creations. Nomoto explained a key difference: Sony plans for Roku Shoku to enable only human chefs to recreate these meals, while Cloudchef eventually aims to use robots for meal replication. Currently, both systems are focused solely on human use (see Spoon’s Tiffany McClurg using the Cloudchef system here).
Sony plans to roll out Roku Shoku in Japan in early 2025, with expansion to other regions to follow. The company has launched a website where you can find out more and request a demo.