Kawasaki, Japan – Toshiba Corporation has started two demonstration experiments exploring advanced energy conservation and security in its office in Innovation Palette, its state-of-the-art R&D facility in Kawasaki, Japan: an energy conservation demonstration that estimates people flows to provide optimal control of lighting and air conditioning; and a security demonstration that combines Toshiba’s video analysis AI with cocobo (*1), a security robot developed by SECOM Co. Ltd. Both demonstrations utilize an operational digital twin (*2), which recognizes spaces, people, and energy usage, using data collected from sensors and cameras to realize appropriate control and optimization of facilities. Through these experiments, Toshiba aims to develop practical technologies that contribute to the realization of carbon neutrality and robust security.
Innovation Palette opened in February 2024 as Toshiba Group’s most important technology development base. Its researchers seek to solve global issues, including carbon neutrality, by accelerating the development of innovative technologies through co-creation in-house, and also with business partners and customers. In order to provide a practical environment for quickly operating, testing, and advancing services and ideas developed by Toshiba Group, and with its customers and partners, the building’s office area, where 1,000 employees work and use various facilities, was set up as a testbed for advanced technologies.
The Group promotes open verification and co-creation with customers and partners by combining various technologies and functions, making full use of Toshiba’s cutting-edge technologies in AI and facility operation.
Details of the Demonstration
1. Energy conservation demonstration for comfort and energy reduction
Toshiba is demonstrating the use of an operational digital twin to provide both user comfort and energy reduction. Physical data on spaces, people, and energy is collected from various sources, including sensors and cameras installed in the building, and reproduced in cyber space in real time. Toshiba’s AI and optimization engine carries out digital trial runs in cyberspace that estimate people flows, at low cost with high accuracy. Taking into account the heat energy load generated by people, energy reduction effects using lighting and air conditioning, and a blind control, are simulated to reflect seasonal changes and building usage. The best measures are derived from the results and reflected in the actual equipment control. This system can also be used for co-creation and proof of concept (PoC) with customers and partners, as it supports verification of services that flexibly combine functions not only with Toshiba’s equipment but also that from other companies.
2. Security demonstration using video analysis AI and robots to achieve both automation and manpower saving in security, and safety and security
The security demonstration achieves automation, labor cost savings and secure locations through simultaneous AI monitoring of multiple images and extensive patrols by security robots. Stable local 5G communications link SECOM's security robots to the building's security gates and to ELCLOUD, a cloud service provided by Toshiba Elevator and Building Systems Corporation. The robot control is compliant with open interfaces established in the cloud for smooth coordination, and robots patrol multiple floors and areas. The additional use of AI delivers simultaneous monitoring of multiple images, which has been difficult to achieve. Video data acquired by cocobo and surveillance cameras are analyzed by Toshiba Group’s analytics AI service SATLYS (*3) and Visual Question Answering AI (*4) to detect unsafe behavior and unregistered persons, and to track any suspicious individuals who breach the security gates.
Going forward, Toshiba will continue to conduct various advanced demonstrations using the testbed, and to reduce energy consumption and realize safe and robust security in various facilities, such as buildings and factories. It will also promote collaboration by using Innovation Palette as a place for co-creation with customers and partners, and contribute to the creation of diverse solutions for carbon neutrality and social issues.
*1: cocobo
https://www.secom.co.jp/english/feature/01.html
*2: Technology that uses sensor technology and AI to reproduce real-world events virtually in real time and simulate the past, present, and future. The operational digital twin can reflect the results of simulations based on live data acquired from actual equipment on site in a timely manner for on-site operation and control.
*3: Introduction video of SATLYS, Toshiba’s analytics AI service
https://www.youtube.com/watch?v=nNbjxG58rSw
*4: Press release in September 2021
https://www.global.toshiba/ww/technology/corporate/rdc/rd/topics/21/2109-02.html
Currently under research and development