Toshiba AI Technology Catalog

  • Anomaly detection
  • Status estimation
  • Media recognition

Technology for detecting “close call” incidents through video and inspection questions

Automatically detects causes of close calls violating safety manuals, based on workplace videos


  • Input workplace video and safety inspection questions created from frontline manuals, to describe current conditions based on Q&A AI (VQA: Visual Question Answering).
  • Because of the universal format that combines videos and questions, it can be quickly applied in a variety of scenarios.
  • If inspection items need to be added or changed, only the addition or editing of questions is required; there is no need to re-create the detection algorithms.

Applications



  • “Close call” detection in production workplaces
  • Search video using questions with narrowed down conditions; e.g., to search for specified scenes in broadcast contents; to search for specified persons or conditions in drive recorder or security camera video; or to search for past close call incidents with similar conditions
  • It can also be used to infer answers based on video and questions

Benchmarks, strengths, and track record



  • In performance evaluations using global standard public data sets (VQA-v2), responded to questions about a video with the world’s highest level of accuracy (as of April 2021)

Inquiries



Please include the title “AI Technology Catalog: Technology for detecting “close call” incidents through video and inspection questions” or the URL in the inquiry text.
Please note that because this technology is currently the subject of R&D activities, immediate responses to inquiries may not be possible.

References: