August 20, 2019

Making Always-on Machine Vision a Reality

Dr. Evgeni Gousev, Senior Director of Qualcomm AI Research

Presentation Abstract

Recent progress in computing, machine learning algorithms and networks and availability of large datasets for model training have created an enormous momentum in development and wide deployment of game changing AI applications. Intelligent devices with human-like senses have enabled a variety of new use cases and applications transforming the way we interact with each other and our surroundings. While the vast majority (>80%) of human insight comes through eyes, always-on machine vision at the edge (e.g. IoT device, smart phone) remains extremely challenging due to significant power consumption of conventional HW architectures and complexity of algorithms. Qualcomm Research has pioneered an Always-on Computer Vision Module (CVM) combining innovations in the system architecture, ultra-low power designs, and dedicated hardware for CV algorithms running at the “edge”. With low end-to-end power consumption (less than 1 mW), tiny form factor and low cost, CVM can be integrated into a wide range of battery- and line-powered devices (IoT, mobile, VR/AR, automotive, etc.), performing object detection, feature recognition, change/motion detection, and other applications. This dedicated tinyML processor performs 100% embedded computation within the module itself and outputs metadata. In the presentation, we will cover the architecture, sensor design, innovations in the circuit, algorithms. We will also discuss use cases and show demos, some of them display related.

Dr. Evgeni Gousev, Senior Director of Qualcomm AI Research

Evgeni Gousev is a Senior Director of Qualcomm AI Research. He leads Qualcomm R&D organization in the Silicon Valley Center and is also responsible for developing ultra low power embedded computing platform, including always on machine vision Evgeni joined Qualcomm in 2005 and led Technology R&D in the MEMS Research and Innovation Center commercializing mirasol display technology. He earned a Ph.D. degree in the solid-state physics and M.S. in Applied Physics from Moscow Engineering Physics Institute. In 1993, Evgeni joined Rutgers University first as a Postdoctoral Fellow and then as a Research Assistant Professor. While at Rutgers, he performed fundamental research in the area advanced gate dielectric for CMOS devices which, a decade later, became industry wide standards. In 1997, he was a Visiting Professor with the Center for Nanodevices and Systems, Hiroshima University, Japan. Shortly after, he joined IBM, where he led projects in the field of advanced silicon technologies in Semiconductor Research and Development Center in East Fishkill and T.J. Watson Research Center in Yorktown Heights, NY. He has co-edited 25 books and published more than 166 papers (with over 10k citations and h-index of 46: Google Scholar). He is a holder of more than 50 issued and filed patents. Dr. Gousev is a member of several professional boards, committees, panels, and societies. Noticeably, he is a member of the Governing Council of MEMS industry group and a member of Tech Council of FlexTech Alliance.