Friday, Apr 01 2022 - 10:00 am (GMT + 7)

Building deep retrieval models in practical applications

About the speaker

Dr. Khoa D. Doan is currently an AI Researcher at the Cognitive Computing Lab, Baidu Research, USA. He received his PhD in Computer Science at Virginia Tech, and MS in Computer Science at the University of Maryland, College Park. His research focuses on developing practical Deep Learning-To-Hash models and Generative-based Machine Learning approaches in various areas such as Retrieval and AI Security. His work has been published in several Data Mining, Information Retrieval, and Machine Learning conferences. In the past, he spent several years in the industry, working as a Senior Software Engineer, and as a Senior Data Scientist/Engineer at NASA and various advertising companies such as Criteo.

Abstract

The rapid growth of digital data, especially visual and textual contents, brings many challenges to the problem of finding similar data. Approximate nearest neighbor search methods, such as hashing methods, provide principled approaches that balance the trade-offs between the quality of the guesses and the computational cost for web-scale databases. In this era of data explosion, it is crucial for the retrieval methods to be efficiently trained and for the learned retrieval models to generalize well with limited labeled data, and to be robust to various scenarios such as when the application has noisy data or data that slightly changes over time (i.e., out-of-distribution).

In this talk, he will discuss three lines of work to make hashing-based retrieval methods more suitable for practical uses, to build interpretable retrieval models, and to improve the computational efficiency of real-time ranking with hashing. Specifically, he will introduce a suite of approaches to replace the many quantization losses (>3-4) in existing hashing methods with a single divergence minimization loss, significantly reducing the training time requirement. These approaches have been successfully used to improve both the training process and retrieval performance of the hashing-based methods in several application domains, including computational advertising, and text/image retrieval. Next, he will introduce energy-based generative hashing networks: models that learn the hash functions in energy-based frameworks to improve generalization and robustness. Then, he will introduce an approach that explains the retrieval decision in the graph retrieval domain. Finally, he will introduce one of the first works to use hashing for real-time ranking where the ranking function can be metric (e.g., cosine distance) or non-metric (e.g., neural networks).
Together, these approaches take significant steps forward for building retrieval models that are suitable for practical uses.

Upcoming Speakers

Guy Van den Broeck

University of California, Los Angeles

Tractable Probabilistic Circuits

Friday, May 27 2022 - 10:00 am (GMT + 7)

Nitesh Chawla

University of Notre Dame

Learning on Graphs: From Representation to Minimally Supervised

Thursday, Jun 02 2022 - 10:00 am (GMT + 7)