Research Topics

Information Theory

Machine Learning

Statistical Signal Processing

Optimization

Clinical Data Analysis

Information Theory

- Second- and Third-Order Coding Rates

- Multi-User Information Theory

- Error Exponent Analysis

- Information Spectrum Analysis

- Common Information

- Covert Communications

1. Common Information, Noise Stability, and Their Extensions
   Lei Yu and Vincent Y. F. Tan
   Foundations and Trends® in Communications and Information Theory, Vol. 19, No. 2, Pages 107 - 389, 2022

2. Optimal Adaptive Strategies for Sequential Quantum Hypothesis Testing
   Yonglong Li, Vincent Y. F. Tan, and Marco Tomamichel
   Communications in Mathematical Physics, Vol. 392, Issue 3, 993 - 1027, Jun 2022

3. Second-Order Asymptotics of Sequential Hypothesis Testing
   Yonglong Li and Vincent Y. F. Tan
   IEEE Transactions on Information Theory, Vol. 66, No. 11, Pages 7222 - 7230, Nov 2020

4. On the Maximum Size of Block Codes Subject to a Distance Criterion [Slides]
   Ling-Hua Chang, Po-Ning Chen, Vincent Y. F. Tan, Carol Wang and Yunghsiang S. Han
   IEEE Transactions on Information Theory, Vol. 65, No. 6, Pages 3751 - 3757, Jun 2019

5. Time-Division is Optimal for Covert Communication over Some Broadcast Channels [Slides]
   Vincent Y. F. Tan and Si-Hyeon Lee
   IEEE Transactions on Information Forensics and Security, Vol. 14, No. 5, Pages 1377 - 1389, May 2019

6. Strong Converse for Multimessage Networks with Tight Cut-Set Bounds [Russian Version]
   Silas L. Fong and Vincent Y. F. Tan
   Problems of Information Transmission (Пробл. передачи информ.), Vol. 55, No. 1, Pages 67- 100, Jan 2019

7. Codes in the Space of Multisets—Coding for Permutation Channels with Impairments
   Mladen Kovačević and Vincent Y. F. Tan
   IEEE Transactions on Information Theory, Vol. 64, No. 7, Pages 5156 - 5169, Jul 2018

8. Minimum Rates of Approximate Sufficient Statistics [Slides]
   Masahito Hayashi and Vincent Y. F. Tan
   IEEE Transactions on Information Theory, Vol. 64, No. 2, Pages 875 – 888, Feb 2018

9. Improved Bounds on Sidon Sets via Lattice Packing of Simplices [Slides]
   Mladen Kovačević and Vincent Y. F. Tan
   SIAM Journal on Discrete Mathematics, Vol. 31, No. 3, Pages 2269 - 2278, Sep 2017

10. The Dispersion of Nearest-Neighbor Decoding for Additive Non-Gaussian Channels
    Jonathan Scarlett, Vincent Y. F. Tan and Giuseppe Durisi
    IEEE Transactions on Information Theory, Vol. 63, No. 1, Pages 81 - 92, Jan 2017

11. Asymmetric Evaluations of Erasure and Undetected Error Probabilities
    Masahito Hayashi and Vincent Y. F. Tan
    IEEE Transactions on Information Theory, Vol. 61, No. 12, Pages 6560 – 6577, Dec 2015

12. Asymptotic Estimates in Information Theory with Non-Vanishing Error Probabilities
    Vincent Y. F. Tan
    Foundations and Trends® in Communications and Information Theory, Vol. 11, Nos. 1-2, Pages 1 – 184, 2014

Machine Learning

- Multi-Armed Bandits

- Deep Learning

- Graphical Model Selection

1. Probably Anytime-Safe Stochastic Combinatorial Semi-Bandits
   Yunlong Hou, Vincent Y. F. Tan, and Zixin Zhong
   Proc. of the 40th International Conference on Machine Learning (ICML), Hawaii, Jul 2023 (AR: 1827/6538 ≈ 27.9%)

2. Communication-Constrained Bandits under Additive Gaussian Noise
   Prathamesh Mayekar, Jonathan Scarlett, and Vincent Y. F. Tan
   Proc. of the 40th International Conference on Machine Learning (ICML), Hawaii, Jul 2023 (AR: 1827/6538 ≈ 27.9%)

3. Minimax Optimal Fixed-Budget Best Arm Identification in Linear Bandits [Poster] [Slides]
   Junwen Yang and Vincent Y. F. Tan
   Proc. of the 36th Annual Conference on Neural Information Processing Systems (NeurIPS), New Orleans, USA, Dec 2022 (AR ≈ 25.6%)

4. Thompson Sampling Algorithms for Cascading Bandits [Slides] [Code]
   Zixin Zhong, Wang Chi Cheung, and Vincent Y. F. Tan
   Journal of Machine Learning Research, Vol. 22, No. 218, Pages 1 - 66, 2021 (Extension of 2019 AISTATS paper)

5. Probabilistic Sequential Shrinking: A Best Arm Identification Algorithm for Stochastic Bandits with Corruptions [Code] [Video]
   Zixin Zhong, Wang Chi Cheung, and Vincent Y. F. Tan
   Proc. of the 38th International Conference on Machine Learning (ICML), Virtual, Jul 2021

6. Thompson Sampling Algorithms for Mean-Variance Bandits [Code]
   Qiuyu Zhu and Vincent Y. F. Tan
   Proc. of the 37th International Conference on Machine Learning (ICML), Vienna, Austria, Jul 2020

7. Best Arm Identification for Cascading Bandits in the Fixed Confidence Setting
   Zixin Zhong, Wang Chi Cheung, and Vincent Y. F. Tan
   Proc. of the 37th International Conference on Machine Learning (ICML), Vienna, Austria, Jul 2020

8. On Robustness of Neural Ordinary Differential Equations
   Hanshu Yan, Jiawei Du, Vincent Y. F. Tan, and Jiashi Feng
   Proc. of the 8th International Conference on Learning Representations (ICLR) (Spotlight), Addis Ababa, Apr 2020

9. High-Dimensional Gaussian Graphical Model Selection: Walk Summability and Local Separation Criterion
   Animashree Anandkumar, Vincent Y. F. Tan, Furong Huang and Alan S. Willsky
   Journal of Machine Learning Research, Vol. 13, Pages 2293 – 2337, Aug 2012

10. High-Dimensional Structure Estimation of Ising Models: Local Separation Criterion [Paper]
    Animashree Anandkumar, Vincent Y. F. Tan, Furong Huang and Alan S. Willsky
    Annals of Statistics, Vol. 40, No. 3, Pages 1346 – 1375, 2012

11. Learning Latent Tree Graphical Models [Abstract] [Webpage] [Code] [Slides]
    Myung Jin Choi, Vincent Y. F. Tan, Animashree Anandkumar and Alan S. Willsky
    Journal of Machine Learning Research, Vol. 12, Pages 1771 – 1812, May 2011

12. A Large-Deviation Analysis of the Maximum-Likelihood Learning of Markov Tree Structures [Link] [Slides]
    Vincent Y. F. Tan, Animashree Anandkumar, Lang Tong and Alan S. Willsky
    IEEE Transactions on Information Theory, Vol. 57, No. 3, Pages 1714 – 1735, Mar 2011

Statistical Signal Processing

- Non-Negative Matrix Factorization

- Sparsity in Signal Processing

1. Distributionally Robust and Multi-Objective Nonnegative Matrix Factorization [Slides] [Code]
   Nicolas Gillis, Le Thi Khanh Hien, Valentin Leplat, and Vincent Y. F. Tan
   IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 44, No. 8, Pages 4052 - 4064, Aug 2022

2. Adversarially-Trained Nonnegative Matrix Factorization [Code]
   Ting Cai, Vincent Y. F. Tan, and Cédric Févotte
   IEEE Signal Processing Letters, Vol. 28, Pages 1415 - 1419, Jun 2021

3. Positive Semidefinite Matrix Factorization: A Connection with Phase Retrieval and Affine Rank Minimization [Code]
   Dana Lahat, Yanbin Lang, Vincent Y. F. Tan, and Cédric Févotte
   IEEE Transactions on Signal Processing, Vol. 69, Pages 3059 - 3074, Apr 2021

4. A Ranking Model Motivated by Nonnegative Matrix Factorization with Applications to Tennis Tournaments [Slides]
   Rui Xia, Vincent Y. F. Tan, Louis Filstroff, and Cédric Févotte
   Proc. of European Conference on Machine Learning (ECML/PKDD), 2019

5. A Unified Convergence Analysis of the Multiplicative Update Algorithm for Regularized NMF
   Renbo Zhao and Vincent Y. F. Tan
   IEEE Transactions on Signal Processing, Vol. 66, No. 1, Pages 129 – 138, Jan 2018

6. Rank-One NMF-Based Initialization for NMF and Relative Error Bounds under a Geometric Assumption [Code] [Slides]
   Zhaoqiang Liu and Vincent Y. F. Tan
   IEEE Transactions on Signal Processing, Vol. 65, No. 18, Pages 4717 – 4731, Sep 2017

7. Online Nonnegative Matrix Factorization with General Divergences [Slides]
   Renbo Zhao, Vincent Y. F. Tan and Huan Xu
   Proc. of the 20th Intl. Conf. on Artificial Intelligence and Statistics (AISTATS), PMLR 54:37-45, 2017, Fort Lauderdale, FL

8. Online Nonnegative Matrix Factorization with Outliers [Code] [Supplemental Material]
   Renbo Zhao and Vincent Y. F. Tan
   IEEE Transactions on Signal Processing, Vol. 65, No. 3, Pages 555 – 570, Feb 2017

9. Automatic Relevance Determination in Nonnegative Matrix Factorization with the β-Divergence [Supplementary Material] [Poster] [Slides] [Code]
   Vincent Y. F. Tan and Cédric Févotte
   IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, No. 7, Pages 1592 – 1605, Jul 2013

10. Estimating Signals with Finite Rate of Innovation from Noisy Samples: A Stochastic Algorithm [Code]
    Vincent Y. F. Tan and Vivek K Goyal
    IEEE Transactions on Signal Processing, Vol. 56, No. 10, Pages 5135 – 5145, Oct 2008

Optimization

- Polynomial Optimization

- Stochastic Optimization

- Sharpness-Aware Training

1. Sharpness-Aware Training for Free [Poster]
   Jiawei Du, Daquan Zhou, Jiashi Feng, Vincent Y. F. Tan, and Joey Tianyi Zhou
   Proc. of the 36th Annual Conference on Neural Information Processing Systems (NeurIPS), New Orleans, USA, Dec 2022 (AR ≈ 25.6%)

2. Efficient Sharpness-aware Minimization for Improved Training of Neural Networks
   Jiawei Du, Hanshu Yan, Jiashi Feng, Joey Tianyi Zhou, Liangli Zhen, Rick Siow Mong Goh, and Vincent Y. F. Tan
   Proc. of the 10th International Conference on Learning Representations (ICLR), Virtual, Apr 2022 (AR: 1095/3391 ≈ 32.3%)

3. Analysis of Optimization Algorithms via Sum-of-Squares [Code] [Slides]
   Sandra S. Y. Tan, Antonios Varvitsiotis, and Vincent Y. F. Tan
   Journal of Optimization Theory and Applications, Vol. 190, Pages 56 - 81, Jul 2021

4. An Optimal Algorithm for Stochastic Three-Composite Optimization
   Renbo Zhao, William B. Haskell and Vincent Y. F. Tan
   Proc. of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS), 2019, Naha, Okinawa, Japan

5. Stochastic L-BFGS Revisited: Improved Convergence Rates and Practical Acceleration Strategies [News]
   Renbo Zhao, William B. Haskell and Vincent Y. F. Tan
   IEEE Transactions on Signal Processing, Vol. 66, No. 5, Pages 1155 - 1169, Mar 2018

Clinical Data Analysis

1. Mobile Gait Analysis using Foot-Mounted UWB Sensors
   Boyd Anderson, Mingqian Shi, Vincent Y. F. Tan and Wang Ye
   Proc. of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 3, Issue 3, Sep 2019

2. MANA: Designing And Validating A User-Centered Mobility Analysis System
   Boyd Anderson, Shenggao Zhu, Ke Yang, Jian Wang, Hugh Anderson, Chao Xu Tay, Vincent Y. F. Tan and Wang Ye
   Proc. of the 20th Intl. ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), 2018, Galway, Ireland

3. Impact of Pre-Adapted HIV Transmission [Science Daily] [News and Views] [Project Webpage] [Video]
   Jonathan M. Carlson, Victor Y. Du, Nico Pfeifer, Anju Bansal, Vincent Y. F. Tan, Karen Power, Chanson J. Brumme, Anat Kreimer, Charles E. DeZiel, Nicolo Fusi, Malinda Schaefer, Mark A. Brockman, Jill Gilmour, Matt A. Price, William Kilembe, Richard Haubrich, Mina John, Simon Mallal, Roger Shapiro, John Frater, P. Richard Harrigan, Thumbi Ndung’u, Susan Allen, David Heckerman, John Sidney, Todd M. Allen, Philip J. R. Goulder, Zabrina L. Brumme, Eric Hunter, Paul A. Goepfert
   Nature Medicine, Vol. 22, No. 6, Pages 606 – 613, Jun 2016

4. Widespread Impact of HLA Restriction on Immune Control and Escape Pathways in HIV-1
   Jonathan M. Carlson, Jennifer Listgarten, Nico Pfeifer, Vincent Y. F. Tan, Carl Kadie, Bruce D. Walker,Thumbi Ndung'u, Roger Shapiro, John Frater, Zabrina L. Brumme, Philip J. R. Goulder, David Heckerman
   Journal of Virology, Vol. 86, No. 9, Pages 5230-5243, May 2012

5. Beyond Atopy: Multiple Patterns of Sensitization in Relation to Asthma in a Birth Cohort Study [Link]
   Angela Simpson*, Vincent Y. F. Tan*, John Winn, Markus Svensen, Chris Bishop, David Heckerman, Iain Buchan and Adnan Custovic
   American Journal of Respiratory and Critical Care Medicine, Vol. 181, Pages 1200 – 1206, Jun 2010 (*Co-first Authorship)