Friday February 6th 11:00am to 12:30pm

Location: UIC, Lecture Center C1

Machine Learning and Visual Texture Analysis

 
Thrasyvoulos (Thrasos) N. Pappas, PhD

Electrical and Computer Engineering 

Northwestern University

Abstract: We review recent progress in visual texture analysis from structural texture similarity metrics to the extraction of material properties. We then investigate data-driven texture modeling via analysis and synthesis with generative adversarial networks. For network training and testing, we have compiled a diverse set of spatially homogeneous textures, ranging from stochastic to regular. We adopt StyleGAN3 for synthesis and demonstrate that it produces diverse textures beyond those represented in the training data. For texture analysis, we propose GAN inversion using a novel latent domain reconstruction consistency criterion for synthesized textures, and iterative refinement with a sliced Wasserstein loss for real-world textures. We propose perceptual procedures for evaluating network capabilities, exploring the global and local behavior of latent space trajectories, and comparing with existing texture analysis-synthesis techniques. 

Bio: Thrasos Pappas received the Ph.D. degree in electrical engineering and computer science from MIT in 1987. From 1987 until 1999, he was a Member of the Technical Staff at Bell Laboratories, Murray Hill, NJ. He joined the ECE Department at Northwestern in 1999. His research interests are in human perception and electronic media, including image analysis, quality and compression, content-based retrieval, and tactile and multimodal interfaces. Prof. Pappas is a Fellow of the IEEE, SPIE and IS&T. He has served as Vice President-Publications (2015-17) and member of the Board of Governors (2004-07) of the Signal Processing Society of IEEE, Editor-in-Chief of the IEEE Transactions on Image Processing (2010-12), and technical program co-chair of ICIP-01 and ICIP-09. He has also served as co-chair of the SPIE/IS&T Conference on Human Vision and Electronic Imaging (1997-2018). He is currently one of the two founding Editors-in-Chief of the IS&T Journal of Perceptual Imaging. 

Faculty Host: Dr. Enis Cetin (aecyy@uic.edu)