Thomas Huang

Thomas Shi-Tao Huang (, June 26, 1936 – April 25, 2020) was a Chinese-born Taiwanese-American computer scientist and electrical engineer. He was a researcher and professor emeritus at the University of Illinois at Urbana-Champaign (UIUC). Huang was one of the leading figures in computer vision, pattern recognition and human computer interaction.

Early life and education Huang was born June 26, 1936, in Shanghai, Republic of China. In 1949, his family moved to Taiwan during the Great Retreat. Huang studied electronics at the National Taiwan University and received his bachelor's degree in 1956.

Huang went on to the United States to study at the Massachusetts Institute of Technology (MIT). At MIT he worked initially with Peter Elias, who was interested in information theory and image coding, and then with William F. Schreiber. At that time scanning equipment was not commercially available, so it was necessary to build a scanner for digitizing and reproducing images. Computer programs were written in assembly language using a prototype Lincoln Lab TX-0 computer. Descriptions of digitized images were stored on paper tape with punched holes. and his Sc.D. thesis, Pictorial noise (1963). His master's work focused on algorithms for image coding using adaptive techniques for interpolation with sensitivity to edges. His doctorate included work on the subjective effects of pictorial noise across a spectrum. He was involved with the Coordinated Science Laboratory (CSL), and served as head of the Image Formation and Processing Group of the Beckman Institute for Advanced Science and Technology and co-chair of the Beckman Institute's research track on Human Computer Intelligent Interaction. As of 2012, he was named a Swanlund Chair, the highest endowed title at UIUC. Huang retired from teaching as of December 2014, but continued to be active as a researcher.

Huang was a founding editor of the International Journal of Computer Vision, Graphics and Image Processing, and of Springer-Verlag's Springer Series in Information Sciences. He helped to organize the first International Picture Coding Symposium (1969), the first International Workshop on Very Low Bitrate Video Coding (1993), and the first International Conference on Automatic Face and Gesture Recognition (1995), all of which became repeated events. He also published on digital holography. While at Purdue, he worked on nonlinear filters, particularly median filters, which became a standard technique for the removal of noise in images.

Some of his earliest work dealt with image compression, extending later into areas of enhancement, restoration and analysis. He developed approaches for binary document compression that utilized 2-dimensional scanned information, examining the changes from one line of a scan to the next, and detecting transition points at which a subsequent line differs. Statistical predictions and experimental results of the model's performance conformed well. building on the work of J. J. Y. Huang and Peter M. Schultheiss.

In 1984, Tsai and Huang were the first to present a frequency-domain multi-frame method which related the discrete Fourier transform of observed low-resolution satellite images from the acquisition stage to the continuous Fourier transform of the high-resolution image, using the inverse Fourier transform to obtain a final image with increased resolution. Huang also worked on wavelet methods of encoding and on fractal coding. Wavelet coding is particularly important for content based image retrieval from multimedia databases containing images, video, audio, and text. It enables searches to be done on smaller encoded images rather than on full-size retrieved images. and constructing tables of contents and semantic indexes for video using multimedia information (image sequence, audio, and closed-captions if available).

In the area of 3-D modelling, Huang worked on the identification of three-dimensional motion and the structure of rigid objects given multiple images in which corresponding features can be identified. This work was important for the compression of television images, for the development of image standards, and for research into human and computer vision.

Huang considered image and speech processing to be fundamentally similar, They also developed methods for detecting audio elements that are likely to attract human attention, and are using them to enable humans to more effectively go through large amounts of audio recordings to find important information.

Huang did important work in multimodal human computer interaction and interface design. He was one of the first researchers to combine audio and video-based techniques for identification of human affective states. More recent work by Huang and others attempts to "develop a series of algorithms to extract information from multi-modality in an optimal way",

Huang also hoped to develop more natural and effective ways for humans to interact with a computer or virtual environment using speech and gesture. the use of visual lip reading to enhance audio speech recognition accuracy; and integration of speech recognition and visual gesture analysis in the controlling of displays in virtual environments.

In 2015, Huang worked with Ann Willemsen-Dunlap in an interdisciplinary project to develop a 3-D computer-generated avatar, capable of showing appropriate emotions, to be used in online communication of medical information to patients.

He also explored the use of high-performance computing and big data to develop better techniques for deep learning.

Published work

Huang had published more than 21 books and been an author on more than 600 papers. Representative publications by Thomas Huang include:

Qi, G. J., Aggarwal, C., Tian, Q., Ji, H., Huang, T. S. (2012), "Exploring Context and Content Links in Social Media: A Latent Space Method", IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 850–862. Jaimes, A., Gatica-Perez, D., Sebe, N., Huang, T.S. (2007), "Human-centered Computing: Toward a Human Revolution", IEEE Computer, 40(5), pp. 30–34. Cohen, I., Cozman, F., Sebe, N., Cirelo, M., Huang, T.S. (2004), "Semi-supervised Learning of Classifiers: Theory, Algorithms and Their Applications to Human-Computer Interaction", IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(12), pp. 1553–1567. Pan, H., Levinson, S.E., Huang, T.S., and Liang, Z.P. (2004), “A Fused HMM Model with Application to Bimodal Speech Processing,” IEEE Transactions On Signal Processing, 52/3, pp. 573– 581. Zhou, X.S. and Huang, T.S. (2003), "Relevance Feedback in Image Retrieval: A Comprehensive Review," ACM Multimedia Systems Journal, pp. 536–544. Bruckstein, A.M., Holt, R.J., Huang, T.S., and Netravali, A.N. (2000), "New Devices for 3D Pose Estimation: Mantis Eyes, Agam Paintings, Sundials, and Other Space Fiducials," International Journal of Computer Vision, pp. 131–139. – This paper received the Most Cited Paper of the Decade Award from the Journal of Visual Communication and Image Representation, 2010

Huang died peacefully in Indiana on April 25, 2020, at the age of 83.

The couple had four children: Caroline, Greg, Tom and Marjorie.

Memberships Member, Academia Sinica, 2008 Foreign Member, Chinese Academy of Sciences, 2002 Foreign Member, Chinese Academy of Engineering, 2001 Member, United States National Academy of Engineering, 2001 Fellow, Japan Society for the Promotion of Science, 1986 Fellow, SPIE Fellow, International Association of Pattern Recognition (IAPR) Fellow, Optical Society of America, 1986 Life Fellow, IEEE, 1979, for contributions to the theory and application of image processing and digital filtering.

Awards Azriel Rosenfeld Award, 2011 HP Innovation Research Award, 2009 Picture Coding Symposium: Pioneering Research in Picture Coding Award, 2006 IS&T and SPIE Imaging Scientist of the Year Award, 2006 Okawa Prize for Information and Telecommunications Technology, 2005 Tau Beta Pi Daniel C. Drucker Eminent Faculty Award, 2005. Pan Wen-Yuan Outstanding Research Award, Pan Wen-Yuan Foundation, 2002 King-Sun Fu Prize, International Association of Pattern Recognition (IAPR), 2002 Information Science Award, Association of Intelligent Machinery, 2002 IEEE Jack S. Kilby Signal Processing Medal, 2001 (together with Arun N. Netravali) IEEE Achievement Award for Contributions to Motion Analysis, 2000 IEEE Third Millennium Medal, 2000 Society Award, IEEE Signal Processing Society, 1991 IEEE ASSP Society Technical Achievement Award, 1988 A. V. Humboldt U.S. Senior Scientist Award, 1976–77 Guggenheim Fellow, 1971–72

Awards Named Huang supervised more than 100 graduate students. In 2012, the Thomas and Margaret Huang Fund for Graduate Research was created in response to appeals by former students James J. Kuch and Chang Wen Chen, to celebrate the contributions of Huang and his wife as mentors and teachers as well as his contributions as a researcher. The fund will provide scholarships to support students in Human-Computer Intelligent Interaction at the Beckman Institute.