Harmonic analysis of deep convolutional neural networks

Authors

Thomas Wiatowski

Reference

Doctoral Thesis, ETH Zurich, Switzerland, Aug. 2017.

Abstract

A central task in machine learning, computer vision, and signal processing is to extract characteristic features of signals. Feature extractors based on deep convolutional neural networks have been applied with significant success in a wide range of practical machine learning tasks such as classification of images in the ImageNet data set, image captioning, or control-policy-learning to play Atari games or the board game Go. Since deep convolutional neural networks lead to remarkable results across a broad range of applications, it is essential to understand their underlying mechanisms. In this thesis, we develop a mathematical theory of deep convolutional neural networks for feature extraction using concepts from applied harmonic analysis. We investigate the impact of network topology and building blocks---convolution filters, non-linearities, and pooling operators---on the network's feature extraction capabilities.

Download this document:

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.