Course that links information theory, signal processing and machine learning…….

This excellent course links:  information theory, signal processing and machine learning……  simply awesome

http://www.cs.cmu.edu/~aarti/Class/10704/

http://www.cs.cmu.edu/~aarti/Class/10704/lecs.html

Reflections on machine learning

It is interesting that clustering is an extreme case of dimensionality reduction in feature space in which the features produced are a kind of special features (so many as clusters) and in which only one feature can be different of zero. It is presented in the coursera course :  Neural Networks for Machine Learning by Geoffrey Hinton. For him, clustering is an extreme case of finding spare features.