MIT

Research

Feature Geometry

A mathematical framework for feature-centric information processing, which

  • formulates representation learning as information decomposition
  • separates feature learning and feature usage
  • provides principled deep-learning designs for
    • adapting learned features
    • learning multivariate dependence structures
    • computing information measures
Fig1

Applications

More Details: Neural Feature Learning in Function Space. (JMLR, vol 25:142)

This blog illustrates the basic idea, including some Pytorch demos.

Recent News

more