Bottlenecks in the Brain

Recent data from the Human Connectome Project has revealed surprisingly narrow informational bottlenecks. The emerging picture of a modular structure with a mix of highly dynamic boundaries and static bottlenecks. This compute graph suggests a new architecture for machine learning models with greatly improved functional localization. If the new architecture proves competitive with existing models, the functional localization would greatly improve interpretability and steerability of the resulting models.