Mixture of Experts
An architecture where only a few specialized sub-networks ("experts") fire for any given input, chosen by a learned router.
Deep Learning
An architecture where only a few specialized sub-networks ("experts") fire for any given input, chosen by a learned router.