Mixture of experts (MoE)
AIMixture of experts (MoE): A model design that routes each input to a subset of specialised sub-networks, cutting the computation needed while keeping the total parameter count large.
Mixture of experts (MoE): A model design that routes each input to a subset of specialised sub-networks, cutting the computation needed while keeping the total parameter count large.