Top-k routing
AITop-k routing: A strategy that sends each token to its k highest-scoring experts, keeping computation sparse while drawing on many parameters.
Top-k routing: A strategy that sends each token to its k highest-scoring experts, keeping computation sparse while drawing on many parameters.