Glossary/Megatron-LMMegatron-LMAIMegatron-LM: Nvidia's framework for training very large transformers, which popularised tensor parallelism.Related termsMechanistic interpretabilityMel spectrogramMel-frequency cepstral coefficients (MFCC)Membership inference attackMemorisation (training data)Memory bandwidthBrowse the full glossary →
