DistilBERT
AIDistilBERT: A distilled BERT roughly 40 per cent smaller and 60 per cent faster, retaining most of the original's accuracy.
DistilBERT: A distilled BERT roughly 40 per cent smaller and 60 per cent faster, retaining most of the original's accuracy.