---

ALBERT Models

Primary Reference: https://ai.googleblog.com/2019/12/albert-lite-bert-for-self-supervised.html
Secondary Reference: https://huggingface.co/albert-xxlarge-v2
Paper: ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

ALBERT Models Included

• albert-base-v2
• albert-large-v2
• albert-xlarge-v2
• albert-xxlarge-v2

---

ALBERT Model Set Plots

---

---

---

---

---

ALBERT % Randomness Metric Plots

---

---