---

OPT Models

Primary Reference: https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/
Secondary Reference: https://huggingface.co/facebook
Paper: OPT: Open Pre-trained Transformer Language Models

OPT Models Included

• opt-125m
• opt-1.3b
• opt-2.7b
• opt-13b
• opt-30b

---

OPT Model Set Plots

---

---

---

---