---

LLAMA Models

LLaMA is a a foundational, 65-billion-parameter, open-source large language model from Meta.LLaMA actually comes in several sizes (7B, 13B, 33B, and 65B parameters), and the smallerversions are becoming the default public model to build custom, fine-tuned models.

If we compute the median alpha for each size model, we see that it systematically decreases as the models get larger. These median alphas actually compare to other models like LLAMA Models Included

• llama-7b
• llama-13b
• llama-30b
• llama-65b

---

LLAMA Model Set Plots

---

---

---

---