---

RedPajama Models

Primary Reference: https://www.together.xyz/blog/redpajama-3b-updates
Secondary Reference: https://github.com/togethercomputer/redpajama.cpp
Paper: N/A

RedPajama Models Included

• RedPajama-Base-3b-v1
• RedPajama-Chat-3b-v1
• RedPajama-Instruct-3b-v1

---

RedPajama Model Set Plots

---

---

---

---