Announcing RedPajama 7B trained on 1T tokens! 🚀 • Instruct, chat, base, and interim checkpoints on @huggingface • The instruct model outperforms all open 7B models on HELM benchmarks • The 5TB dataset has been used to train over 100 models Details👇 together.xyz/blog/redpajama-…

Introducing GPT-JT, a 6B parameter open source model that can outperform many 100B+ parameter models and was trained over slow (1Gbps) internet links. together.xyz/research/releas…