Red Pajama 2: The Public Dataset With a Whopping 30 Trillion Tokens

$ 11.00

4.7 (297) In stock

Together, the developer, claims it is the largest public dataset specifically for language model pre-training

ChatGPT / Generative AI recent news, page 3 of 19

Top 10 List of Large Language Models in Open-Source

RedPajama's Giant 30T Token Dataset Shows that Data is the Next Frontier in LLMs

2311.17035] Scalable Extraction of Training Data from (Production) Language Models

Data science recent news

RedPajama Project: An Open-Source Initiative to Democratizing LLMs - KDnuggets

cerebras/SlimPajama-627B · Datasets at Hugging Face

RedPajama training progress at 440 billion tokens

Shamane Siri, PhD on LinkedIn: RedPajama-Data-v2: an Open Dataset with 30 Trillion Tokens for Training…

ChatGPT / Generative AI recent news, page 5 of 21

What's in the RedPajama-Data-1T LLM training set

Together AI Releases RedPajama v2: An Open Dataset with 30 Trillion Tokens for Training Large Language Models - MarkTechPost

GPT-4 – Dr Alan D. Thompson – Life Architect

Leaderboard: OpenAI's GPT-4 Has Lowest Hallucination Rate