All Tools
T
Fine-tuningFreeOpen Source
TINYZERO
Minimal DeepSeek R1-Zero reproduction for RL reasoning
Apache-2.0
ABOUT
Reproducing R1-Zero-style RL usually means a large stack and opaque training code. TinyZero is a small, readable setup on verl that trains countdown reasoning so you can inspect how longer chains of thought appear under RL.
INTEGRATION GUIDE
1. Reproduce R1-Zero-style RL on a countdown task with a small model
2. Study how reasoning traces lengthen during GRPO or PPO training
3. Teach RL-for-LLMs without standing up a full production trainer
4. Baseline a new reward or environment against a known tiny setup
TAGS
rlreasoningr1-zeroverlresearchpytorch