Dolly 2.0 12B
Databricks · 2023-04-12 · 11.8B parameters
Dolly 2.0 is Databricks' 12B instruction-following causal language model, released in April 2023 and derived from EleutherAI's Pythia-12B. It was fine-tuned exclusively on approximately 15,000 instruction/response records generated by Databricks employees; Databricks released the model weights, training code, and databricks-dolly-15k dataset for commercial use without relying on ChatGPT-generated instruction-tuning data.