Hugging Face
Hugging Face's 7B DPO-tuned chat model — Mistral-based with strong alignment and helpfulness for its size.