tech

MathΣtral

We're contributing Mathstral to the science community to bolster efforts in advanced mathematical problems requiring complex, multi-step logical reasoning. The Mathstral release is part of our broader effort to support academic projects—it was produced in the context of our collaboration with Project Numina.

MathΣtral

TL;DR

  • Mathstral is a new AI model for advanced mathematical problems.
  • It builds upon Mistral 7B and specializes in STEM subjects.
  • Mathstral achieves state-of-the-art reasoning capacities in its size category.
  • It scored 56.6% on MATH and 63.47% on MMLU.
  • With additional computation, Mathstral 7B scores 68.37% on MATH with majority voting and 74.59% with a strong reward model.
  • The model is an instructed model and its weights are hosted on HuggingFace.
  • Mathstral was developed in collaboration with Project Numina.