tech
Codestral Mamba
Following the publishing of the Mixtral family, Codestral Mamba is another step in our effort to study and provide new architectures. It is available for free use, modification, and distribution, and we hope it will open new perspectives in architecture research. Codestral Mamba was designed with help from Albert Gu and Tri Dao.
TL;DR
- Codestral Mamba is a new architecture, following the Mixtral family.
- It is available for free use, modification, and distribution.
- The aim is to open new perspectives in architecture research.
- Albert Gu and Tri Dao assisted in its design.