We now have state-of-the-art pre-trained base models in the 3T-parameter weight class, built entirely in-house at MAI. Post-training results coming soon -- stay tuned! Lots of details in our technical blog post.
MAI unveils in-house 3T-parameter pre-trained base model
Mustafa Suleyman announced state-of-the-art pre-trained base models in the 3T-parameter class, built entirely in-house at MAI. Post-training results are coming soon, with details in a technical blog post.