Mistral News 09/11/2024 AI Rating: Medium

Mistral AI Releases Its First Multimodal Model, "Pixtral 12B"

#Mistral#Mistral AI#AI History

On September 11, 2024, Mistral AI released its first multimodal model, “Pixtral 12B.” Built on the text model “Nemo 12B,” it stands out for its ability to handle any number of images of any size (via URL or base64 encoding), and was released under the Apache 2.0 license, freely available for anyone to use and modify.

Details

  • Size: 12 billion parameters, with a model size of about 24GB
  • Multimodal capabilities: Designed to handle image understanding tasks similar to those of the Claude family and GPT-4o, such as generating captions for images or counting objects in a photo
  • Input format: Accepts images via URL or base64 encoding, with no limit on the number or size of images
  • License and distribution: Released under the Apache 2.0 license via a torrent link on GitHub and on Hugging Face, with no restrictions on downloading, fine-tuning, or commercial use
  • Platform integration: Sophia Yang, head of developer relations, said on X that it would soon also be available to try on Le Chat and La Plateforme

What happened next

Pixtral 12B later evolved into “Pixtral Large” that November, marking the point at which multimodal capability became firmly integrated into Mistral’s model lineup.