NVIDIA has unveiled a new compact language model, Mistral-NeMo-Minitron-8B, designed to offer state-of-the-art accuracy while maintaining a smaller footprint.
Today we released Mistral-NeMo-Minitron 8B, a pruned and distilled version of the open @MistralAI NeMo 12B model, achieving high accuracy across nine popular benchmarks for chatbots, virtual assistants, content generation, coding, and educational tools.
➡️… pic.twitter.com/N8oS9hF0fd— NVIDIA AI Developer (@NVIDIAAIDev) August 21, 2024
This model is a distilled version of the previously released open Mistral NeMo 12B model, making it more accessible for developers and organizations with limited computational resources.
Mistral-NeMo-Minitron-8B-Base is optimized for low latency, ensuring faster responses and higher computational efficiency. Its compact size allows it to run on NVIDIA RTX-powered workstations, making it suitable for a wide range of AI applications, including chatbots, virtual assistants, content generation, and educational tools.
NVIDIA’s AI Foundry platform and services provide developers with a comprehensive solution for creating customized foundation models. This includes access to foundation models like Mistral-NeMo-Minitron-8B-Base, the NVIDIA NeMo platform for developing and training custom models, and dedicated capacity on NVIDIA DGX Cloud.
