Mini toolsApertus models
Browse all models from this model family.
to
-
A 4B parameter instruction-tuned language model created via pre-training distillation from the Apertus-8B teacher model. Uses a dense transformer decoder with grouped-query attention and xIELU activations, trained on 1.7T tokens. Natively supports 1811 languages with quantized checkpoints available for mobile and edge deployment. Apache-2.0 licensed.NewTextReleased 10d ago
-
Apertus-v1.1-4B is a 4B parameter open-source base language model created via pre-training distillation from the Apertus-8B teacher model. It uses a dense transformer with grouped-query attention and xIELU activations, natively supports 1,811 languages, and is trained on 1.7T high-quality tokens. Designed for constrained hardware and further fine-tuning.NewTextReleased 10d ago
-
Apertus-v1.1-1.5B-Instruct is a 1.5B parameter instruction-tuned language model built on a dense transformer decoder with grouped-query attention and xIELU activation. Created via pre-training distillation from an 8B teacher model trained on 1.7T tokens. Natively supports 1811 languages and optimized for mobile and edge deployments. Apache 2.0.NewTextReleased 1mo ago
-
Apertus-v1.1-1.5B is a 1.5 billion parameter base language model trained via distillation from an 8B teacher model. It supports 1,811 languages, uses a dense transformer architecture with grouped-query attention and xIELU activation, and has a 32,768 token context window. Designed for text generation and multilingual applications.NewTextReleased 1mo ago
-
Apertus-v1.1-0.5B-Instruct is a 0.5B parameter multilingual instruction-tuned language model built via pre-training distillation from an 8B teacher model. Supports 1811 natively integrated languages on a dense transformer with grouped-query attention and xIELU activation. Apache 2.0 licensed with fully open weights, data, and training details.NewTextReleased 1mo ago
-
Apertus 8B Instruct 2509 is an 8B parameter open-source instruction-tuned language model pretrained on 15T tokens. It natively supports 1,811 languages, uses fully open data and weights with disclosed training recipes, and is designed to respect data owner opt-outs. It features a 65,536-token context window and supports tool use for agentic tasks.TextReleased 9mo ago
-
Apertus 8B 2509 is a fully open 8B parameter language model by Swiss AI Initiative, pretrained on 15T tokens. It natively supports over 1800 languages including all Swiss national languages, uses only compliant open training data, and achieves performance comparable to closed-source models. Supports long context up to 65K tokens and tool use.TextReleased 9mo ago
