Loading…

Aleph Alpha has released Kolibri, a German-English mixture-of-experts model with 78 billion parameters, about three billion of which are active per token. Over 21 percent of the training data is German. The model was trained on 768 B200 GPUs in Germany and Finland, and the…
To respect copyright, we link to the source rather than republishing the full text. Read the complete article on The Decoder.