Tencent releases Hy3 open-source model that allegedly matches models up to five times its active size

Tencent has released Hy3, an open-source language model with 295 billion parameters built on a mixture-of-experts architecture. Only 21 billion parameters are active at any given time. Tencent says Hy3 matches models two to five times its size while cutting its hallucination…

To respect copyright, we link to the source rather than republishing the full text. Read the complete article on The Decoder.