VIDRAFT Releases Aether-7B-5Attn: A Fully Open-Source MoE LLM with Five Heterogeneous Attention Mechanisms

VIDRAFT Releases Aether-7B-5Attn: A Fully Open-Source MoE LLM with Five Heterogeneous Attention Mechanisms TL;DR: Korean AI startup VIDRAFT has released Aether-7B-5Attn , a 6. 59B-parameter Mixture-of-Experts foundation model on Hugging Face under Apache-2. 0 — shipping not just weights but train...

Source: [Dev.to](https://dev.to/ai_openfree_b23025ef075cf/vidraft-releases-aether-7b-5attn-a-fully-open-source-moe-llm-with-five-heterogeneous-attention-2n11)