Overview
No overview available.
Description
Open-source LLM with a record-breaking context window of up to 4 million tokens. Uses a 'Lightning Attention' + MoE architecture (~456B total params).
About
No company description available.
Related Models
Last updated: March 3, 2025