tech

Defeating Fable 5! Kimi K3 Rushes to First Place, Yang Zhilin's Mentor is Proud - 36Kr

The first open-source 3T-level model, with performance close to Claude Fable 5, but at half the price.

Defeating Fable 5! Kimi K3 Rushes to First Place, Yang Zhilin's Mentor is Proud - 36Kr

TL;DR

  • Kimi K3, an open-source model with 2.8 trillion parameters, supports a 1 million token context window and visual understanding.
  • It has achieved top rankings in professional AI evaluations for web engineering and coding tasks, surpassing many overseas closed-source models.
  • Kimi K3 demonstrates strong long-range Agent execution capabilities, integrating programming, visual understanding, tool use, and knowledge work.
  • Real-world tests show Kimi K3 can create complex outputs like 3D games and research reports from single prompts, often at a lower cost than competitors.
  • The model's performance improvements are attributed to architectural upgrades like Kimi Delta Attention (KDA) and Attention Residuals (AttnRes), and a more sparse Mixture of Experts (MoE) design.
  • Despite its advancements, Kimi K3 has limitations in stability when switching models and can be overly proactive in ambiguous user intentions.
  • The pricing of Kimi K3 remains competitive, significantly lower than top closed-source models like Claude Fable 5.