tech
ByteDance trains massive AI model in bid to rival Anthropic
TikTok owner training a model with 10 trillion parameters.
TL;DR
- ByteDance is training an AI model with up to 10 trillion parameters.
- This model would be three times larger than the biggest Chinese model currently available, Moonshot's Kimi K3.
- The project aims to rival Anthropic's cutting-edge AI systems like Mythos 5.
- Chinese AI labs are actively working to close the gap with top US companies.
- ByteDance has invested aggressively in AI, data centers, and talent, including its cloud unit Volcano Engine and ambitions for custom AI chips.
- The company's AI development team, Seed, has around 2,000 members and follows an independent development approach, avoiding model distillation.
- ByteDance's founder, Zhang Yiming, emphasizes independent development for achieving world-leading AI capabilities.