tech
This week's Anthropic-inspired AI freakout, explained
Anthropic limits AI model use, citing safety concerns. But it's also trying to stop open-source models from competing.
TL;DR
- Anthropic will now inform developers when their requests are routed to a less capable model instead of secretly degrading responses.
- The company claims restrictions on its most powerful model are for safety, to prevent foreign adversaries from gaining an AI advantage.
- These restrictions also serve a business purpose by preventing rivals from using model distillation to improve their own systems.
- Open-source models are rapidly catching up to closed models in performance and are significantly cheaper, posing a competitive threat.
- Critics suggest the restrictions are as much about business protection as they are about safety, given the competitive landscape.