Anthropic has to keep revising its technical interview test so you can't cheat on it with Claude
Since 2024, Anthropic's performance optimization team has given job seekers a take-home test to make sure they know their stuff — but as AI coding tools have gotten better, the test has had to change a lot to stay ahead of AI-assisted cheating.
TL;DR
- Anthropic's take-home coding test has been repeatedly redesigned since 2024 to counter AI-assisted cheating.
- New AI models, such as Claude Opus 4 and 4.5, have surpassed human performance on the test.
- The current test format makes it impossible to differentiate between top human candidates and AI output.
- Anthropic developed a new test with novel problems to stump contemporary AI tools.
- The team is seeking better solutions and has shared the original test for public input.