← Timeline

Notes

Opus 5.5 is apparently evaluation aware

It’s highly likely that we don’t currently have the mechanisms to tell when a model becomes evaluation aware. Another way to think about this is that Claude knows how to cheat without getting caught, but to reiterate, we can’t tell that at the moment.

Lukas Petersson’s chart of cheating across Claude releases.