Well, they read your code in the actual hiring loop.

measurablefunc · 2026-01-21T09:09:42 1768986582

My point still stands. I don't know what the LLM is doing so my guess is it's cheating unless there is evidence to the contrary.

red75prime · 2026-01-21T09:51:53 1768989113

I guess your answer to "Try to run Claude Code on your own 'ill-defined' problem" would be "I'm not interested." Correct? I think we can stop here then.

KeplerBoy · 2026-01-21T11:13:56 1768994036

Well that's certainly a challenge when you use LLMs for this test driven style of programming.

saagarjha · 2026-01-21T09:21:47 1768987307

Why do you assume it’s cheating?

measurablefunc · 2026-01-21T10:55:59 1768992959

Because it's a well know failure mode of neural networks & scalar valued optimization problems in general: https://www.nature.com/articles/s42256-020-00257-z

saagarjha · 2026-01-21T11:41:56 1768995716

Again, you can just read the code

red75prime · 2026-01-21T11:32:55 1768995175

And? Anthropic is not aware of this 2020 paper? The problem is not solvable?