If you follow online chess drama you might have noticed that Vladimir Kramnik has been on a crusade against online cheating, especially on chess.com. He has often based his analysis on the Chess.com accuracy scores.
The fact that they use different depths based on the player ratings make it impossible to compare accuracy numbers. It's clear that it is a marketing tool (and a good one too because players like it)
I actually made a python script that keeps a log of stockfish best move at depth 1, 2, 3, and so on.. if it changes move and position eval beyond depth 1 you can say it is a difficult move. The deeper stockfish has to look to find the best move indicates a harder move to find/calculate
Interesting piece. Has anyone tried to test a large database on the chess.com accuracy vs. lichess accuracy or even centipawn loss to see how far off it is from known algorithms?
The fact that they use different depths based on the player ratings make it impossible to compare accuracy numbers. It's clear that it is a marketing tool (and a good one too because players like it)
That's a really good point!
Makes me wonder how you would test for the difficulty of the move.
I actually made a python script that keeps a log of stockfish best move at depth 1, 2, 3, and so on.. if it changes move and position eval beyond depth 1 you can say it is a difficult move. The deeper stockfish has to look to find the best move indicates a harder move to find/calculate
Can you share that python script?
It still needs a little more work then I will share it 👍🏻
I've been trying to learn how to script stockfish analysis so I would love to see it.
Interesting piece. Has anyone tried to test a large database on the chess.com accuracy vs. lichess accuracy or even centipawn loss to see how far off it is from known algorithms?
Thanks! I haven’t stumbled into any analysis or tries to find out