02 / IT · Analysis
AI leaderboard separates accuracy from self-error detection
The evaluation distinguishes getting an answer right from recognising an error in the model's own answer.

JGENai and VIDRAFT jointly released a public leaderboard covering 24 AI models [collection time not reported], according to a DEV report. That figure describes the reported evaluation scope, rather than a count of reaction posts.
DEV reported that the release introduced a tool to evaluate whether AI can detect its own errors. Its stated purpose extends beyond assessing whether answers are correct.
That distinction matters when reading the rankings: an evaluation's aim does not itself establish how well models detect mistakes. The leaderboard therefore needs to be read in terms of what it seeks to measure.
Answer accuracy and self-error detection
DEV described the approach as metacognition evaluation: assessing the ability to reflect on one's own judgement. Here, the focus is whether a model recognises errors in its answers.
The report distinguished answer correctness from self-error detection. These are separate evaluation targets, and the stated goal should not be read as evidence of successful detection.
Model-specific modules accompany the leaderboard
According to DEV, the release also included 11 model-specific metacognition adapters [collection time not reported]. These are supplementary modules attached to models to target self-error detection.
DEV presented the leaderboard and adapters together as tools for evaluation. The distinction remains between releasing those tools and demonstrating error detection; the results must establish whether models meet the stated aim.