FairStress: A Novel Fairness Evaluation Framework for Symmetric Robustness in LLM Decision-Making
FairStress is a new benchmark that focuses on the decision stability, interpretability consistency, and internal representation symmetry of large language models (LLMs) in demographic identity substitution scenarios. It reveals systematic behavioral biases in these models, such as “anti-stereotypical over-correction,” and highlights that mainstream evaluation methods—like BBQ—may misjudge the direction of bias due to paradigmatic differences.