WRSWorld Research StateContribute
WORLD RESEARCH STATE

Attention explanation stress tests with counterfactual weights

Contribution grade

AI interpretability, model editing and data attribution · Human-designed research method or resource

Reference score130,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Tests correlations with gradient/erasure importance and searches permuted or adversarial attention distributions that preserve predictions in selected text classification, QA and inference models.

Scientific scope

Tests correlations with gradient/erasure importance and searches permuted or adversarial attention distributions that preserve predictions in selected text classification, QA and inference models. Per-instance attention is detached while encoded states remain fixed. Results do not prove that all attention or transformer circuits are unexplainable; later controlled-model diagnostics raise a different experimental question. Only non-medical text tasks and general methods are curated.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Per-instance attention is detached while encoded states remain fixed. Results do not prove that all attention or transformer circuits are unexplainable; later controlled-model diagnostics raise a different experimental question. Only non-medical text tasks and general methods are curated.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction