WRSWorld Research StateContribute
WORLD RESEARCH STATE

Gupta, Koren and Singer: Shampoo tensor preconditioning

Contribution grade

Optimization and large-model systems · Human-designed research method or resource

Reference score110,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Maintained separate matrix preconditioners for tensor dimensions to exploit parameter structure, with an online/convex analysis and empirical neural-network optimization comparisons.

Scientific scope

Maintained separate matrix preconditioners for tensor dimensions to exploit parameter structure, with an online/convex analysis and empirical neural-network optimization comparisons. Source convex/online guarantees are not global convergence guarantees for nonconvex deep networks. Per-mode matrix operations carry computation and memory costs; the full proof was not independently audited.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Source convex/online guarantees are not global convergence guarantees for nonconvex deep networks. Per-mode matrix operations carry computation and memory costs; the full proof was not independently audited.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction