On the Sparsity of Direct Preference Optimization: Weight Disentanglement in the NTK Regime
Theory for why direct preference optimization produces sparse weight updates, in the NTK regime.
Explainer · on the wire
The explainer for this story is still on the wire.
The claim, the mechanism, and the figures land here once generated.
Source · arXiv wire