Spectral Regularization as a Safety-Critical Inductive Bias

An interesting approach that seems intuitively reasonable. The main shortcomings are in the experimental scope. Namely, comparison directly with adversarial training of different types is important, as well as conceptually similar regularizes (gradient penalties, Jacobian norm, Sobolev training, spectral norm constraints). Furthermore, one should benchmark robustness against stronger attacks (CW, autoattack) as PGD is relatively weak.

This project offers a highly effective, physics-inspired approach to enhance adversarial robustness, directly addressing a critical AI safety concern with strong empirical evidence.

This is a tidy project that adds a high-frequency fourier mode regularizer to the loss, claiming shocking gains in robustness compared to a baseline model. The physics connection is sound, but the framing could use some work. Spectral bias is a training phenomenon; your penalty acts on the final decision surface to reinforce this by smoothing out wrinkles learned later in training. While the safety connection -- robustness by design -- is clear, more focus could have been paid to what kinds of adversarial examples this approach filters out. The author also missed relevant literature i) questioning the spectral bias hypothesis and ii) applying similar techniques to hidden layers or input gradients (e.g., Ross et al. 2017, Yin et al. 2019). This doesn't mean the work has already been done, but could have helped to contextualize the results. Finally, the methodology and plots are largely unexplained (e.g., the regularizer weight, type of attack), adding to a loss in confidence of these results.

The author proposes that altering models’ training objectives by adding a loss term penalizing their sensitivity to high-frequency input changes could make them more robust to adversarial perturbations without substantially penalizing performance. The intuition is that such a loss term would force models to learn smoother functions that are intrinsically less exploitable by pixel-scale noise. The author tested this idea on a ResNet model trained on CIFAR-10 and found that it achieved 102% relative improvement in adversarial robustness with a negligible accuracy loss.

This was perhaps the most mature of the entries that I reviewed. The paper presents a clear AI safety motivation (the problem of adversarial vulnerability), proposes to address it with a mathematically precise physics-motivated regularizer, implements it in code, reports a clear-cut improvement on safety metrics and suggests a well-motivated set of next steps (scaling to other datasets/models and head-to-head comparison with other adversarial defenses). I think it’s a promising candidate for continued research beyond this hackathon.

The submission proposes and studies a novel regularization method for adversarial robustness, based on adding an auxiliary loss term constructed from the high-frequency components of the loss gradient. Adversarial robustness is an interesting topic, and the project finds some positive preliminary results for the proposed method. The project could be improved by discussing more explicitly the connection between the regularization of high-frequency components in the loss, and the high-frequency noise structure in data that’s thought to enable adversarial examples.