Nonlinear Dynamics

NerVE: Nonlinear Eigenspectrum Dynamics in LLM Feed-Forward Networks

Introduces eigenspectrum-based tools for tracking how nonlinearities reshape FFN representation geometry across layers and model scales.

Nandan Kumar Jha, Brandon Reagen