Private AI

AERO: Entropy-Guided Attention for Private LLM Inference
Develops entropy-guided attention and hierarchical entropy regularization for efficient private LLM inference with reduced nonlinearities.
Nandan Kumar Jha, Brandon Reagen
Cite Code Poster Video Earlier arXiv Press release
AERO: Entropy-Guided Attention for Private LLM Inference
Entropy and Private Language Models
Invited seminar on entropy dynamics and efficient private language-model inference.
Apr 1, 2025 2:00 PM — 3:00 PM New York University
Slides Video
Entropy-Guided Attention for Private LLMs
Fireside chat on entropy-guided attention mechanisms for efficient private LLM inference.
Jan 1, 2025 Virtual Event
Video