Research Papers

MoE Lens - An Expert Is All You Need
Practical downstream application of interpretability for compute optimization.
Marmik Chaudhari, Idhant Gulati, Nishkal Hundia, Pranav Karra, Shivam Raval
ICLR SLLM Workshop 2025
Advisory capacity
Click to view paper →

Augmenting X-ray Astronomical Representations with Scientific Knowledge through Contrastive Learning
Multimodal representation alignment for astronomical data.
Juan Rafael Martínez-Galarza, Nicolò Oreste Pinciroli Vago,, Shivam Raval, , Carolina Cuesta-Lazaro, Melanie Weber, David Alvarez-Melis, Alberto Accomazzi, Cecilia Garraffo, Joshua Knutson, Ryan Thill, Christopher B Green, Imantha Ahangama
ICLR Re-Align Workshop 2025
Click to view paper →

Hypertrix: An indicatrix for high-dimensional visualizations
Visualizing and identifying anomalous distortion in visual projections
Shivam Raval, Fernanda Viegas, Martin Wattenberg
IEEE VIS 2024
Best Short Paper Award
Click to view paper →