Gopeshh Subbaraj

Publications

Using Scaling Laws for Data Source Utility Estimation in Domain-Specific Pre-Training. Oleksiy Ostapenko, Charles Guille-Escuret, Luke Kumar, Max Tian, Denis Kocetkov, Gopeshh Subbaraj, Raymond Li, Joel Lamy Poirier, Sébastien Paquet, Torsten Scholak. At COLM Workshops, 2025.

Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning. Md Rifat Arefin, Gopeshh Subbaraj, Nicolas Gontier, Yann LeCun, Irina Rish, Ravid Shwartz-Ziv, Christopher Pal. At International Conference of Learning Representations (ICLR), 2025.

PDF Cite Code Slides Video