While numerous recent benchmarks focus on evaluating generic Vision-Language Models (VLMs), they fall short in addressing the unique …
Muhammad Sohail Danish,
Muhammad Akhtar Munir,
Syed Roshaan Ali Shah,
Kartik Kuckreja,
Fahad Shahbaz Khan,
Paolo Fraccaro,
Alexandre Lacoste,
Salman Khan
International Conference on Computer Vision (ICCV),
2025.
Text embeddings are typically evaluated on a narrow set of tasks, limited in terms of languages, domains, and task types. To circumvent …
Kenneth Enevoldsen,
Isaac Chung,
Imene Kerboua,
Márton Kardos,
Ashwin Mathur,
David Stap,
Jay Gala,
Wissam Siblini,
Dominik Krzeminski,
Genta Indra Winata,
Saba Sturua,
Saiteja Utpala,
Mathieu Ciancone,
Marion Schaeffer,
Gabriel Sequeira,
Diganta Misra,
Shreeya Dhakal,
Jonathan Rystrøm,
Roman Solomatin,
Ömer Çagatan,
Akash Kundu,
Martin Bernstorff,
Shitao Xiao,
Akshita Sukhlecha,
Bhavish Pahwa,
Rafał Poswiata,
Kranthi Kiran GV,
Shawon Ashraf,
Daniel Auras,
Björn Plüster,
Jan Philipp Harries,
Loïc Magne,
Isabelle Mohr,
Mariya Hendriksen,
Dawei Zhu,
Hippolyte Gisserot-Boukhlef,
Tom Aarsen,
Jan Kostkan,
Konrad Wojtasik,
Taemin Lee,
Marek Šuppa,
Crystina Zhang,
Roberta Rocca,
Mohammed Hamdy,
Andrianos Michail,
John Yang,
Manuel Faysse,
Aleksei Vatolin,
Nandan Thakur,
Manan Dey,
Dipam Vasani,
Pranjal Chitale,
Simone Tedeschi,
Nguyen Tai,
Artem Snegirev,
Michael Günther,
Mengzhou Xia,
Weijia Shi, Xing Han Lu,
Jordan Clive,
Gayatri Krishnakumar,
Anna Maksimova,
Silvan Wehrli,
Maria Tikhonova,
Henil Pancha,
Aleksandr Abramov,
Malte Ostendorff,
Zheng Liu,
Simon Clematide,
Lester James Miranda,
Alena Fenogenova,
Guangyu Song,
Ruqiya Bin Saf,
Wen-Ding Li,
Alessia Borghini,
Federico Cassano,
Hongjin Su,
Jimmy Lin,
Howard Yen,
Lasse Hansen,
Sara Hooker,
Chenghao Xiao,
Vaibhav Adlakha,
Orion Weller, Siva Reddy,
Niklas Muennighoff
International Conference of Learning Representations (ICLR),
2025.