Distillation
Generalization bounds for deep learning models are typically vacuous, not computable or restricted to specific model classes. In this …
Training-time privileged information (PI) can enable language models to succeed on tasks they would otherwise fail, making it a …
Data augmentation is a widely used technique to address the problem of
text classification when there is a limited amount of training …
Probability distillation has recently been of interest to deep learning practitioners as it presents a practical solution for sampling …