ServiceNow Research

Distilation

PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation
Data augmentation is a widely used technique to address the problem of text classification when there is a limited amount of training …
On Difficulties of Probability Distillation
Probability distillation has recently been of interest to deep learning practitioners as it presents a practical solution for sampling …