ServiceNow Research

In-Context Learning

XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference
XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference
In-context learning (ICL) approaches typically leverage prompting to condition decoder-only language model generation on reference …
Conference on Empirical Methods in Natural Language Processing (EMNLP),  2024.
PDF Cite Code
InCoRo: In-Context Learning for Robotics Control with Feedback Loops
InCoRo: In-Context Learning for Robotics Control with Feedback Loops
One of the challenges in robotics is to enable robotic units with the reasoning capability that would be robust enough to execute …
ArXiv,  2024.
PDF Cite
MAGNIFICO: Evaluating the In-Context Learning Ability of Large Language Models to Generalize to Novel Interpretations
MAGNIFICO: Evaluating the In-Context Learning Ability of Large Language Models to Generalize to Novel Interpretations
Humans possess a remarkable ability to assign novel interpretations to linguistic expressions, enabling them to learn new words and …
Conference on Empirical Methods in Natural Language Processing (EMNLP),  2023.
PDF Cite Code
In-Context Learning for Text Classification with Many Labels
In-Context Learning for Text Classification with Many Labels
In-context learning (ICL) using large language models for tasks with many labels is challenging due to the limited context window, …
Workshop at the Conference on Empirical Methods in Natural Language Processing (EMNLP),  2022.
PDF Cite