ServiceNow AI Research

Safety and Security

DoomArena: A framework for Testing AI Agents Against Evolving Security Threats
DoomArena: A framework for Testing AI Agents Against Evolving Security Threats
We present DoomArena, a security evaluation framework for AI agents. DoomArena is designed on three principles: 1) It is a …
Conference on Language Modeling (COLM),  2025.
PDF Cite Code
DoomArena: A framework for Testing AI Agents Against Evolving Security Threats
DoomArena: A framework for Testing AI Agents Against Evolving Security Threats
We present DoomArena, a security evaluation framework for AI agents. DoomArena is designed on three principles: 1) It is a …
Workshop at the International Conference of Machine Learning (ICML),  2025.
PDF Cite Code
Silent Sabotage: Injecting Backdoors into AI Agents Through Fine-Tuning
Silent Sabotage: Injecting Backdoors into AI Agents Through Fine-Tuning
The rise of AI agents that can use tools, browse the web and interact with computers on behalf of a user, has sparked strong interest …
Workshop at the International Conference of Machine Learning (ICML),  2025.
PDF Cite
No, of course I can! Refusal Mechanisms Can Be Exploited Using Harmless Fine-Tuning Data
No, of course I can! Refusal Mechanisms Can Be Exploited Using Harmless Fine-Tuning Data
Leading language model (LM) providers like OpenAI and Google offer fine-tuning APIs that allow customers to adapt LMs for specific use …
Workshop at the International Conference of Learning Representation (ICLR),  2025.
PDF Cite Video