ServiceNow AI Research

State Space Models

Apriel-SSM: Converting Pre-Trained Transformer LLMs Into Subquadratic Hybrid Models Through Iterative End-to-End Distillation
Apriel-SSM: Converting Pre-Trained Transformer LLMs Into Subquadratic Hybrid Models Through Iterative End-to-End Distillation
Large Language Models achieve their success through transformer architectures with attention mechanisms that compute token …
NOW AI,  2025.
Cite
Efficient Dynamics Modeling in Interactive Environments with Koopman Theory
Efficient Dynamics Modeling in Interactive Environments with Koopman Theory
The accurate modeling of dynamics in interactive environments is critical for successful long-range prediction. Such a capability could …
International Conference of Learning Representations (ICLR),  2024.
PDF Cite
Efficient Dynamics Modeling in Interactive Environments with Koopman Theory
Efficient Dynamics Modeling in Interactive Environments with Koopman Theory
The accurate modeling of dynamics in interactive environments is critical for suc- cessful long-range prediction. Such a capability …
European Workshop on Reinforcement Learning (EWRL),  2023.
PDF Cite