Efficient Inference
We introduce multi-token prediction (MTP) variants of
the Apriel model family, designed to generate multiple to-
kens per forward pass. …
Large Language Models achieve their success through transformer architectures with attention mechanisms that compute token …
Retrieval-Augmented Generation (RAG) has become ubiquitous when deploying Large Language Models (LLMs), as it can address typical …
Graph databases like Neo4j are gaining popularity for handling complex, interconnected data, over traditional relational databases in …
We take significant steps toward unifying autoregressive and diffusion-based sequence generation by extending the SEDD discrete …
In-context learning (ICL) approaches typically leverage prompting to condition decoder-only language model generation on reference …
We present a simple meta quantization approach that quantizes different layers of a large language model (LLM) at different bit levels, …