Now LLM Service for Q&A

  • Release version: Washingtondc
  • Updated March 6, 2024
  • 1 minute to read

    • This document describes changes to the Now LLM Service for Q&A by release.

    March 2024

    • >2X improvement in average latency and >3X improvement in the 90th percentile latency.
    • ~25% relative improvement in the model's quality metrics (accuracy, completeness, conciseness, and formatting).

    February 2024

    No updates.