Configuring monitoring and evaluations in AI Control Tower
Set up monitoring in AI Control Tower by activating evaluations, adding metrics, and configuring metric templates.
Configuration overview
Setting up monitoring involves enabling scoring for each type of AI system you want to evaluate, managing which metrics to include, and configuring metric templates that define how quality and safety scores are calculated. After the initial setup, you can adjust which AI systems are included in scoring as your portfolio changes.
- Monitor a ServiceNow AI system
Begin monitoring quality for ServiceNow AI systems by activating evaluation scoring.
- Monitor an external AI system
Activate evaluation scoring for external AI systems, generate an API key, and configure trace data collection.
- Configure evaluation metric templates
Define how quality and safety scores are calculated by selecting metrics, assigning weights, and creating the scoring formula for each AI system type.