Version control for AI agents and agentic workflows
Summarize
Summary of Version Control for AI Agents and Agentic Workflows
Version control allows ServiceNow customers to track and manage changes to the instructions sent to large language models (LLMs) for AI agents and agentic workflows. This feature is crucial for creating effective workflows and enables experimentation and testing of new instructions by allowing the creation, editing, and reverting of versions within the guided setup.
Show less
Key Features
- Creating Versions: Users can create a new version of the List of steps by selecting View versions > New version. This process includes naming the version and making necessary changes, with the option to set it as active immediately.
- Refining Versions: Through Now Assist, users can refine their current List of steps if an active version exists. This feature generates suggestions that can be reviewed and modified before finalizing.
- Changing Between Versions: Customers can switch active versions at any time, allowing for performance evaluations of different iterations of workflows and agents.
- Testing Different Versions: The AI Agent Studio Testing page facilitates testing with a dropdown menu to select both active and inactive versions for evaluation runs.
- Version Logs: The AI Agent Studio Activity page provides execution tracking for different versions, simplifying the identification of changes through specific version names.
Key Outcomes
By utilizing version control, ServiceNow customers can enhance the effectiveness of their AI agents and workflows. The ability to track changes and experiment with different versions leads to improved performance and better results in executing tasks with LLMs. This structured approach supports ongoing refinement and optimization of AI-driven processes.
Version control enables you to track changes made to instructions sent to the LLM for AI agents and agentic workflows.
Version control overview
When creating an AI agent or agentic workflow, the List of steps field is important because it provides the context necessary for the large language model (LLM) to accomplish tasks. You can use version control to create multiple versions of the List of steps field in the guided setup. Tracking your changes with version control helps enable you to experiment and test new instructions. You can create versions, edit and refine versions, and revert to previous versions as needed.
Creating versions
You can create a version by selecting in the guided setup of an AI agent or agentic workflow. Doing so brings up the Create a new version modal where you can name the version and make changes. Naming your version enables you to identify what changes were made to make it easier to track.
You can choose to make the new version active immediately by selecting the Set as active toggle.
For more information about writing effective descriptions and instructions, see General guidelines for creating AI agents and agentic workflows.
When creating a new version, you also have the option to use Now Assist to refine your current List of steps. You must already have an active version for this option to be available. Selecting brings up the modal where Now Assist generates and displays a new List of steps for you to review. You can change any of the generated text, or you can use it as it was generated. Select Create to use the new, refined version.
Changing between versions
When you have multiple versions of the same List of steps field, you can switch which one is active at any time. Choosing to make a new version active enables you to test it and evaluate its effectiveness.
If you’re updating an agentic workflow, you can execute an agentic evaluation run to measure performance.
You can decide which version is active by selecting View versions in the guided setup. Toggle the Set as active field and save your changes to make the new version active.
Testing different versions
You can test different versions of an agentic workflow or AI agent from the AI Agent Studio Testing page. The Version selector dropdown displays both active and inactive versions with the currently active version marked as (Active). You can also start evaluation runs for specific versions by selecting Set up evaluation run.
Version logs
The AI Agent Studio Activity page enables you to track AI agent and agentic workflow executions by version. When in the guided setup, you can select View version logs in the View all versions modal. Choosing to view the version logs opens the Activity tab in a new window with the list filtered for the version you selected.
When viewing the Activity tab at any time, you can choose to filter by version. The more specific your version names, the easier it is to identify those changes in the list.