AI Desktop Actions
Summarize
Summary of AI Desktop Actions
ServiceNow® AI Desktop Actions empowers you to design, configure, and manage automated desktop and web tasks that reduce repetitive manual work across legacy systems, thick client applications, and web environments without requiring APIs. AI agents can autonomously or semi-autonomously interpret instructions, develop execution plans, and perform multi-step tasks involving conditional logic, adapting in real time to UI changes and managing errors by evaluating context and trying alternative methods.
Show less
Types of Desktop Actions
- Defined Path Desktop Actions: Record or capture a fixed sequence of steps executed deterministically by AI agents. Ideal for repeatable tasks with consistent UI interactions on desktop and web-based applications.
- Adaptive Path Desktop Actions: Specify high-level task goals for web-based tasks. AI agents dynamically generate execution plans and adapt to changing UI elements, supporting flexibility and decision-making in task execution.
Practical Use and Getting Started
ServiceNow customers can:
- Learn key concepts and features of AI Desktop Actions.
- Configure the system to automate desktop tasks, especially for legacy applications lacking APIs.
- Create custom AI agents leveraging advanced multi-agent reasoning frameworks.
- Execute automations through AI agents using the AI Desktop Actions application.
Considerations and Limitations
- Availability of AI model providers and Now Assist features varies by region, data center, and environment restrictions. Customers should check the latest availability updates and knowledge base articles.
- This application uses AI and machine learning, which may not always produce fully accurate or appropriate outputs. Customers must thoroughly test and apply human oversight, especially in sensitive or high-impact domains such as healthcare, finance, legal, or security.
- Data processed by this application may be transferred across different data centers or third-party cloud providers, handled according to ServiceNow’s compliance policies.
- Inputs, outputs, and script usage data may be collected to improve ServiceNow AI technologies, with options available for customers to opt out of data collection.
Helpful Resources
- ServiceNow Community Workflow Automation product discussions.
- Known Error Portal for troubleshooting known issues.
- Customer Service and Support for direct assistance.
ServiceNow® AI Desktop Actions enables you to design, configure, and manage desktop actions that automate repetitive tasks in your desktop and web environment. AI agents can autonomously and semi-autonomously process instructions, generate execution plans, and run desktop actions across legacy systems, thick client applications, and web applications without APIs.
- Automating multi-step desktop or web tasks that involve conditional logic, so agents can focus on work that needs a human touch.
- Adapting to changes in application state and UI in real-time, reducing the need to maintain rigid scripts.
- Helping detect and recover from errors by evaluating context and trying alternative approaches when something doesn't go as expected.
Types of desktop actions
There are two types of desktop actions: defined path and adaptive path. Both enable AI agents to automate tasks on behalf of users, but they differ in how steps are designed and executed, what applications they support, and how they handle variation in the user interface.
- Defined desktop actions for desktop and web-based tasks (deterministic)
- With defined path desktop actions, you record with AI or capture a fixed sequence of steps in the AI Desktop Actions
Windows application. The AI agent executes these predefined steps in order without deviation.
Best for: Repeatable tasks with consistent steps and predictable UI interactions.
- Adaptive desktop actions for web-based tasks (probabilistic)
- With adaptive path desktop actions, you describe what task you want to accomplish at a high level in the tool configuration for web-based tasks. The web-based tasks include performing tasks on web applications or websites. The
AI agent processes the request, generates an execution plan, and dynamically determines the specific steps needed to complete the task.
Best for: Tasks that require flexibility, decision-making, or adaptation to changing UI elements.
For more information, see When to use adaptive vs. defined path desktop actions.
Get started
- Not all model providers are available for customers with in-country SKUs, and some Now Assist products/features are currently unavailable for in-country customers. For more information, see the KB1584492 article in the Now Support Knowledge Base. Be sure to check for model provider availability updates in future releases.
- Some Now Assist products/features are currently unavailable for customers in the FedRAMP, NSC DOD IL5, or Australia IRAP-Protected data centers, self-hosted customers, or in other restricted environments. For more information, see the KB0743854 article in the Now Support Knowledge Base. Be sure to check for availability updates in future releases.
- Some Now Assist products/features are currently available only for customers in some regions. Be sure to check for availability updates in future releases.
- Some AI products and skills are not available in Regulated Markets. For more information, see KB2593939: Regulated Markets AI Products/Skills Not Available. Be sure to check for availability updates in future releases.
Helpful resources
AI limitations
This application uses artificial intelligence (AI) and machine learning, which are rapidly evolving fields of study that generate predictions based on patterns in data. As a result, this application may not always produce accurate, complete, or appropriate information. Furthermore, there is no guarantee that this application has been fully trained or tested for your use case. To mitigate these issues, it is your responsibility to test and evaluate your use of this application for accuracy, harm, and appropriateness for your use case, employ human oversight of output, and refrain from relying solely on AI-generated outputs for decision-making purposes. This is especially important if you choose to deploy this application in areas with consequential impacts such as healthcare, finance, legal, employment, security, or infrastructure. You agree to abide by ServiceNow’s AI Acceptable Use Policy, which may be updated by ServiceNow.
Data processing
This application requires data to be transferred from ServiceNow customers' individual instances to a centralized ServiceNow environment, which may be located in a different data center region from the one where your instance is, and potentially to a third-party cloud provider, such as Microsoft Azure. This data is handled per ServiceNow's internal policies and procedures, including our policies available through our CORE Compliance Portal.
Data collection
ServiceNow collects and uses the inputs, outputs, and edits to outputs of this application to develop and improve ServiceNow technologies including ServiceNow models and AI products. In addition, this application will collect information about scripts (and associated script records) in which Now Assist for code generation is called. Customers can opt out of future data collection at any time, as described in the Now Assist Opt-Out page.
For more information, see the Now Assist documentation.