Website Web Scrapping by Servicenow

[Avishandilay]

Hi Team,
I need to pull out some data from a website on EOD basis. Can it be done using the ServiceNow? 

[Amit Verma]

Hi @Avishandilay 

I could think of the following ways to achieve this :

1. Run a PowerShell Mid Server Script file from Mid Server. Inside the PowerShell script, make use of Selenium to do the web scrapping for you and get the result.

2. Run a PowerShell Mid Server Script file from Mid Server and call a Python Script. Inside the Python script, make use of the following modules to do the web scrapping for you and get the result :

• Requests

• Beautiful Soup

• lxml

• Selenium

3. If you have any REST APIs available to fetch the same data from the website, make use of ServiceNow REST Message to get it.

Thanks & Regards

Amit Verma