We've updated the ServiceNow Community Code of Conduct, adding guidelines around AI usage, professionalism, and content violations. Read more

URL encoding and HTTPS File retrieval method in data source

avid
Kilo Expert

Hello.

I'm, trying to import a CSV report via https URL.

When I try To download the file with the browser I don't need to provide any credentials because of the token that already in the URL and it expires after a while.

I want to download and process the file with the data source by using the HTTPS File retrieval method, but when I put the URL in the server+file path fields and try to import it. I get an error.

I've noticed that the URL that I get with the error is not similar to the URL I provided and it tried to encode it. for example, my original URL contains this string :
%2Fm%

And the URL with the error replacing the original string with this:

%252Fm

 

 

find_real_file.png
 

I guess the data source tries to decode special chars but I would like to avoid it because it fails. 

 

Things I've tried:

1. Use a get method in rest web service - The same error with the data source.

2. Use decodeURIComponent('THE URL STRING'), and put the result in the file path in the data source  - still, I'm getting an error

3. Create a CURL rest command with the MID server to download the file locally - I was managed to download the file successfully but I don't want to use the mid server. 

4. Put the URL in postman - successfully download the file. 

Thank you.

 

 

 

 

 

 

3 REPLIES 3

Jeffrey DJ
Kilo Expert

I'm wondering if this is an authentication issue as indicated by 403 status.

No it's not.

I can download the file after copying and pasting it in the browser.

you mentioned that you used postman to test the URL, what kind of auth did you use?