Below are the steps:
In the SFTP step available OOB (requires Integration Hub subscription), using Get File List command we can pass source path and get the file names present in that folder. This command also accept filenames with wild card character to get specific files. In our case, filename appends with timestamp at the end. So we passed filename as “<filename>_*.csv” and retrieved complete filename shown below.
Output:
Using script, we can read the filename and pass it over to the SFTP data source which pulls data from the server.
Other commands like Copy Files To This Instance are also available which will reduce multiple SFTP calls to the server.
PS: To make this work, you should allow connection between mid server and SFTP server.
