Create a Fivetran metadata collector

Create a collector to import metadata from Fivetran.

Before you begin

Before you begin, verify the following:

• A MID Server is setup for the collectors. For more information, see MID Server for metadata collectors.
• All per-requisite tasks are completed. For more information, see Prepare to run the Fivetran collector.
• Role required: connection-admin

Procedure

1. Navigate to All > Workflow Data Fabric > Workflow Data Fabric Home.
2. Select the Connect Hub icon in the left sidebar.
3. Select Create > Metadata collector.
4. From the System list, select Fivetran.
5. From the Connection type list, select one of the following:
   1. Select New connection to configure a new connection.
   2. Select Existing connection to reuse an existing connection and select an existing connection from the Connections list.
      The configuration form is filled with details from the existing connection. The name is appended with the word Copy and sensitive details like password aren't copied.
6. On the form, fill in the fields.

   Table 1. Azure Data Factory metadata collector form

   Field	Description
   Connection name	Unique identifier for the connection. This field can't be modified once the connection is established.
   Short description	Purpose and details of the connection.

7. Enter the Fivetran authentication details.

   Table 2. Fivetran authentication details

   Field	Description
   Fivetran API key	The Fivetran API key used to authenticate to the REST API.
   Fivetran API secret	The Fivetran secret used to authenticate to the REST API.

8. Enter the Fivetran configuration details.

   Table 3. Fivetran configuration details

   Field	Description
   Exclude groups	Exclude the specified Fivetran group's contents from the catalog.
   Include only groups	Include only the specified Fivetran group's contents in the catalog.

9. Configure the advanced options.

   Table 4. Advanced options

   Field	Description
   Max retries	The number of times the system retries a failed API call. Default: 5
   Retry delay	The number of seconds to wait between retry attempts for a failed API call. Default: 2 seconds

10. Select Save.

Result

The metadata collector is created and appears on the Connectors page with a Configured status. It is now ready to connect to the source system and harvest metadata.

What to do next

After creating the collector, you can perform any of the following tasks:

• Run the collector manually to harvest metadata immediately. See Run metadata collectors manually.
• Automate metadata collection by scheduling regular collector runs. See Schedule metadata collector runs.
• Monitor execution status and troubleshoot issues by viewing the runtime logs. See View runtime logs for collector runs.
• Discover and evaluate the harvested data assets in the Data Catalog. See Governing the Data Catalog.