Teradata metadata collector
Summarize
Summary of Teradata Metadata Collector
The Teradata Metadata Collector is a tool designed to harvest read-only metadata from a Teradata database account. It captures detailed metadata about various Teradata objects such as user defined functions, stored procedures, triggers, user defined types, and methods. The collector connects to Teradata using username and password authentication, requiring a dedicated database user with appropriate permissions to run.
Show less
Key Features
- Metadata Cataloged: The collector gathers extensive metadata including database types, tables, indexes, schemas, views, user defined functions, stored procedures (SQL and external), triggers, user defined types, and methods. Metadata details include creation and modification information, descriptions, keys, sizes, and definitions.
- Profiling and Sampling: If enabled, the collector also harvests column-level profiling data such as average/max/min values, data distribution, distinct values, sample strings, and row counts. This requires read access to the actual data.
- Relationships and Lineage: The harvested metadata automatically includes relationships between resources like tables, columns, indexes, triggers, schemas, and databases. It captures lineage information for views and stored procedures, identifying data sources, sorting, filtering, aggregation, and downstream table updates, with some limitations on certain SQL constructs.
Practical Considerations for ServiceNow Customers
- Authentication Setup: Before running the collector, create a dedicated Teradata user with necessary permissions to ensure secure and successful metadata harvesting.
- Collector Creation: Configure the Teradata Metadata Collector in your ServiceNow environment to import metadata effectively from your Teradata database.
- Data Profiling Access: Ensure users or roles have read privileges on Teradata data to enable profiling and sampling features for richer metadata insights.
- Lineage Limitations: Be aware that lineage extraction does not support SQL statements with variable-defined queries, SELECT INTO clauses, multiple inserts in stored procedures, or transient table creation within stored procedures.
Benefits
Enabling the Teradata Metadata Collector allows ServiceNow customers to gain comprehensive visibility into their Teradata environment’s metadata, understand data relationships and lineage, and enhance data governance, impact analysis, and compliance efforts. This detailed metadata foundation supports better data management and informed decision-making.
The Teradata metadata collector harvests read-only metadata from a Teradata account.
The collector harvests metadata from Teradata, including user defined functions, stored procedures, triggers, user defined types, and user defined methods.
Authentication supported
The collector authenticates to Teradata using username and password. Before running the collector, set up a dedicated database user with the required permissions. See Prepare to run the Teradata Collector.
Metadata cataloged
| Object | Information cataloged |
|---|---|
| Database | Type, Name, JDBC URL Extended metadata: Created By, Created At, Updated By, Updated At, Owner name, Space allocation (permanent, spool, temporary), Description |
| Table | Name, Description, Primary Key, Foreign Key, Sample rows (if data sampling is enabled) Extended metadata: Created By, Created At, Updated By, Updated At, Size |
| Table index | Index Cardinality, Column name, Index Type, Index Name, Is Non Unique, Column Ordinal Position, Pages, Column Sort Sequence |
| Schema | Name |
| Column | Name, Description, Data Type, Is Nullable |
| View | Name, Description, SQL definition, Created By, Created At, Updated By, Updated At |
| User defined functions | Name, Function type Extended metadata: Definition, Deterministic characteristic, Null-call characteristic, Description, Number of parameters, Source file language, Data access, Parameter style, Execution protection mode, Platform type, Character type, Created, Created By, Last Modified, Last Modified By, External File Reference |
| SQL stored procedures | Name, Description, Stored procedure type, Definition Extended metadata: Created, Created By, Last Modified, Last Modified By |
| External stored procedures | Name, Stored procedure type Extended metadata: Definition, Application category, Description, Number of parameters, External file reference, Execution protection mode, Character type, Platform type, Source file language, Parameter style, Data access |
| Triggers | Name, Fired at instant Extended metadata: Created By, Created At, Updated By, Updated At, Name, Evaluation type, Fired on event, Trigger enabled, Order number, Definition, Trigger Comment, Subject Table Name, Action Time, Trigger Definition |
| User defined types | Extended metadata: Name, Type, Default transform group, Ordering form, Ordering Category, Default null specified for array, All operators supported, Encryption supported, Compression supported, Instantiable, Final |
| User defined methods | Name, Description, Number of parameters, Source file language, Data access, Parameter style, Deterministic characteristic, Null-call characteristic, Execution protection mode, Character type, Platform type |
Profiling and sampling specific information.
If you include the profiling and sampling specific parameters while running the collector, the following additional information is harvested for columns.
| Object | Information cataloged |
|---|---|
| Column |
|
| Table |
|
Relationships between objects
By default, the harvested metadata includes catalog pages for the following resource types. Each catalog page has a relationship to the other related resource types. If the metadata presentation for this data source has been customized, you might see other resource pages and relationships.
| Resource page | Relationship |
|---|---|
| Table |
|
| Columns |
|
| Table indexes | Columns |
| Trigger | Table triggers on tables |
| Schema |
|
| Database | Schema contained in database |
Lineage for Teradata
The Teradata collector collects the following lineage information.
| Object | Lineage available |
|---|---|
| View | The collector identifies the associated column in an upstream view or table:
|
| Stored procedure | The collector identifies:
Lineage is not available in the following cases:
|