Ideas
ADD A NEW IDEA

FILTER BY CATEGORY

Metadata

Showing 50 of 379

Data Security Policy Enforcement (Alternative to Ranger)

Current setup is based on S3, Ranger and EMR. But defining security policies in Ranger does not enforce the security policies when data is accessed by tools outside of EMR eg. presto, athena. Desired solution would be cloud/platform agnostic secur...
Nikhil Goel almost 2 years ago in Data Security / Metadata 0 On the Backlog

API for exporting files from Data Lake

Customer expects a ZDP API that would allow them to download files from the Data Lake without having to communicate with the storage layer directly. The data may be stored in HDFS, S3, ADLS or GCP.Basically current we can export records in a file ...
Sabyasachi Gupta about 2 years ago in Catalog / Metadata management 0 On the Backlog

Ability to catalog files

Catalog files (including structured and unstructured)Capture metadata, lineage, profile (for structured data) at file levelCapability to extract and store metadata embedded in the files (eg. DICOM..)Expected number of files - 1M+API for uploading,...
Nikhil Goel about 2 years ago in Metadata 0 Future consideration

Lineage: Default view should show latest activity

1. As a <user persona>| <user role>| <user permissions>Business user2. I want (Feature Details):To see latest activity happened on entity first with an option of 'Expand all' which will give an ability to track lineage back in ti...
Ajinkya Rasam about 2 years ago in Lineage 0 On the Backlog

Lineage: Enable for DB/File ingestion wizard

1. As a Business user2. I want (Feature Details):See entity lineage for files ingested via DB wizard or file ingestion wizard3. So that (Use case details):Lineage on wizard ingestion is not lost.4. Acceptance Criteria: (performance expectations, s...
Ajinkya Rasam about 2 years ago in Lineage 0 On the Backlog

Need hierarchy within Entities

The intent is to be able to have a hierarchy within the Entities itself in ZDP
Gaurav Chakravarti about 2 years ago in Metadata 0 Future consideration

Assistance with Destination Path in File Pattern

1. As a data miner that isresponsible for bringing data in the the ZDP from a variety of sources, but especially from files, 2. I want the ZDP system to assist me in assuring that the Destination Path specified in the File Pattern matches the Loca...
Nikhil Goel about 2 years ago in Data Ingestion / Metadata 0 On the Backlog

Show/Hide business metadata

Need flexibility to hide/un-assessable Business metadata. Technical metadata can continue to be visible/available for users. What this means is that while sharing entities is at either business metadata or technical metadata or both. It’s needed b...
Sabyasachi Gupta over 2 years ago in Metadata management / Metadata 0 On the Backlog

With reference to 9154: Teradata char /varchar changed to string by default in hive using db import

DB Import action is being used for importing tables from Teradata. Sqoop, which is the internal implementation of DB Import action, converts the datatype VARCHAR to the corresponding Hive type STRING and hence the corresponding ZDP entity field is...
Nikhil Goel over 2 years ago in Data Ingestion / Metadata 0 Changed to Defect

Ingest History - Table Row Count

Customer would like to have details on rows counts ingested from tables. Today, ZDP 5.0.2 displays no information on the daily record loads from DBMS. User would like to validate that these match in both a visual and cumulative report. Suggestio...
Deleted User over 2 years ago in Metadata / Discovery / Data Ingestion 0 On the Backlog