Enable data profiling on Hive Views from profile of underlying Tables
Enable data profiling on views in Zaloni via linking with table instead of physically creating data profiling From customer: Views should not have their own profiling but profile information should come from the original table profiled from where ...
almost 3 years ago
On the Backlog
Need ability to have automated schema mapping of data being ingested
PS has implemented a mechanism of schema mapping of the data being ingested. This allows columns to be not fixed within a data-file and it gets assigned to the right position within the Hive table at run-time. It uses column-headers to determine t...
almost 3 years ago
in Data Ingestion
1. As a data miner that isresponsible for bringing data in the the ZDP from a variety of sources, but especially from files, 2. I want the ZDP system to assist me in assuring that the Destination Path specified in the File Pattern matches the Loca...
Today if the customer has to sync the metadata from Hcatalog/Hive, they have run hive inventory action (which is sub-optimal in performance) per schema. Request is to be able to automatically scan hcatalog and catalog the changes/new tables.
With reference to 9154: Teradata char /varchar changed to string by default in hive using db import
DB Import action is being used for importing tables from Teradata. Sqoop, which is the internal implementation of DB Import action, converts the datatype VARCHAR to the corresponding Hive type STRING and hence the corresponding ZDP entity field is...
Customer wants to remove the middle man (eg. ingestion warden) in way that BDCA agents can be spawned directly on landing zone server and joins the ingestion cluster. File patterns and other ingestion definition etc. can be further defined by the ...
Should be able to run Data Profiling as next step directly after ADI
customer is trying to run DP after ADI which they are unable to do in a single workflow. We currently do not have any provision to read the content of the "[STEP-NAME]_DI_FILE_WITH_REGISTERED_ENTITIES" file generated via ADI directly in the Data p...