1. As a part of the big data team I am responsible for ingesting file data into the lake. Many of the files that we receive are fixed length files. It is difficult to process these files within the lake so I generally create a delimited version of...
Gary Asmus
over 2 years ago
in Transformations
1
On the Backlog
Currently, we have to map the DECIMAL(x,y) of HDFS DATA TYPE to STRING of HCATALOG DATA TYPE. Everytime value of x & y changes, we have to add a new data type mapping. This is not a feasible way of handling data type mapping between HDFS and H...
Add 'between' condition in transformation filter action
I want (Feature Details): I want to be able to select 'between' condition to filter column having values between to columns or constant values. So that (Use case details): I can add only one rule for a column which takes care of both greater than ...
Radhika Kolimi
over 2 years ago
in Transformations
0
On the Backlog
Ability to integrate with a third-party solution for encryption
Customer plans to use an enterprise-wide solution for masking/encrypting PII data Can we integrate with a third-party solution for this, as an alternative to ZDP masking/tokenizing
As a data steward or member of governance team or subject matter expert I want to interactively work with the data to perform enrichment or fix bad data to update trusted zone data
User experience improvement on transformation actions like 'filter'
Changes in transformation actions to take effect before clicking 'OK' button. Eg: 1. Create transformation 2. select 'Filter' action 3. Add rule under 'Properties' tab 4. switch to 'Outgoing' tab 5. See: outgoing fields are not added unless you cl...
Ajinkya Rasam
almost 3 years ago
in Transformations
0
On the Backlog