Ability to parse multi level complex json file in ZDP
Current json serde unable to parse multi level json. can we add openx serde which is available as open source. details: open source link : https://github.com/rcongiu/Hive-JSON-Serde jar files link: http://www.congiu.net/hive-json-serde/1.3.8/cdh5/
Need ability to have automated schema mapping of data being ingested
PS has implemented a mechanism of schema mapping of the data being ingested. This allows columns to be not fixed within a data-file and it gets assigned to the right position within the Hive table at run-time. It uses column-headers to determine t...
almost 3 years ago
in Data Ingestion
Include product usage workflow as a sample workflow along with Arena Installations
We have prepared a workflow that collects Zaloni product usage and audit metrics from the customer environment and sends the report via mail to the user. Document for the workflow : https://zaloni.atlassian.net/l/c/Fuum2d6t We recommend adding the...
Currently, if pyspark code is present on hdfs, we need to first bring it to a shared directory on the local file system and then run pyspark action on it. However it would be very useful if Arena was able to run scripts directly from hdfs instead ...
about 1 year ago
Will not implement
A feature to copy artifacts like workflow and entity from one project to another in Arena
Recently, during a support meeting with a client, a requirement came up to copy all the artifacts present in one project to another, this involves a lot of manual labor of export and import of artifacts. We would like to request for a feature wher...
Provide ability to comment and crowdsource business information on ZDP entities/fields.
Business user/Data Stewards would like to collaborate and share their comments and findings on the data sets. They would like review these comments before underlying data can be provisioned to downstream systems. Provide ability to capture user fe...
There is no way to export DME models from one instance to another.User has to recreate the model manually.There should be provision to export and import DME components - the model and the associated training datasets with it.Thanks.
over 2 years ago
On the Backlog
* When project selection is clicked the cursor can go to search so that user can easily start searching and might be able to navigate with arrow keys and select the result by enter key as an easy option along side current mouse click PLAT-1213 >...