Skip to Main Content
Zaloni Ideas
ADD A NEW IDEA

FILTER BY CATEGORY

Data Ingestion

Showing 32 of 451

Ability to specify connection in File Wizard

Scenario #1: For AWS GovCloud, it is mandatory to supply the S3 region (or endpoint) to successfully access any S3 buckets. In an S3 connection, we can easily provide this information, and hence file ingestion using a BDCA agent is possible. Howev...
Mithulesh Kumar Medhi 10 months ago in Catalog / Data Ingestion / User Interface 0

Ability to parse multi level complex json file in ZDP

Current json serde unable to parse multi level json. can we add openx serde which is available as open source. details: open source link : https://github.com/rcongiu/Hive-JSON-Serde jar files link: http://www.congiu.net/hive-json-serde/1.3.8/cdh5/
Adi Bandaru almost 3 years ago in Catalog / Data Ingestion 0 On the Backlog

Need ability to have automated schema mapping of data being ingested

PS has implemented a mechanism of schema mapping of the data being ingested. This allows columns to be not fixed within a data-file and it gets assigned to the right position within the Hive table at run-time. It uses column-headers to determine t...
Gaurav Chakravarti almost 3 years ago in Data Ingestion 0 Future consideration

Display ingestion history for db wizard, db import created entities in entity view ingestion history tab when Display is 'Ingested File Size Per Day'

Display ingestion history for db wizard, db import created entities in entity view ingestion history tab when Display is 'Ingested File Size Per Day' Current behavior: The 'Ingested File Size Per Day' is shown only for entities associated with fil...
Sanjay Yadav over 2 years ago in Catalog / Data Ingestion / Metadata 0 On the Backlog

Ingest History - File Row Count

Customer would like to have details on rows counts ingested from files. Today, ZDP 5.0.2 displays the File Size per Day and File Count per Day. User would like to validate that these match in both a visual and cumulative report. Suggestion: Provid...
Deleted User over 3 years ago in Data Ingestion 0 On the Backlog

Ability to ingest VSAM data

VSAM format - Ability to process any VSAM format based on configuration
Guest 11 months ago in Data Ingestion 0 Will not implement

DB Import Action to support Oracle Views

Customer is trying to use DB Import action to ingest data from views in Oracle Database. Expected Behavior: DB Import Action should support ingesting data from Oracle views along with registering Entity in the catalog.
Sunilam Chakraborty about 2 years ago in Data Ingestion / Workflow 0 On the Roadmap

Ability to ingest data from MS Excel (xls, xlsx)

Ingest directly from Excel (to save a step in converting to CSV) This is particularly useful for business users within the UI, who may upload xls/x files from their computers for ingestion
Guest over 3 years ago in Data Ingestion 0 On the Backlog

Improve DB Import design

Hi, In DB import action we have an option to import all tables in DB. When this option is selected ZDP creates SQOOP command for every single table and executes a MR job for each table. Meaning, if there are 1000 tables in db then ZDP will fire 10...
Ajinkya Rasam over 2 years ago in Data Ingestion 0 Will not implement

Ability to select Spark Engine for Database ingestion

Ability to select Spark Engine for Database data ingestion and import (in place of Sqoop)
Guest almost 3 years ago in Data Ingestion 3 On the Roadmap