Zaloni Ideas
ADD A NEW IDEA

FILTER BY CATEGORY

Data Ingestion

Showing 31 of 445

Ability to parse multi level complex json file in ZDP

Current json serde unable to parse multi level json. can we add openx serde which is available as open source. details: open source link : https://github.com/rcongiu/Hive-JSON-Serdejar files link: http://www.congiu.net/hive-json-serde/1.3.8/cdh5/
Adi Bandaru about 2 years ago in Data Ingestion / Catalog 0 On the Backlog

Need ability to have automated schema mapping of data being ingested

PS has implemented a mechanism of schema mapping of the data being ingested. This allows columns to be not fixed within a data-file and it gets assigned to the right position within the Hive table at run-time. It uses column-headers to determine t...
Gaurav Chakravarti about 2 years ago in Data Ingestion 0 Future consideration

Display ingestion history for db wizard, db import created entities in entity view ingestion history tab when Display is 'Ingested File Size Per Day'

Display ingestion history for db wizard, db import created entities in entity view ingestion history tab when Display is 'Ingested File Size Per Day'Current behavior:The 'Ingested File Size Per Day' is shown only for entities associated with file ...
Sanjay Yadav over 1 year ago in Data Ingestion / Catalog / Metadata 0 On the Backlog

Ingest History - File Row Count

Customer would like to have details on rows counts ingested from files. Today, ZDP 5.0.2 displays the File Size per Day and File Count per Day. User would like to validate that these match in both a visual and cumulative report. Suggestion: Prov...
Deleted User over 2 years ago in Data Ingestion 0 On the Backlog

Ability to ingest data from MS Excel (xls, xlsx)

Ingest directly from Excel (to save a step in converting to CSV)This is particularly useful for business users within the UI, who may upload xls/x files from their computers for ingestion
Guest over 2 years ago in Data Ingestion 0 On the Backlog

DB Import Action to support Oracle Views

Customer is trying to use DB Import action to ingest data from views in Oracle Database.Expected Behavior:DB Import Action should support ingesting data from Oracle views along with registering Entity in the catalog.
Sunilam Chakraborty about 1 year ago in Data Ingestion / Workflow 0 On the Roadmap

Improve DB Import design

Hi,In DB import action we have an option to import all tables in DB. When this option is selected ZDP creates SQOOP command for every single table and executes a MR job for each table. Meaning, if there are 1000 tables in db then ZDP will fire 100...
Ajinkya Rasam over 1 year ago in Data Ingestion 0 Will not implement

Ability to select Spark Engine for Database ingestion

Ability to select Spark Engine for Database data ingestion and import (in place of Sqoop)
Guest almost 2 years ago in Data Ingestion 3 On the Roadmap

Ability to ingest data from SFDC

SFDC Connector (using Mulesoft API integration) including dynamic schema creation
Guest almost 2 years ago in Data Ingestion 0 Future consideration

CDC for DBImport

No description provided
Nikhil Goel over 2 years ago in Data Ingestion 1 Future consideration