Zaloni Ideas
Status Future consideration
Categories Metadata API
Created by Guest
Created on Apr 15, 2019

Ability to sync metadata to hive meta store for reporting and dashboards

"Sync Zaloni metadata (from mysql /Elastic Serach) to hive meta store for reporting and Dashboarding. Alternatively get zaloni access for DR."

Sync Zaloni metadata (from mysql / ES) to hive meta store for reporting and dashboarding for DQ and profiling results

    1. Need access to additional field-level data (currently in ES but not exposed)

    2. Required for audit purposes

    3. Possible solution

      1. Customer to provide details on requirements for what data is needed

      2. Zaloni could expand data available

Customer Impact Minor inconvenience
  • Attach files
  • Admin
    Matthew Monahan
    Feb 18, 2020

    Additional Information on the use case:

    Replicate the Zaloni metadata into a database (e.g. Hive) where a BI tool can access and use for reporting and dashboards. Note, this is not just a DB replication, since the output needs to be processed in a way similar to the APIs, not the underlying DB structure.

  • Admin
    Matthew Monahan
    Nov 26, 2019

    Update to the requirement: the goal is to provide ZDP metadata for reporting within Tableau server

  • Admin
    Matthew Monahan
    Apr 23, 2019

    We will evaluate options for bulk export of catalog metadata via API. In the meantime, it will be helpful to understand gaps in ZDP dashboard, to see if that's sufficient to meet customer requirements.