Skip to Main Content
Zaloni Ideas
Status On the Backlog
Categories Catalog Discovery
Created by Nikhil Goel
Created on Jun 19, 2019

Metadata Sync from Hive metastore

Today if the customer has to sync the metadata from Hcatalog/Hive, they have run hive inventory action (which is sub-optimal in performance) per schema. Request is to be able to automatically scan hcatalog and catalog the changes/new tables.

Customer Impact Major inconvenience
  • Attach files
  • Admin
    Matthew Monahan
    Feb 18, 2020

    Watch the whole Hive metastore for changes and update Zaloni automatically. Use case: when changes happen in Hive, Zaloni needs to be updated without user intervention. The load would be too great to have to check every Hive table.

    If this requires scheduling, then daily should be sufficient.

    Optional setting for auto-creation of newly discovered Hive tables as Zaloni catalog entities.

  • Admin
    Matthew Monahan
    Dec 18, 2019

    This may already be available in one of the 5.0.2 patches.