Ideas
ADD A NEW IDEA

FILTER BY CATEGORY

Workflow

Showing 33 of 379

An action to get table stats from an entity

PS team had been using shell actions with $beeline queries in many client projects to captures the total number of rows from an entity/table and storing it in a NAMESPACE variable to later use it in conditional flow of workflow. This action will r...
Faisal Zafar over 1 year ago in Catalog / Workflow 2 On the Backlog

Action to export to Hbase

In current ZDP version, we do not have the support in the workflow nor in the provisioning to export the data to HBASE. Customer requires a workflow action to export to HBase by ZDP. During Phase 0, the application team has build the custom code t...
Mary Das over 1 year ago in Provision / Workflow 1 Will not implement

Stop background process when we stop workflow

At this time if we have to stop a workflow we still have to manually kill a running step from Linux and then possibly change some values in Bedrock MySQL database. We don't see it as a good approach of stopping a process started by Bedrock. We sti...
Mrinmoy Jyoti Kaushik over 1 year ago in Workflow 1 On the Roadmap

Support for adding step namespace variables using PySpark

We have seen that recently we have been getting tickets from clients asking for instructions on setting step namespace variables using PySpark. Since PySpark is now a popular tool for Big Data, we can consider enhancing the product to include the ...
Kavel Baruah 7 months ago in Workflow 0

show associated Schedules in slide menu [kebab menu] of workflows in workflow listing page

In ZDP, when we open schedule in kebab menu from workflows in workflow listing page, It shows existing schedules as well. But in Arena, we dont have that feature. It would be great if this featue is added in arena as well for better UX. I have att...
Kaushik Talukdar 4 months ago in Workflow / User Interface 0

multi-table select in DB Import Action

The Table Import option. So currently you can filter using java regex and it gives you a list of matching tables but if you only want to include some you have to copy and paste the values. Something like a multi/all select feature would be support...
Cody Rich 5 months ago in Catalog / Workflow 0 On the Backlog

Improve the connection selection UI component

When selection a connection in DB import, it currently is a free text selection with matching options showing up after typing the first letter (autocomplete). Would be much easier as a drop down.
Cody Rich 5 months ago in Workflow / Catalog 0 On the Backlog

make the status of workflows in RUNNING “Failed” in case of Communication Link Failure

In case there is a communication link failure due to disconnection from mysql database, the workflows remain in the RUNNING state even thought the workflow actually fails at backend.There should be a mechanism to mark these as FAILED in sucs a sce...
Mrinmoy Jyoti Kaushik about 1 year ago in Workflow 0 On the Backlog

Schedule job not runnning when Impersonation is ON

Workflow Schedule job not running -Reason : The user who created the Schedule is validated during Workflow trigger , only when Impersonation is ON from ZDP . This validation is done by ZDP internally to check if the user has permission to imperson...
Vishakha Agarwal about 1 year ago in Workflow 0 Future consideration

Identify hadoop resource consumption by each zdp/arena workflow step

Hi, As we know that most of the hive queries/mapreduce jobs that are triggers either from any BI tool / ZDP or Arena spawn an yarn job in hadoop ecosystem whose information can be retrieved using yarn API.And once we get the yarn job details we ca...
Shyam Sundar Baishya about 1 year ago in Dashboards / Workflow / Lineage 0 Future consideration