Arena Customer Ideas

Workflow Queue Min/Max Limit needed

Problem Statement: [Workflow Queue Min/Max Limit]

We had a scenario where we want multiple instances of workflow X to be executed to load 10 years of historical data faster. We identified that the cluster chokes when 5 or more instances of workflow X executes in parallel due to Metastore (MySql Table Lock) issue. The cluster works fine when the number of running instances of workflow X is < 5. The requirement is to throttle the max number of concurrent instances of workflow X.

  • Sunilam Chakraborty
  • May 7 2019
  • Future consideration
  • Attach files
  • +1