Cloudera Docs

Pre-upgrade - Preparing for Cloudera Private Cloud Data Services update for Cloudera Data Engineering

To upgrade the Cloudera Data Engineering service, no jobs must be running or scheduled in any virtual cluster under that Cloudera Data Engineering service.

  1. Pause all Airflow jobs and scheduled Spark jobs.
  2. Kill all the the running jobs in the Cloudera Data Engineering virtual clusters under all Cloudera Data Engineering services or wait for them to complete.