Limitations of Cloudera Data Engineering service

Limitations of restoring Cloudera Data Engineering provide details on non-persistent data, manual environment requirements, and version-specific credential handling.

  • Airflow job logs from the original cluster are unavailable after a Restore operation.
  • (Applicable only in Cloudera Data Services on premises 1.5.5 and 1.5.5 SP1) The Spark UI tab for a completed job does not work on the first click. As a workaround, perform the following actions:
    1. Click the Spark UI tab. Nothing is displayed.
    2. Click on some other tab. For example, the Logs tab.
    3. Click the Spark UI tab again. The Spark UI loads now.
  • Cloudera Data Engineering service does not support the backup and restore of Airflow Python environment resources after an upgrade. You must create and manually activate a new Airflow Python environment resource after restoring the Cloudera Data Engineering service.
  • In Cloudera Data Services on premises 1.5.5 SP2 and lower versions, the Cloudera Data Engineering backup process excludes credentials. As a result, restoring jobs that rely on these credentials fails.

    However, in Cloudera Data Services on premises 1.5.5 SP2 CHF1 and higher versions, the Cloudera Data Engineering backup process includes credentials.