Cloudera Docs

Prerequisites for CDSW to Cloudera AI migration

Before migrating from Cloudera Data Science Workbench (CDSW) to Cloudera AI in Cloudera Private Cloud, you must meet a number of prerequisites to succeed. A prerequisite for migration is the installation of Cloudera AI on your Cloudera Data Science Workbench base cluster.

The following table presents the supported migration version combinations for Cloudera Data Science Workbench and Cloudera AI:

Table 1. Supported migration versions for Cloudera Data Science Workbench and Cloudera AI
Supported CDSW versions Target Cloudera AI Private Cloud version

CDSW 1.10.0- 1.10.4

1.5.3

1.5.4 SP1 (recommended version)

Upgrade to CDSW 1.10.5 before migrating to Cloudera AI.

CDSW 1.10.5

1.5.3

1.5.4

1.5.4 SP1 (recommended version)

Migration from CDSW, configured with LDAP, SAML, or LOCAL authentication to Cloudera AI, is supported, but the automatic migration is supported only if CDSW is running with LDAP. The migration process does not automatically migrate your authentication configurations. Therefore, setting up LDAP in CDSW prior to migration is part of the migration procedure.

The migration does not migrate your CDSW endpoint connections. Therefore, post-migration instructions include setting up LDAP, endpoint connections, and DNS on Cloudera AI, as well as downloading CDSW-related Grafana dashboards, so you can upload them after migration to Cloudera AI.

  1. You must have a CDSW 1.10.0 or higher version cluster in Cloudera; otherwise, choose one of the following options:
    • If you have a CDSW installation in either CDH or HDP, migrate to Private Cloud 1.5.1 or higher version, and then migrate CDSW to Cloudera AI.
    • If you have CDSW installation earlier than 1.10.0, upgrade to CDSW 1.10.0 or higher versions.
  2. If you do not have LDAP set up in your CDSW cluster on Cloudera, set up LDAP before pre-migration tasks. For guidelines on setting up LDAP, see Configuring External Authentication with LDAP and SAML.
    The migration process cannot succeed without authentication.
  3. Meet the Cloudera AI software requirements for Private Cloud, including storage, for installing Cloudera AI on Cloudera Private Cloud 1.5.1 or higher version. For Cloudera AI software requirements for Private Cloud, see Cloudera AI software requirements for Cloudera.
  4. Backup CDSW data. For details on how to backup CDSW data, see Backup and Disaster Recovery for Cloudera Data Science Workbench.
  5. In CDSW, export your Grafana dashboards. For details on how to export Grafana dashborads, see Export and import | Grafana documentation.
  6. Note the connections of endpoints in your CDSW cluster, consider your custom settings.
    You need to use this information after migration to set up endpoints in your Private Cloud cluster.
  7. If you customized your DNS configuration, make notes your custom settings to be able to customize your DNS configuration after migration.
    If you did not customize your DNS configuration, the migration tool configures DNS in your Private Cloud cluster.
  8. Gather information about your LDAP configurations on CDSW.
    After migration, you must set up LDAP again on the Cloudera AI cluster. The LDAP configuration is not migrated.
  9. In CDSW, manually back up the custom DNS configuration for Kube-DNS, and then migrate your custom configuration to Cloudera AI.
    Cloudera AI uses the core-DNS, which is incompatible with the CDSW Kube-DNS.
  10. In Cloudera Manager, select install and upgrade to Cloudera Private Cloud 1.5.1 or higher version using the Cloudera Embedded Container Service on your CDSW cluster.
    Migration of your CDSW workloads to Cloudera AI on OpenShift is not supported.
  11. During the installation of Cloudera Private Cloud Data Services using Cloudera Embedded Container Service set up a network connection between CDSW and the Cloudera Private Cloud cluster if you select Airgap.
  12. Enable those Cloudera AI features during installation that you were using in CDSW.
    For example, enable model metrics and monitoring.
    If you do not enable the same, or similar, Cloudera AI features during installation that you were using in CDSW, you will not be able to use the Cloudera AI features.