Additional resource requirements for Cloudera Data Warehouse
Standard resource mode requirements for Cloudera Data Warehouse.
The following table lists the minimum and recommended compute (processor), memory, storage, and
network bandwidth required for each Cloudera Embedded Container Service worker node using the
Standard Resource Mode for production use case. Note that the actual node still needs some extra
resources to run the operating system, Kubernetes engine, and Cloudera Manager
agent on Cloudera Embedded Container Service.
| Component | Minimum | Recommended |
|---|---|---|
| Node Count | 4 | 10 |
| CPU per worker | 16 cores [or 8 cores or 16 threads that have Simultaneous Multithreading (SMT) enabled] | 32+ cores (can also be achieved by enabling SMT) |
| Memory per worker | 128 GB per node | 384 GB* per node |
|
FAST (Fully Automated Storage Tiering) Cache - Locally attached SCSI device(s) on every worker. Preferred: NVMe and SSD. ECS uses Local Path Provisioner. |
1.2 TB* SATA, SSD per host | 1.2 TB* NVMe/SSD per host |
| Network Bandwidth | 1 GB/s guaranteed bandwidth to every Cloudera Base on premises | 10 GB/s guaranteed bandwidth to every Cloudera Base on premises node |
* Depending on the number of executors you want to run on each
physical node, the per-node requirements change proportionally. For example, if you are
running 3 executor pods per physical node, you require 384 GB of memory and approximately
1.8TB (600GB per executor) of locally attached SSD/NVMe storage for FAST Cache.
