Yarn and Yarn Queue Manager

You can review the list of reported issues and their fixes for Yarn and Yarn QM in 7.3.1.200.

COMPX-18663: Cgroup v2 support must fall back to v1 when there are no v2 controllers

Cgroup v1/v2 mixed mode support was introduced previously. If the cgroup v2 support was enabled (using yarn.nodemanager.linux-container-executor.cgroups.v2.enabled set to true), with only cgroup v1 controllers mounted on the Node Managers, the cgroup v2 support did not fall back to v1. This issue is now resolved and cgroup v2 support now falls back to v1 when there are no v2 controllers.

Apache Jira: YARN-11743

COMPX-18909: NodeManager marked as unhealthy if an application is terminated

Node Managers are marked unhealthy if the container-executor has an unrecoverable/configuration error, that is, the container-executor script is missing. However, if the application was terminated just before one of the containers was trying to access the localizer syslog file, causing an IOException then the Node Managers was marked unhealthy incorrectly. This issue is now resolved and the error checking is more specific, thereby, removing the false positive Node Managers markings.

Apache Jira: YARN-11753

COMPX-18545: Setting maximum-application-lifetime using AQCv2 templates does not apply on the first submitted application

Setting the maximum-application-lifetime property using the AQC v2 templates did not apply to the first submitted application bu twas applied to the subsequent ones. This issue is now resolved.

Apache Jira: YARN-11708

COMPX-18589: YARN ResourceManager raised an exception during comparison of queues

YARN ResourceManager raised an exception, java.lang.IllegalArgumentException: Comparison method violates its general contract!. The RCA was with the AND condition that caused the exception of TimSort algorithm during comparison of queues. This issue is now resolved.

Apache Jira: YARN-11745

CDPD-49702: NodeManager must be shut down when the program /var/lib/yarn-ce/bin/container-executor cannot be run

Previoulsy, a job failed when NodeManager encountered the No such file or directory error when running the /var/lib/yarn-ce/bin/container-executor program. This issue is now resolved and NodeManager is marked as unhealthy and shut down when it cannot run the program.

Apache Jira: YARN-11709