mirror of
https://github.com/apache/impala.git
synced 2026-01-07 00:02:28 -05:00
With RHEL 8 on AWS Graviton instances, dfs.datanode.max.locked.memory=64000 is insufficient to run query_test/test_hdfs_caching.py::TestHdfsCaching::test_table_is_cached. Sets dfs.datanode.max.locked.memory based on 'ulimit -l', and sets memlock to 64MB in bootstrap_system.sh to match modern defaults and provide space for future HDFS caching tests. New setting can be seen in admin output like node-1 will use ports DATANODE_PORT=31002, DATANODE_HTTP_PORT=31012, DATANODE_IPC_PORT=31022, DATANODE_HTTPS_PORT=31032, DATANODE_CLIENT_PORT=31042, NODEMANAGER_PORT=31102, NODEMANAGER_LOCALIZER_PORT=31122, NODEMANAGER_WEBUI_PORT=31142, KUDU_TS_RPC_PORT=31202, and KUDU_TS_WEBUI_PORT=31302; DATANODE_LOCKED_MEM=65536000 Change-Id: I7722ddd0c7fbd9bbd1979503952b7522b808194a Reviewed-on: http://gerrit.cloudera.org:8080/20623 Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com> Reviewed-by: Joe McDonnell <joemcdonnell@cloudera.com>