6 Commits

Author SHA1 Message Date
Xiang Yang
8af0ce8ed6 IMPALA-13001: Support graceful and force shutdown for impala.sh
This patch add graceful and force shutdown support for impala.sh.

This patch also keep the stdout and stderr log when startup.

This patch also fix some bugs in the impala.sh, including:
 - empty service name check.
 - restart command cannot work.

Testing:
 - Manually deploy package on Ubuntu22.04 and verify it.

Change-Id: Ib7743234952ba6b12694ecc68a920d59fea0d4ba
Reviewed-on: http://gerrit.cloudera.org:8080/21297
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
2024-07-15 12:03:18 +00:00
stiga-huang
61ceb16d88 IMPALA-12999: Add log4j.properties to the DEB/RPM packages
log4j.properties is required to configure log4j before logs from it are
redirected to glog (done in GlogAppender#Install()). This is crucial to
show error logs during initialization, especially while lauching the
JVM. See the JIRA description for an example.

This copies log4j.properties from fe/src/test/resources directly since
it hasn't changed for years.

Change-Id: Iee0b9699ef313aa8e94bd351fa51fad3ea0cdf57
Reviewed-on: http://gerrit.cloudera.org:8080/21293
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
2024-04-14 10:10:47 +00:00
Xiang Yang
07218588a6 IMPALA-12362: (part-3/4) Add more binaries to packaging module.
Add admissiond service and impala-profile-tool to packaging module.

Testing:
 - Manually deploy packages on Ubuntu22.04 and verify it.

Change-Id: I594742037a05d4d74d6a2bc011619713f7ca12e4
Reviewed-on: http://gerrit.cloudera.org:8080/20929
Reviewed-by: Quanlong Huang <huangquanlong@gmail.com>
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
2024-04-08 10:23:18 +00:00
Xiang Yang
e74bb9d81b IMPALA-12362: (part-2/4) Optimize default configurations for packaging module.
To avoid absolutely paths and keep it simple, optimize the default
configurations for packaging module by remove or change some entries.

At the same time, add license header to 'package/conf/*-site.xml' and
rename them to '*-site.xml.template' to force administrator making
configurations appropriate for their cluster.

Testing:
 - Manually deploy packages on Ubuntu22.04 and verify it.

Change-Id: Ifda229b779a3d6fca647bb81fe23dd61ad7e5d66
Reviewed-on: http://gerrit.cloudera.org:8080/20928
Reviewed-by: Quanlong Huang <huangquanlong@gmail.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
2024-04-08 04:29:26 +00:00
Xiang Yang
b64dc110c1 IMPALA-12362: (part-1/4) Refactor service management scripts.
Uniform all service management scripts to 'bin/impala.sh', administrator
can customize environment variables based on their cluster at
'conf/impala-env.sh', as well as set flags at 'conf/impalad_flags...'.

Usually administrator can override the environment variables in
'conf/impala-env.sh' with commandline arguments.  The same is true for
flags in 'conf/impalad_flags...'. This flexibility can be used in
scenarios such as supporting multi-instance deployments.

The directory structure has been adjusted as follows:
 - put java libs to 'lib/jars' directory.
 - put native libs to 'lib/native' directory.
 - put impalad binary to 'sbin' directory.

Testing:
 - Manually deploy packages on Ubuntu22.04 and verify it.

Change-Id: I8f4dcad9cfa12d351d562e7ef8c0a8957d3ca147
Reviewed-on: http://gerrit.cloudera.org:8080/20921
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
2024-04-06 11:22:26 +00:00
stiga-huang
8d0ab2b684 IMPALA-10262: RPM/DEB Packaging Support
This patch bases on a previous patch contributed by Shant Hovsepian:
https://gerrit.cloudera.org/c/16612/

It adds a new option, -package, to buildall.sh for building a package
for the current OS type (e.g. CentOS/Ubuntu). You can also use
"make/ninja package" to build the package. Scripts for launching the
services and the required configuration files are also added.

Tests:
 - Built on Ubuntu 18.04/20.04 and CentOS 7 using
   ./buildall.sh -noclean -skiptests -release -package
 - Deployed the RPM package on a CDP cluster. Verifed the scripts.
 - Deployed the DEB package on a docker container. Verified the scripts.

Change-Id: I64419fd400fe8d233dac016b6306157fe9461d82
Reviewed-on: http://gerrit.cloudera.org:8080/18939
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
2023-07-16 11:13:23 +00:00