jprdonnelly/impala
1
0
Fork 0
mirror of https://github.com/apache/impala.git synced 2025-12-19 18:12:08 -05:00
Code Issues Projects Releases Wiki Activity

IMPALA-14580: Document Iceberg table repair functionality

Browse Source 
Testing: built docs locally

Change-Id: I67a861a56269648c5f8c2e9697861bf95587f731
Reviewed-on: http://gerrit.cloudera.org:8080/23738
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Reviewed-by: Daniel Vanko <dvanko@cloudera.com>
Reviewed-by: Zoltan Borok-Nagy <boroknagyz@cloudera.com>
This commit is contained in:
Noemi Pap-Takacs
2025-11-27 16:36:38 +01:00
committed by Zoltan Borok-Nagy
parent 780e6683a2
commit 1bddbefb2d
1 changed files with 37 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

37
docs/topics/impala_iceberg.xml
View File

@@ -842,6 +842,43 @@ ALTER TABLE ice_tbl EXECUTE remove_orphan_files(now() - interval 5 days);
</conbody>
</concept>
<concept id="iceberg_repair_metadata">
<title>Repair table metadata</title>
<conbody>
<p>
Users should always use the engine/Iceberg API to interact with Iceberg tables;
e.g. to remove a partition, use Impala and issue the DROP PARTITION statement
instead of deleting the partition directory.
Deleting files directly from storage without going through the Iceberg API
corrupts the table, and makes queries that try to read the missing files fail
with the following error message:
<codeph>Iceberg table [...] cannot be fully loaded due to unavailable
files</codeph>.
</p>
<p>
This happens because the metadata files are still referencing the missing data
files. This erroneous state can be fixed by restoring the deleted files on the
file system.
If this is not intended or not possible, the dangling references can be removed
from the Iceberg metadata with the
<codeph>ALTER TABLE ... EXECUTE repair_metadata()</codeph>
statement, so that the table becomes functional again.
<codeblock>
-- Use the statement simply without parameters:
ALTER TABLE ice_tbl EXECUTE repair_metadata();
</codeblock>
</p>
<note>
This operation does not restore the deleted content. Execute only if
there is no intention to restore the missing data.
<p>
Impala can repair the table only if the missing files are data files,
but it cannot repair the table if there are missing delete files.
</p>
</note>
</conbody>
</concept>
<concept id="iceberg_metadata_tables">
<title>Iceberg metadata tables</title>
<conbody>