HIVE-29361: BasicStatsTask.aggregateStats shouldn't update partition stats in HMS for non-native tables

[deniskuzZ]

What changes were proposed in this pull request?

Skip updating basic partition statistics in HMS for non-native, self-contained tables.

Why are the changes needed?

Bug-fix

Does this PR introduce any user-facing change?

No

How was this patch tested?

Added test-case for partitioned table

[glapark]

I tested the patch and found that the warning is no longer printed.

[Aggarwal-Raghav]

LGTM +1 (non-binding)

Small doubt, somewhat outside the scope of PR. When hive.iceberg.stats.source=iceberg, the basic table stats (numRows, totalSize, numFiles which are present in desc formatted output) are read from puffin files or from HMS?

If hive.iceberg.stats.source=metastore, then where per-partition stats be present? As per javadoc in org.apache.hadoop.hive.ql.metadata.HiveStorageHandler#supportsPartitioning()

Any partitioning scheme provided via the standard HiveQL syntax will be honored but stored in someplace
other than HMS, depending on the storage handler implementation.

[deniskuzZ]

Small doubt, somewhat outside the scope of PR. When hive.iceberg.stats.source=iceberg, the basic table stats (numRows, totalSize, numFiles which are present in desc formatted output) are read from puffin files or from HMS?

column stats from Puffin, basic stats from iceberg metadata

If hive.iceberg.stats.source=metastore, then where per-partition stats be present? As per javadoc in org.apache.hadoop.hive.ql.metadata.HiveStorageHandler#supportsPartitioning()

It's not even supported, since HMS is unaware of partitioning

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud