Release 470 (5 Feb 2025)#

General#

  • Add DuckDB connector. (#18031)

  • Add Loki connector. (#23053)

  • Add support for the WITH SESSION clause to set per-query session properties with SELECT queries. (#24889)

  • Improve compatibility of fault-tolerant exchange storage with S3-compliant object stores. (#24822)

  • Allow skipping directory schema validation to improve compatibility of fault-tolerant exchange storage with HDFS-like file systems. This can be configured with the exchange.hdfs.skip-directory-scheme-validation property. (#24627)

  • Export JMX metric for blockedQueries. (#24907)

  • ⚠️ Breaking change: Remove support for the optimize_hash_generation session property and the optimizer.optimize-hash-generation configuration option. (#24792)

  • Fix failure when using upper-case variable names in SQL user-defined functions. (#24460)

  • Prevent failures of the array_histogram() function when the input contains null values. (#24765)

JDBC driver#

CLI#

Delta Lake connector#

  • Prevent connection leakage when using the Azure Storage file system. (#24116)

  • Deprecate use of the legacy file system support for Azure Storage, Google Cloud Storage, IBM Cloud Object Storage, S3 and S3-compatible object storage systems. Use the migration guides for Azure Storage, Google Cloud Storage, and S3 to assist if you have not switched from legacy support. (#24878)

  • Fix potential table corruption when using the vacuum procedure. (#24872)

Faker connector#

Hive connector#

  • Deprecate use of the legacy file system support for Azure Storage, Google Cloud Storage, IBM Cloud Object Storage, S3 and S3-compatible object storage systems. Use the migration guides for Azure Storage, Google Cloud Storage, and S3 to assist if you have not switched from legacy support. (#24878)

  • Prevent connection leakage when using the Azure Storage file system. (#24116)

  • Fix NullPointerException when listing tables on Glue. (#24834)

Hudi connector#

  • Deprecate use of the legacy file system support for Azure Storage, Google Cloud Storage, IBM Cloud Object Storage, S3 and S3-compatible object storage systems. Use the migration guides for Azure Storage, Google Cloud Storage, and S3 to assist if you have not switched from legacy support. (#24878)

  • Prevent connection leakage when using the Azure Storage file system. (#24116)

Iceberg connector#

  • Add the optimize_manifests table procedure. (#14821)

  • Allow configuration of the number of commit retries with the max_commit_retry table property. (#22672)

  • Allow caching of table metadata when using the Hive metastore. (#13115)

  • Deprecate use of the legacy file system support for Azure Storage, Google Cloud Storage, IBM Cloud Object Storage, S3 and S3-compatible object storage systems. Use the migration guides for Azure Storage, Google Cloud Storage, and S3 to assist if you have not switched from legacy support. (#24878)

  • Prevent connection leakage when using the Azure Storage file system. (#24116)

  • Fix failure when adding a new column with a name containing a dot. (#24813)

  • Fix failure when reading from tables with equality deletes with nested fields. (#18625)

  • Fix failure when reading $entries and $all_entries tables using equality deletes. (#24775)

JMX connector#

  • Prevent missing metrics values when MBeans in coordinator and workers do not match. (#24908)

Kinesis connector#

MySQL connector#

  • Add support for MERGE statement. (#24428)

  • Prevent writing of invalid, negative date values. (#24809)

PostgreSQL connector#

  • Raise minimum required version to PostgreSQL 12. (#24836)