Release 424 (17 Aug 2023)#

General#

  • Reduce coordinator overhead on large clusters. (#18542)

  • Require the JVM default charset to be UTF-8. This can be set with the JVM command line option -Dfile.encoding=UTF-8. (#18657)

JDBC driver#

  • Add the number of bytes that have been written to the query results response. (#18651)

Delta Lake connector#

  • Remove the legacy Parquet reader, along with the parquet.optimized-reader.enabled and parquet.optimized-nested-reader.enabled configuration properties. (#18639)

Hive connector#

  • Improve performance for line-oriented Hive formats. (#18703)

  • Improve performance of reading JSON files. (#18709)

  • Remove the legacy Parquet reader, along with the parquet.optimized-reader.enabled and parquet.optimized-nested-reader.enabled configuration properties. (#18639)

  • Fix incorrect reporting of written bytes for uncompressed text files, which prevented the target_max_file_size session property from working. (#18701)

Hudi connector#

  • Remove the legacy Parquet reader, along with the parquet.optimized-reader.enabled and parquet.optimized-nested-reader.enabled configuration properties. (#18639)

Iceberg connector#

  • Add support for CASCADE option in DROP SCHEMA statements. (#18689)

  • Remove the legacy Parquet reader, along with the parquet.optimized-reader.enabled and parquet.optimized-nested-reader.enabled configuration properties. (#18639)

  • Fix potential incorrect query results when a query involves a predicate on a timestamp with time zone column. (#18588)

Memory connector#

  • Add support for CASCADE option in DROP SCHEMA statements. (#18668)

PostgreSQL connector#

  • Add support for CASCADE option in DROP SCHEMA statements. (#18663)

  • Remove support for Postgres versions older than version 11. (#18696)

SPI#

  • Introduce the getNewTableWriterScalingOptions and getInsertWriterScalingOptions methods to ConnectorMetadata, which enable connectors to limit writer scaling. (#18561)