hetu-core/hetu-docs/en/releasenotes/releasenotes-1.5.0.md

2.7 KiB
Raw Permalink Blame History

Release 1.5.0

Key Features

Area Feature
Star Tree 1. Support for optimizing join queries such as star schema queries.
2. Optimized the query plan by eliminating unnecessary aggregations on top of the cube since the cube already contains the rolled up results. The performance optimizations benefits queries whose group by clause exactly matches the cubes group.
3. Bug fixes to further enhance the usability, and robustness of cubes.
Memory Connector 1. Improved performance of memory connector by adding support for memory table partitioning to allow data skipping of entire partitions
2. Collect statistics on memory table to support openLooKeng cost based optimizers.
Task Recovery Fixed several important bugs to address data inconsistency issues, and query hanging issues that occasionally occur during high concurrency, and during worker failures.
OLK-on-Yarn Support deploying an HA-enabled openLooKeng cluster instance on-yarn, that contains a reverse proxy (ngnix by default), and 2 or more coordinator nodes. The cluster can be horizontally scaled manually by adding and removing yarn containers to the coordinator and worker components.
Spill to Disk Optimized the spill to disk mechansim to directly write Pages to disk instead of buffering it. Changed the strategy to spill those operators which can free up maximum memory. This resulted in improvement of spill to disk performance by 30%

Known Issues

Category Description Gitee issue
Task Recovery When the query process reaches stage1,a worker is killed result some values become smaller(occasionally). I4M2LW
Memory Connector When a table with the index_columns parameter is queried, an error message is displayedjava.lang.NullPointerException. I4NVW3
When drop and then create a same partitioned table with data type double, query result rows is greater than expected. I4LUDF

Obtaining the Document

For details, see https://gitee.com/openlookeng/hetu-core/tree/1.5.0/hetu-docs/en