Add a new HudiHFileBootstrapIndex with HBase 2.4.9 by yihua · Pull Request #11 · codope/trino

Commits on Dec 27, 2021

Add Hudi plugin
codope
committed
Add concrete implementation of connector metadata and split
codope
committed
Add Hudi plugin to trino-server-dev
codope
committed
Add table and column metadata
codope
committed
Fix show tables
codope
committed
Handle partition and add support for metadata listing
codope
committed
Add tests for the connector
codope
committed
Fix partition column and apply filter
codope
committed
Add splits to split source

yihua
authored and
codope
committed
Fix configuration for list status

yihua
authored and
codope
committed
Fix logic using HoodieParquetInputFormat to get splits and support bootstrap

yihua
authored and
codope
committed
Add flag to control how to fetch splits

yihua
authored and
codope
committed
Refactor file listing and Hudi split

yihua
authored and
codope
committed
Remove unused variables

yihua
authored and
codope
committed
Fix partition keys

yihua
authored and
codope
committed
Use empty partition keys for now

yihua
authored and
codope
committed
Consider bootstrap base file when getting the file status

yihua
authored and
codope
committed
Fix partition keys

yihua
authored and
codope
committed
Add argument for dynamic filter

yihua
authored and
codope
committed
Add batch processing in split source

yihua
authored and
codope
committed
Add logs for partition info from metastore

yihua
authored and
codope
committed
Add a hack to construct partition keys without using hive metastore

yihua
authored and
codope
committed
Refactoring and more tests
codope
committed
Remove debug logs
codope
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add a new HudiHFileBootstrapIndex with HBase 2.4.9#11

Add a new HudiHFileBootstrapIndex with HBase 2.4.9#11
yihua wants to merge 28 commits into
codope:hudi-plugin-cleanupfrom
yihua:hudi-plugin-hbase-reader

Commits on Dec 27, 2021

Add Hudi plugin

Add concrete implementation of connector metadata and split

Add Hudi plugin to trino-server-dev

Add table and column metadata

Fix show tables

Handle partition and add support for metadata listing

Add tests for the connector

Fix partition column and apply filter

Add splits to split source

Fix configuration for list status

Fix logic using HoodieParquetInputFormat to get splits and support bootstrap

Add flag to control how to fetch splits

Refactor file listing and Hudi split

Remove unused variables

Fix partition keys

Use empty partition keys for now

Consider bootstrap base file when getting the file status

Fix partition keys

Add argument for dynamic filter

Add batch processing in split source

Add logs for partition info from metastore

Add a hack to construct partition keys without using hive metastore

Refactoring and more tests

Remove debug logs

Commits on Dec 28, 2021

Fix dependency issue after rebase on master

Commits on Dec 29, 2021

Fix describe table query

Add partition filtering in split source (#9)

Commits on Jan 3, 2022

Use HBase 2.4.9