Fix incr errors new reader#2

Open

jonvex wants to merge 10 commits into

linliu-code:HUDI-6790-incremental_query_using_file_group_readerfrom

jonvex:fix_incr_errors_new_reader

Commits on Oct 30, 2023

fix testPartitionFiltersPushDown
Jonathan Vexler
committed
fix testFileListingWithPartitionPrefixPruning. precombine field was not in table
Jonathan Vexler
committed
fix testQueryCOWWithBasePathAndFileIndex. Incremental queries cannot be batch enabled
Jonathan Vexler
committed
fix testAlteringRecordKeyConfig. precombine was not in table
Jonathan Vexler
committed
fix testPrunePartitionForTimestampBasedKeyGenerator
Jonathan Vexler
committed

Commits on Oct 31, 2023

fix TestIncrementalReadWithFullTableScan. might need to inject filters because df.count() is wrong while df.rdd.count() is correct
Jonathan Vexler
committed

Commits on Nov 3, 2023

try implement glob paths
Jonathan Vexler
committed

Commits on Nov 6, 2023

use legacy parquet ff as underlying to allow schema evolution
Jonathan Vexler
committed
disable test
Jonathan Vexler
committed
change count() to rdd.count()
Jonathan Vexler
committed