Skip to content

Ensure Variant type support on Spark 4.1 #18605

@yihua

Description

@yihua

Bug Description

What happened:

TestVariantDataType failed on Spark 4.1 due to new Variant read and write implementation on Spark.

What you expected:
Hudi Variant type support should still work

Steps to reproduce:
Run TestVariantDataType with Spark 4.1

Environment

Hudi version: master
Query engine: Spark
Relevant configs:

Logs and Stack Trace

No response

Metadata

Metadata

Assignees

Labels

type:bugBug reports and fixes

Type

No type
No fields configured for issues without a type.

Projects

Status

Done

Relationships

None yet

Development

No branches or pull requests

Issue actions