IE-655: migrate skyflow-java beta to skyflow-flowvault-java GA 1.1.0

[skyflow-srivyshnavi]

IE-655: migrate skyflow-java beta to skyflow-flowvault-java GA 1.1.0

[piyushjain-skyflow]

Looks good to me!

[Devesh-Skyflow]

Can we use BulkInsertResponse.getRecordsToRetry() here

[skyflow-srivyshnavi]

spark-hive-utils/spark/src/main/java/com/skyflow/spark/Constants.java

Line 19 in 1234905

public static final HashSet<Integer> RETRYABLE_ERROR_CODES = new HashSet<>(Arrays.asList(

Does it return records that cover these error codes @Devesh-Skyflow ?
I believe 429 is not covered.

[Devesh-Skyflow]

Yes 429 is not covered

[koshy-skyflow]

Minor comments and findings, can be addressed later as well:

1. The README prerequisites section still mentions Skyflow Java SDK 3.0.0-beta.6: https://github.com/SkyflowFoundry/spark-hive-utils/blob/main/spark/README.md#prerequisites

2. UpsertOptions now supports updateType (UPDATE/REPLACE) in 1.1.0, but the wrapper never sets it, just flagging that there's currently no way for a caller use REPLACE as updateType on upsert.

3. We should probably think of adding 409 error to RETRYABLE_ERROR_CODES as concurrent upsert conflicts for a non existing unique value surface as 409 http status weith error message "The request conflicted with another concurrent operation on the same resource. Retry the request. Contact Skyflow support with request ID %s if the issue persists."

4. Are we planning to cover the Hive migration separately? Asking since the Hive utilities are in the same repo.

[skyflow-srivyshnavi]

Minor comments and findings, can be addressed later as well:

1. The README prerequisites section still mentions Skyflow Java SDK 3.0.0-beta.6: https://github.com/SkyflowFoundry/spark-hive-utils/blob/main/spark/README.md#prerequisites
2. UpsertOptions now supports updateType (UPDATE/REPLACE) in 1.1.0, but the wrapper never sets it, just flagging that there's currently no way for a caller use REPLACE as updateType on upsert.
3. We should probably think of adding 409 error to RETRYABLE_ERROR_CODES as concurrent upsert conflicts for a non existing unique value surface as 409 http status weith error message "The request conflicted with another concurrent operation on the same resource. Retry the request. Contact Skyflow support with request ID %s if the issue persists."
4. Are we planning to cover the Hive migration separately? Asking since the Hive utilities are in the same repo.

Thanks Koshy

1. Updated.
2. Yes, not needed for Walmart. These are single column tables.
3. Yes, added.
4. They are not using Hive yet.