Skip to content

Native worker image#2

Open
xpengahana wants to merge 1707 commits into
xpengahana:native-worker-imagefrom
prestodb:native-worker-image
Open

Native worker image#2
xpengahana wants to merge 1707 commits into
xpengahana:native-worker-imagefrom
prestodb:native-worker-image

Conversation

@xpengahana
Copy link
Copy Markdown
Owner

@xpengahana xpengahana commented Jan 3, 2024

Description

Motivation and Context

Impact

Test Plan

Contributor checklist

  • Please make sure your submission complies with our development, formatting, commit message, and attribution guidelines.
  • PR description addresses the issue accurately and concisely. If the change is non-trivial, a GitHub Issue is referenced.
  • Documented new properties (with its default value), SQL syntax, functions, or other functionality.
  • If release notes are required, they follow the release notes guidelines.
  • Adequate tests were added if applicable.
  • CI passed.

Release Notes

Please follow release notes guidelines and fill in the release notes below.

== RELEASE NOTES ==

General Changes
* ...
* ...

Hive Changes
* ...
* ...

If release note is NOT required, use:

== NO RELEASE NOTE ==

@presto-release-bot presto-release-bot force-pushed the native-worker-image branch 4 times, most recently from daca1b2 to 0effee9 Compare January 11, 2024 02:00
@presto-release-bot presto-release-bot force-pushed the native-worker-image branch 3 times, most recently from 892525f to 571c2c8 Compare January 19, 2024 02:00
@ethanyzhang ethanyzhang force-pushed the native-worker-image branch 3 times, most recently from 15b437d to 076f229 Compare January 20, 2024 05:51
@ethanyzhang ethanyzhang force-pushed the native-worker-image branch 6 times, most recently from 0c1543f to 696144c Compare February 2, 2024 20:39
@presto-release-bot presto-release-bot force-pushed the native-worker-image branch 3 times, most recently from 4b4af20 to 473b334 Compare February 13, 2024 02:01
hantangwangd and others added 30 commits October 16, 2024 08:59
@hantangwangd
[Iceberg]Enable test cases for rename table on REST and NESSIE catalog
f1058cc
@zuyu @yingsu00
[native] Add the native isBlockedTiming stat to operator stats
87277f8
@amitkdutta
[native] Advance velox.
e4c7e05
@lukmanulhakkeem @ebyhr @tdcmeehan
Fix aggregate queries with labels column in prometheus
9f54207 
Remove the map to Block conversion of MetricHeader to resolve
the issue with aggregate queries with labels column in Prometheus

Co-authored-by: Yuya Ebihara <ebyhry@gmail.com>
@BryanCutler @tdcmeehan
Fix flaky test TestQueues.testEagerPlanValidation
90742a4
@steveburnett @tdcmeehan
Add documentation for query plan and plan fragment
86ae524
@spershin @amitkdutta
Add "native_expression.max_array_size_in_reduce" session property.
61f5c3e
@Joe-Abraham @tdcmeehan
Use JDBC for ContainerQueryRunner
8c69bcb
@tanjialiang
[native] Fix periodic memory checker reporting metrics
85a0fa4
@Yuhta
[native] Revert remaining filter pushdown from FilterNode
f6c3abe 
If there is column renaming happening in-between, this will not work.  We need
to fix this in optimizer.
@SthuthiGhosh9400 @tdcmeehan
Pass extra credentials to system connector
f73097f 
Corrected in a line
@czentgr
[native] Include glog for thrift artifact build
8cceea2 
An upgrade to folly introduces the glog headers into the build of
thrift artifacts. This commit adds the glog include directory when building
the targets.
@steveburnett
Add presto_cpp/properties-session.rst
3d62b27
@amitkdutta
Add more tests for ArrayNormalizeFunction.
47e3730
@pdabre12 @tdcmeehan
Fix native_expression.max_array_size_in_reduce session property
0c19d4f
@amitkdutta @xiaoxmeng
[native] Advance velox.
a4e7d3f
@pramodsatya
[native] Update presto_protocol
d00cbe8
@pramodsatya
[native] Retrieve Json function metadata
bba64ad
@tanjialiang
[native] Add partitioned output buffers sessions
38e977e
@tdcmeehan @pdabre12
Add sidecars to NodeManager and add PluginNodeManager
7e6691d
@pramodsatya @aditi-pandit
[native] Update metadata for function combinations in FunctionMetadat…
90fe610 
…aTest
@xiaoxmeng
[native]Advance velox version with flaky test fix
b0a9144
@feilong-liu
Extend join prefilter optimizer to use hash
1512671
@ZacBlanco
[parquet] Add a profile to re-generate batch readers
342ceb0 
Previously, the code generation step was removed in 7c814ae
However, this makes it more difficult to add new readers in the
future, such as for UUIDs. This change adds the code generation step
as an optional profile which can be enabled when building the
parquet module through -PgenerateParquetReaders
@ZacBlanco
[iceberg] Add UUID type support
6909c85 
The iceberg spec lists uuid as a valid schema type. Presto supports
UUID types but there was no support for reading or writing them
in the connector.

This commit makes the necessary changes in the connector to create
tables with UUID columns and support for UUIDs in the parquet reader.
This includes an implementation for UUIDs in the batchreader.
@ZacBlanco
Rename enabledOptimizedReader -> enableBatchReader
e1c2db8
@zuyu @czentgr
[native] Update gtest targets for presto_function_metadata_test
96b716d
@bikramSingh91 @tanjialiang
[native] Add a metric to track expected reduction of memory and minor…
6537485 
… fixes

Summary:
- Add a metric `presto_cpp.memory_pushback_expected_reduction_bytes`
to track expected reduction in memory after a pushback attempt as
this can be different from actual reduction due to other threads
allocating simultaneously
- Fix registeration of a pushback metric
- Make periodicCb() API non-const to allow it to update internal
state if required
@xiaoxmeng
[native]Update TaskManagerTest to create new file in local file sink
c2dad16
@czentgr
Add LinuxMemoryChecker
be8c154
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.