[WIP] Add streaming support by julien-nc · Pull Request #366 · nextcloud/integration_openai

start implementing streaming

julien-nc

committed

use direct curl for streaming, parse the stream and yield intermediate tokens

julien-nc

committed

track quota usage of streamed response

julien-nc

committed

warn about effects of using curl directly

julien-nc

committed

add small tests showing that streaming does not fully work with IClient

julien-nc

committed

use IClient that now progressively writes the stream response body

julien-nc

committed

factorize, harmonize stream/non-stream results

julien-nc

committed

add comments

julien-nc

committed

start using ISynchronousProgressiveProvider

julien-nc

committed

cleanup

julien-nc

committed

fix psalm and cs issues

julien-nc

committed

read smaller chunks of the streaming response to allow higher update frequency

julien-nc

committed

bump min and max NC versions to 35

julien-nc

committed

add optional input in providers to toggle streaming

julien-nc

committed

add streaming support for context write and reformulate

julien-nc

committed

add streaming support for analyse image, change tone, translate and chatWithTools

julien-nc

committed

adjust to changes in ISynchronousProgressiveProvider, use new preferStreaming param in process

julien-nc

committed

add support for reasoning_content in streamed and non-streamed API responses, content and resoning_content chunks are yielded when streaming. ignore reasoning in the providers for now

julien-nc

committed

adjust to recent changes in server: use ISynchronousOptionsProvider and SynchronousProviderOptions

julien-nc

committed

rename ISynchronousOptionsProvider to ISynchronousOptionsAwareProvider

julien-nc

committed

reduce the streaming chunk size to reduce time to first token

julien-nc

committed

fix php lint issue, a stub was outdated

julien-nc

committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[WIP] Add streaming support#366

[WIP] Add streaming support#366
julien-nc wants to merge 22 commits into
mainfrom
enh/noid/streaming

Commits on Jun 2, 2026

start implementing streaming

use direct curl for streaming, parse the stream and yield intermediate tokens

track quota usage of streamed response

warn about effects of using curl directly

add small tests showing that streaming does not fully work with IClient

use IClient that now progressively writes the stream response body

factorize, harmonize stream/non-stream results

add comments

start using ISynchronousProgressiveProvider

cleanup

fix psalm and cs issues

read smaller chunks of the streaming response to allow higher update frequency

bump min and max NC versions to 35

add optional input in providers to toggle streaming

add streaming support for context write and reformulate

add streaming support for analyse image, change tone, translate and chatWithTools

adjust to changes in ISynchronousProgressiveProvider, use new preferStreaming param in process

add support for reasoning_content in streamed and non-streamed API responses, content and resoning_content chunks are yielded when streaming. ignore reasoning in the providers for now

adjust to recent changes in server: use ISynchronousOptionsProvider and SynchronousProviderOptions

rename ISynchronousOptionsProvider to ISynchronousOptionsAwareProvider

reduce the streaming chunk size to reduce time to first token

fix php lint issue, a stub was outdated