Streaming from the output of an LLM in Python.

[cyai]

Is there any documentation or some one could provide me a code snippet of how to Input and Output Streaming with chatGPT (or any LLM) in python.

I've went through the official docs but it seems to be only having NodeJS not Python.

[ansario]

Did you figure this out @cyai ?

[haydenkaizeta]

Would be great to see this in the general REST api too