aixplain.modules.model.model_response_streamer
ModelResponseStreamer Objects
class ModelResponseStreamer()
A class representing a streamer for model responses.
This class provides an iterator interface for streaming model responses. It handles the conversion of JSON-like strings into ModelResponse objects and manages the response status.
__init__
def __init__(iterator: Iterator)
Initialize a new ModelResponseStreamer instance.
Arguments:
iterator
Iterator - An iterator that yields JSON-like strings.
__next__
def __next__()
Return the next chunk of the response.
Returns:
ModelResponse
- A ModelResponse object containing the next chunk of the response.
__iter__
def __iter__()
Return the iterator for the ModelResponseStreamer.
Returns:
Iterator
- The iterator for the ModelResponseStreamer.