ResponseGeneratorSync
A wrapper for OpenAI streaming responses that logs the response to Permitech. This class wraps the OpenAI streaming response generator and logs the response to Permitech when the generator is exhausted. It implements the iterator protocol to allow for streaming responses. Arguments-
resource(OpenAiModuleDefinition): The OpenAI resource definition. -
response(Generator or openai.Stream): The OpenAI streaming response. -
input_data(OpenAiInputData): The input data for the OpenAI request. -
logger(PermitechLogger): The Permitech logger instance. -
should_complete_trace(bool): Whether to complete the trace when the generator is exhausted.