Python: Cardinality difference between C# and Python on GetStreamingChatMessageContentsAsync and complete_chat_stream

[matthewbolanos]

In C#, GetStreamingChatMessageContentsAsync generates a IAsncEnumerable of StreamingChatMessageContent

// Invoke the chat completion service
IChatCompletionService chatCompletionService = kernel.GetRequiredService<IChatCompletionService>();
var results = chatCompletionService.GetStreamingChatMessageContentsAsync(
    chatHistory: chatHistory,
    executionSettings: new OpenAIPromptExecutionSettings() {
        // Allows the AI to automatically choose and invoke functions from the kernel's plugins
        ToolCallBehavior = ToolCallBehavior.AutoInvokeKernelFunctions
    },
    kernel: kernel
);

// Return the results as a stream
var completeMessage = new StringBuilder();
await foreach (var result in results)
{
    completeMessage.Append(result);

    // Send the message events to the client
    var events = assistantEventStreamUtility.CreateMessageEvent(run.Id, result);
    foreach (var messageEvent in events)
    {
        yield return messageEvent;
    }
}

Python, however, creates a AsyncGenerator[list[StreamingChatMessageContent], which makes the code less obvious to write because you always have to get the first index [0].

# Invoke the chat completion service
chatCompletion: ChatCompletionClientBase = kernel.get_service(type=ChatCompletionClientBase)
results = chatCompletion.complete_chat_stream(
    chat_history=history,
    settings=OpenAIChatPromptExecutionSettings(
        # function_call_behavior=FunctionCallBehavior()
    ),
    kernel=kernel
)

# Return the results as a stream 
completeMessage = ""
async for result in results:
    completeMessage += result[0].content

    # Send the message events to the client
    events = event_stream_utility.create_message_event(run.id, result[0])
    for event in events:
        yield event

[eavanvalkenburg]

@matthewbolanos how does dotnet deal with num_responses > 1 for this, because that is the reason everything returns a list!