feat: compress session automaticlly

[sigoden]

There are three configuration items that control automatic session compression

# Compress session messages if tokens exceed this value (valid only >=1000)
compress_threshold: 2000
# The prompt for summarizing session messages
summarize_prompt: 'Summarize the discussion briefly in 200 words or less to use as a prompt for future context.'
# The prompt for the summary of the session
summary_prompt: 'This is a summary of the chat history as a recap: '

When the total number of tokens in the session messages exceeds compress_threshold, aichat will automatically compress the session.

Aichat will send a summarize_prompt with session messages to LLM to summarize the conversation, and then use the summary text prefixed with summary_prompt and the last two messages as context for the next chat.

close #329 #280

This is a very opinion feature, welcome to test and give feedback.

[ahmedre]

Just wanted to say thank you - I think this will do nicely!