What if the context size exceeds the limit? #6
Description
Since the session is stateful, do we need to discuss the case when context exceeds the window limit? Should the implementation discard oldest or newest tokens?
{{ message }}
Since the session is stateful, do we need to discuss the case when context exceeds the window limit? Should the implementation discard oldest or newest tokens?