Skip to content

Conversation

@mattbrandman
Copy link
Contributor

@mattbrandman mattbrandman commented Dec 4, 2025

  • Store and resends the container id on the modelresponse.provider_details.
  • Always goes by the most recent container id
  • Introduces a setting on modelprofile to force a new container (this is relevant for resetting and handling expiring containers)

solves containerid part of #3365.

@mattbrandman mattbrandman force-pushed the container-id branch 2 times, most recently from aa4dca2 to 4cc56e5 Compare December 4, 2025 02:57
@mattbrandman
Copy link
Contributor Author

@DouweM for review whenever you have time

@mattbrandman mattbrandman marked this pull request as ready for review December 4, 2025 03:48
return None if container is False else container
for m in reversed(messages):
if isinstance(m, ModelResponse) and m.provider_details:
if cid := m.provider_details.get('container_id'):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should verify that the provider_name matches self.system as well

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants