Skip to content

Fix AdaptiveBatcher timeout calculation#2093

Merged
sakoush merged 1 commit intoSeldonIO:masterfrom
hanlaur:bug-batching-timeout
Apr 1, 2025
Merged

Fix AdaptiveBatcher timeout calculation#2093
sakoush merged 1 commit intoSeldonIO:masterfrom
hanlaur:bug-batching-timeout

Conversation

@hanlaur
Copy link
Copy Markdown
Contributor

@hanlaur hanlaur commented Mar 31, 2025

Before the fix, the timeout calculation subtracted the passed time from the timeout calculated for the previous round instead of subtracting it from the configured timeout value, causing time to pass quicker than expected.

Fixes #1936

Fixes #2065

Before the fix, the timeout calculation subtracted the passed time from the
timeout calculated for the previous round instead of subtracting it from the
configured timeout value, causing time to pass quicker than expected.
@CLAassistant
Copy link
Copy Markdown

CLAassistant commented Mar 31, 2025

CLA assistant check
All committers have signed the CLA.

Copy link
Copy Markdown
Contributor

@sakoush sakoush left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, @hanlaur thanks for your contribution.

@sakoush sakoush merged commit 4199fe1 into SeldonIO:master Apr 1, 2025
50 checks passed
@hanlaur hanlaur deleted the bug-batching-timeout branch April 1, 2025 09:15
RobertSamoilescu pushed a commit that referenced this pull request Apr 11, 2025
Before the fix, the timeout calculation subtracted the passed time from the
timeout calculated for the previous round instead of subtracting it from the
configured timeout value, causing time to pass quicker than expected.
RobertSamoilescu pushed a commit that referenced this pull request Apr 11, 2025
Before the fix, the timeout calculation subtracted the passed time from the
timeout calculated for the previous round instead of subtracting it from the
configured timeout value, causing time to pass quicker than expected.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Adaptive batching timeout calculation mistake Adaptive batching batch timeout fires sooner than configured

3 participants