feat(openai): per-tool MaxContextTokens prompt budget #3

Merged

thklein merged 3 commits from feat/max-context-tokens into main

2026-07-10 12:21:03 +00:00

thklein commented

2026-07-10 07:53:02 +00:00

Owner

Plumbs a new budget-only field MaxContextTokens through types/completion/engine/parser and makes the prompt-trim budget prefer it: precedence MaxContextTokens > MaxTokens (legacy) > GPTSCRIPT_DEFAULT_MAX_TOKENS env > 400k. request.MaxTokens (output limit) and isContextLengthError are untouched. Lets bpai set a per-model context window without conflating it with the output max_tokens.\n\nCommits: plumb field (+parser round-trip test); prefer it in getBudget/dropMessagesOverCount/decreaseTenPercent.

Plumbs a new budget-only field `MaxContextTokens` through types/completion/engine/parser and makes the prompt-trim budget prefer it: precedence `MaxContextTokens > MaxTokens (legacy) > GPTSCRIPT_DEFAULT_MAX_TOKENS env > 400k`. `request.MaxTokens` (output limit) and `isContextLengthError` are untouched. Lets bpai set a per-model context window without conflating it with the output max_tokens.\n\nCommits: plumb field (+parser round-trip test); prefer it in getBudget/dropMessagesOverCount/decreaseTenPercent.

thklein added 3 commits

2026-07-10 07:53:02 +00:00

feat(types): plumb MaxContextTokens through tool/completion/parser 1f380e6126

test(parser): cover MaxContextTokens parse round-trip 3d41827d4b

TestToolMaxContextTokensRoundTrip only checked Print() output, leaving
the parser case for "Max Context Tokens" without coverage. Add a
parser-level test that parses tool text and asserts the resulting
Parameters.MaxContextTokens.

feat(openai): prefer MaxContextTokens for the prompt-trim budget

Request reviewers for Dependabot PRs / request_reviewers (pull_request_target) Has been skipped

Details

smoke / check-label (pull_request_target) Failing after 3m0s

Details

integration / integration (ubuntu-22.04) (pull_request) Failing after 3m43s

Details

smoke / gpt-4o-2024-08-06 (pull_request_target) Has been skipped

Details

smoke / gpt-4o-mini-2024-07-18 (pull_request_target) Has been skipped

Details

smoke / claude-3-7-sonnet-20250219 (pull_request_target) Has been skipped