pakrym-oai 658af936fd [codex] Add token budget context feature (#27438) ...

## Why

The model should be able to see bounded context-window budget metadata
when the `token_budget` feature is enabled. The full-window message is
only injected with full context, while normal turns get a smaller
follow-up only when reported usage first crosses a budget threshold.

## What changed

- Added the `TokenBudget` feature flag.
- Added `<token_budget>` developer fragments for full context-window
metadata and current-window remaining tokens.
- Inserted the threshold message during normal turn handling by
comparing token usage before and after sampling, avoiding persistent
threshold bookkeeping.
- Added core integration coverage for full-context-only metadata and
25/50/75 percent threshold messages.

## Verification

- `just test -p codex-core token_budget`
- `git diff --check`

658af936fd · 2026-06-10 20:07:06 -07:00

History

..

agent

Add app-server thread/delete API (#25018)

2026-06-10 11:22:12 -07:00

apps

Split DeveloperInstructions into individual fragments. (#18813)

2026-04-21 10:22:36 -07:00

bin

Refactor config types into a separate crate (#16962)

2026-04-07 00:32:41 +00:00

config

Use plugin-service MCP as the hosted plugin runtime (#27198)

2026-06-10 12:54:21 +02:00

context

[codex] Add token budget context feature (#27438)

2026-06-10 20:07:06 -07:00

context_manager

[codex] Remove remote compaction failure log (#27106)

2026-06-08 19:23:35 -07:00

guardian

[codex] Retry transient Guardian review failures (#27062)

2026-06-10 11:46:57 -07:00

plugins

[plugins] Inject remote_plugin_id into install elicitations (#26409)

2026-06-10 12:01:03 -07:00

sandboxing

core: stop threading SandboxPolicy through exec (#25700)

2026-06-03 10:41:41 -07:00

session

[codex] Add token budget context feature (#27438)

2026-06-10 20:07:06 -07:00

state

[codex] Store compact window id in rollout (#27264)

2026-06-10 08:47:16 -07:00

tasks

Add app-server background terminal process APIs (#26041)

2026-06-10 11:18:09 -07:00

tools

core: resize all history images behind a feature flag (#27247)

2026-06-10 19:21:24 -07:00

unified_exec

Add app-server background terminal process APIs (#26041)

2026-06-10 11:18:09 -07:00

utils

Extract rollout into its own crate (#15548)

2026-03-24 18:10:53 -07:00

agents_md_tests.rs

[codex] Preserve logical paths during AGENTS.md discovery (#26465)

2026-06-04 15:08:52 -07:00

agents_md.rs

[codex] Preserve logical paths during AGENTS.md discovery (#26465)

2026-06-04 15:08:52 -07:00

apply_patch_tests.rs

[codex] Migrate apply_patch to executor filesystem (#17027)

2026-04-07 21:20:22 +00:00

apply_patch.rs

Support multi-environment apply_patch selection (#21617)

2026-05-11 16:33:44 -07:00

attestation.rs

[codex] request desktop attestation from app (#20619)

2026-05-08 12:36:02 -07:00

client_common_tests.rs

[codex] Remove legacy shell output formatting paths (#22706)

2026-05-18 09:57:54 -07:00

client_common.rs

Encrypt multi-agent v2 message payloads (#26210)

2026-06-05 10:25:57 +02:00

client_tests.rs

[codex] Store compact window id in rollout (#27264)

2026-06-10 08:47:16 -07:00

client.rs

[codex] Store compact window id in rollout (#27264)

2026-06-10 08:47:16 -07:00

codex_delegate_tests.rs

Use latest-wins MCP manager replacement (#27259)

2026-06-10 08:33:21 -07:00

codex_delegate.rs

Load selected executor skills through extensions (#27184)

2026-06-09 19:51:54 +02:00

codex_thread.rs

Add app-server background terminal process APIs (#26041)

2026-06-10 11:18:09 -07:00

command_canonicalization_tests.rs

…

command_canonicalization.rs

core: remove cross-crate re-exports from lib.rs (#16512)

2026-04-01 23:06:24 -07:00

compact_remote_v2.rs

[codex] Add token budget context feature (#27438)

2026-06-10 20:07:06 -07:00

compact_remote.rs

[codex] Add token budget context feature (#27438)

2026-06-10 20:07:06 -07:00

compact_tests.rs

[codex] Filter legacy warning messages during compaction (#22243)

2026-05-11 19:51:51 -07:00

compact.rs

[codex] Add token budget context feature (#27438)

2026-06-10 20:07:06 -07:00

config_lock.rs

Use plugin-service MCP as the hosted plugin runtime (#27198)

2026-06-10 12:54:21 +02:00

connectors_tests.rs

Switch runtime to cloud config bundle (#24622)

2026-06-02 13:18:59 -07:00

connectors.rs

Use latest-wins MCP manager replacement (#27259)

2026-06-10 08:33:21 -07:00

consequential_tool_message_templates.json

…

environment_selection.rs

feat: guard git enrichment (#26175)

2026-06-03 18:36:10 +02:00

event_mapping_tests.rs

[codex] Add token budget context feature (#27438)

2026-06-10 20:07:06 -07:00

event_mapping.rs

[codex] Add token budget context feature (#27438)

2026-06-10 20:07:06 -07:00

exec_env_tests.rs

[codex] Move config loading into codex-config (#19487)

2026-04-26 15:10:53 -07:00

exec_env.rs

[codex] Move config loading into codex-config (#19487)

2026-04-26 15:10:53 -07:00

exec_policy_tests.rs

[codex] Respect Windows sandbox backend in exec policy (#26307)

2026-06-05 11:20:52 -07:00

exec_policy_windows_tests.rs

[codex] Respect Windows sandbox backend in exec policy (#26307)

2026-06-05 11:20:52 -07:00

exec_policy.rs

[codex] Respect Windows sandbox backend in exec policy (#26307)

2026-06-05 11:20:52 -07:00

exec_tests.rs

core: stop threading SandboxPolicy through exec (#25700)

2026-06-03 10:41:41 -07:00

exec.rs

core: stop threading SandboxPolicy through exec (#25700)

2026-06-03 10:41:41 -07:00

function_tool.rs

feat: extract shared tool executor interface (#22359)

2026-05-13 11:31:27 +02:00

git_info_tests.rs

[codex] preserve fsmonitor for worktree Git reads (#26880)

2026-06-08 21:32:46 -07:00

hook_runtime.rs

Add spans to run_turn (#27107)

2026-06-10 04:41:06 +00:00

image_preparation_tests.rs

core: resize all history images behind a feature flag (#27247)

2026-06-10 19:21:24 -07:00

image_preparation.rs

core: resize all history images behind a feature flag (#27247)

2026-06-10 19:21:24 -07:00

installation_id.rs

feat: split memories part 2 (#19860)

2026-04-28 13:03:28 +02:00

landlock.rs

linux-sandbox: switch helper plumbing to PermissionProfile (#20106)

2026-04-28 19:43:44 -07:00

lib.rs

core: resize all history images behind a feature flag (#27247)

2026-06-10 19:21:24 -07:00

mcp_openai_file.rs

Deprecate TurnContext cwd and resolve_path (#22519)

2026-05-13 11:15:25 -07:00

mcp_skill_dependencies.rs

Route hosted Apps MCP through extensions (#27191)

2026-06-09 22:44:16 +02:00

mcp_tool_approval_templates.rs

Uprev Rust toolchain pins to 1.95.0 (#24684)

2026-05-26 20:59:47 -07:00

mcp_tool_call_tests.rs

Use latest-wins MCP manager replacement (#27259)

2026-06-10 08:33:21 -07:00

mcp_tool_call.rs

Use latest-wins MCP manager replacement (#27259)

2026-06-10 08:33:21 -07:00

mcp_tool_exposure_test.rs

[codex] Support ui visibility meta for tools (#24700)

2026-05-28 10:24:03 -07:00

mcp_tool_exposure.rs

Add spans to run_turn (#27107)

2026-06-10 04:41:06 +00:00

mcp.rs

[codex] Preserve disabled MCP servers across runtime overlays (#27414)

2026-06-10 16:11:20 -04:00

memory_usage.rs

Remove ToolsConfig from tool planning (#22835)

2026-05-19 11:24:09 +02:00

mention_syntax.rs

Extract codex-utils-plugins crate (#15746)

2026-03-25 11:05:35 -07:00

network_policy_decision_tests.rs

extract models manager and related ownership from core (#16508)

2026-04-02 23:00:02 -07:00

network_policy_decision.rs

refactor(proxy): clarify sandbox block messages (#17168)

2026-04-09 10:53:06 -07:00

network_proxy_loader_tests.rs

Use named MITM permissions config (#18240)

2026-05-20 17:10:37 -07:00

network_proxy_loader.rs

Switch runtime to cloud config bundle (#24622)

2026-06-02 13:18:59 -07:00

original_image_detail.rs

Remove js_repl feature (#19410)

2026-04-24 17:49:29 -07:00

otel_init.rs

Add process-scoped SQLite telemetry (#22154)

2026-05-11 11:32:40 -07:00

personality_migration_tests.rs

Add multi-agent runtime metadata types (#25720)

2026-06-02 12:10:14 +02:00

personality_migration.rs

chore: stop consuming legacy config profiles (#24076)

2026-05-26 10:34:43 +02:00

prompt_debug.rs

core: resize all history images behind a feature flag (#27247)

2026-06-10 19:21:24 -07:00

realtime_context_tests.rs

Add extra config to StoredThread, leave empty for now (#27092)

2026-06-09 00:38:35 +00:00

realtime_context.rs

[codex] Route live thread writes through ThreadStore (#18882)

2026-04-23 10:17:09 -07:00

realtime_conversation_tests.rs

[codex] Fix realtime v1 websocket compatibility (#23771)

2026-05-20 16:03:51 -07:00

realtime_conversation.rs

Forward standalone assistant output to realtime (#27319)

2026-06-10 21:32:29 +00:00

realtime_prompt.rs

[codex] Consolidate shared prompts in codex-prompts (#25151)

2026-06-01 18:45:07 +00:00

responses_retry.rs

centralize Responses retry policy (#24131)

2026-05-26 11:01:18 +02:00

review_format.rs

core: remove cross-crate re-exports from lib.rs (#16512)

2026-04-01 23:06:24 -07:00

rollout.rs

app-server: remove experimental persist_extended_history bool flag (#25712)

2026-06-01 23:33:42 +00:00

safety_tests.rs

Make deny canonical for filesystem permission entries (#23493)

2026-05-19 11:03:47 -07:00

safety.rs

Make turn diff tracking operation backed (#21180)

2026-05-07 11:33:47 +02:00

sandbox_tags_tests.rs

telemetry: tag sandboxes from permission profiles (#22791)

2026-05-15 10:58:50 -07:00

sandbox_tags.rs

telemetry: tag sandboxes from permission profiles (#22791)

2026-05-15 10:58:50 -07:00

session_prefix.rs

Organize context fragments (#18794)

2026-04-20 22:39:17 -07:00

session_rollout_init_error.rs

remove temporary ownership re-exports (#16626)

2026-04-03 00:33:34 -07:00

session_startup_prewarm.rs

[codex] Store compact window id in rollout (#27264)

2026-06-10 08:47:16 -07:00

shell_snapshot_tests.rs

state: pass state db handles through consumers (#20561)

2026-05-04 11:46:03 -07:00

shell_snapshot.rs

[codex] Add environment shell info (#26480)

2026-06-04 22:36:25 -07:00

shell_tests.rs

chore: clean up argument-comment lint and roll out all-target CI on macOS (#16054)

2026-03-27 19:00:44 -07:00

shell.rs

[codex] Add environment shell info (#26480)

2026-06-04 22:36:25 -07:00

skills.rs

chore: mechanical rename (#26156)

2026-06-03 15:38:30 +02:00

spawn.rs

core: stop threading SandboxPolicy through exec (#25700)

2026-06-03 10:41:41 -07:00

state_db_bridge.rs

state: pass state db handles through consumers (#20561)

2026-05-04 11:46:03 -07:00

stream_events_utils_tests.rs

Remove async-trait from extension contributors (#27383)

2026-06-10 14:31:09 +02:00

stream_events_utils.rs

Add saved image path hint to standalone image generation (#25947)

2026-06-04 09:39:20 -07:00

test_support.rs

Uprev Rust toolchain pins to 1.95.0 (#24684)

2026-05-26 20:59:47 -07:00

thread_manager_tests.rs

Remove async-trait from extension contributors (#27383)

2026-06-10 14:31:09 +02:00

thread_manager.rs

Add app-server thread/delete API (#25018)

2026-06-10 11:22:12 -07:00

thread_rollout_truncation_tests.rs

Drop startup context when truncating forked rollouts (#24751)

2026-05-27 15:49:08 +02:00

thread_rollout_truncation.rs

Drop startup context when truncating forked rollouts (#24751)

2026-05-27 15:49:08 +02:00

turn_diff_tracker_tests.rs

core: cache turn diff rendering (#27489)

2026-06-10 17:17:44 -07:00

turn_diff_tracker.rs

core: cache turn diff rendering (#27489)

2026-06-10 17:17:44 -07:00

turn_metadata_tests.rs

Populate workspace kind on Codex turn events (#25135)

2026-06-02 12:46:14 -07:00

turn_metadata.rs

Populate workspace kind on Codex turn events (#25135)

2026-06-02 12:46:14 -07:00

turn_timing_tests.rs

[codex] Add turn profiling analytics (#26484)

2026-06-05 11:27:10 -07:00

turn_timing.rs

[codex] Add turn profiling analytics (#26484)

2026-06-05 11:27:10 -07:00

user_shell_command_tests.rs

Organize context fragments (#18794)

2026-04-20 22:39:17 -07:00

user_shell_command.rs

Organize context fragments (#18794)

2026-04-20 22:39:17 -07:00

util_tests.rs

Trim TUI legacy core helper usage (#22695)

2026-05-14 16:54:59 -07:00

util.rs

Trim TUI legacy core helper usage (#22695)

2026-05-14 16:54:59 -07:00

web_search.rs

…

windows_sandbox_read_grants_tests.rs

windows-sandbox: pass workspace roots to runner (#24108)

2026-05-28 15:26:55 -07:00

windows_sandbox_read_grants.rs

windows-sandbox: pass workspace roots to runner (#24108)

2026-05-28 15:26:55 -07:00

windows_sandbox_tests.rs

config: remove legacy profile v1 resolution (#24051)

2026-05-22 12:13:52 +02:00

windows_sandbox.rs

Add Windows sandbox provisioning setup command (#24831)

2026-05-29 11:01:44 -07:00