jif aae4c0b02b bound prompt image cache retention (#28294) ...

## Why

The prompt image cache was bounded to 32 entries, but not by the size of
those entries. A set of large encoded images could therefore retain
substantially more memory than intended. Cache hits also cloned the full
encoded payload.

## What changed

- cap the cache at 64 MiB of encoded image data while preserving its
existing 32-entry limit
- skip caching an image that exceeds the entire byte budget
- evict least-recently-used entries until the cache is back within its
byte budget
- share cached encoded bytes with `Arc<[u8]>` so cache hits do not
deep-clone image payloads

## Validation

- `just test -p codex-utils-image`

aae4c0b02b · 2026-06-15 19:52:30 +02:00

History

..

benches

[codex] Add image re-encoding benchmarks (#23935)

2026-05-22 22:38:40 +00:00

src

bound prompt image cache retention (#28294)

2026-06-15 19:52:30 +02:00

BUILD.bazel

feat: add support for building with Bazel (#8875)

2026-01-09 11:09:43 -08:00

Cargo.toml

[codex] Add image re-encoding benchmarks (#23935)

2026-05-22 22:38:40 +00:00