Skip to content

TEST cover Crescendo seeded media follow-ups - #2478

Open
Roman Lutz (romanlutz) wants to merge 6 commits into
microsoft:mainfrom
romanlutz:romanlutz-test-crescendo-seeded-followups
Open

TEST cover Crescendo seeded media follow-ups#2478
Roman Lutz (romanlutz) wants to merge 6 commits into
microsoft:mainfrom
romanlutz:romanlutz-test-crescendo-seeded-followups

Conversation

@romanlutz

Copy link
Copy Markdown
Contributor

Description

Crescendo already consumes original seed media after an accepted response and routes later turns using text or the latest generated media. This PR adds focused regression coverage for that contract, especially around cases where accidentally reattaching the original seed would reset an iterative edit.

The tests verify that:

  • single-turn objective targets are rejected because Crescendo requires native multi-turn history;
  • the original seed is attached exactly once during a normally accepted first turn;
  • a content-filtered first attempt retries the same logical turn with the seed intact;
  • after acceptance, later requests are text-only unless the latest accepted generated media is forwardable;
  • adversarial prompt state, conversation branching, normalized and persisted history, scorer inputs, and terminal results remain consistent.

Production code is unchanged because the current routing behavior already satisfies these cases.

Tests and Documentation

  • uv run pytest tests\unit\executor\attack\multi_turn\test_crescendo.py tests\unit\executor\attack\multi_turn\test_crescendo_resilience.py -q (91 passed)
  • uv run ruff check tests\unit\executor\attack\multi_turn\test_crescendo_resilience.py
  • uv run ruff format --check tests\unit\executor\attack\multi_turn\test_crescendo_resilience.py
  • git diff --check origin/main...HEAD

Documentation was not changed because this PR only strengthens coverage for existing behavior. JupyText was not run because no documentation files changed.

Copilot AI and others added 6 commits August 14, 2026 12:55
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: c915b94a-29a0-45b5-8f3f-6ee06848b6eb
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: c915b94a-29a0-45b5-8f3f-6ee06848b6eb
@hannahwestra25 hannahwestra25 self-assigned this Aug 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants