Skip to content

[server] Clarify remote log start offset semantics - #3942

Closed
gyang94 wants to merge 1 commit into
apache:mainfrom
gyang94:codex/fix-remote-log-logical-offset
Closed

[server] Clarify remote log start offset semantics#3942
gyang94 wants to merge 1 commit into
apache:mainfrom
gyang94:codex/fix-remote-log-logical-offset

Conversation

@gyang94

@gyang94 gyang94 commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

Purpose

Close #3943.

Keep the remote log start offset reported by the manifest and tablet aligned with the manifest-visible logical range. A replacement object may physically start before the current visible range; for example, a physical object covering [5, 25) can be visible only from offset 10. Reporting physical offset 5 would incorrectly expose an expired prefix.

Brief change log

  • return the logical start offset from RemoteLogManifest
  • rename physical segment start-offset APIs to physicalStartOffset
  • rename propagated start-offset fields and variables so logical and physical semantics are explicit
  • leave all remote log end-offset APIs and semantics unchanged
  • add regression coverage for a physical start offset preceding the manifest-visible logical start

Tests

  • mvn -o -pl fluss-common -DskipITs -Dfast -Dtest=RemoteLogManifestOverlapTest test
  • mvn -o -pl fluss-server -am -DskipITs -Dfast -Dtest=RemoteLogTabletOverlapTest,RemoteLogTabletTest,RemoteLogManagerTest -Dsurefire.failIfNoSpecifiedTests=false test
  • mvn -o -pl fluss-client,fluss-server,fluss-flink/fluss-flink-common -am -DskipTests -Dfast package

API and Format

This renames internal Java APIs for remote segment physical start offsets. It does not change the RPC wire format, manifest storage format, or remote log end-offset semantics.

Documentation

No user-facing documentation changes are required.

Generative AI disclosure

  • Yes — Codex (GPT-5)

Keep manifest-visible start offsets logical and distinguish physical segment start offsets throughout the remote log call chain.

Co-Authored-By: Codex <noreply@openai.com>

AI-Model: gpt-5

AI-Contributed/Feature: 200/200

AI-Contributed/UT: 118/118
@gyang94
gyang94 marked this pull request as ready for review August 11, 2026 08:17
@wuchong

wuchong commented Aug 12, 2026

Copy link
Copy Markdown
Member

Continue with #3956

@wuchong wuchong closed this Aug 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Remote log start offset may expose an expired physical prefix

2 participants