Skip to content

fix: support external page tables with 4-byte alignment - #12

Open
rogeryoungh wants to merge 1 commit into
MiniMax-AI:mainfrom
rogeryoungh:support-page-table
Open

fix: support external page tables with 4-byte alignment#12
rogeryoungh wants to merge 1 commit into
MiniMax-AI:mainfrom
rogeryoungh:support-page-table

Conversation

@rogeryoungh

@rogeryoungh rogeryoungh commented Aug 6, 2026

Copy link
Copy Markdown
Collaborator

Summary

SGLang integration requires two changes to MSA sparse attention:

  • Accept a prebuilt page_table directly.
  • Remove the 16-byte alignment assumption for page-table metadata and use the natural 4-byte alignment of int32.

Changes

  • Added page_table support to the public API and sparse prefill adapter, including mixed-batch routing.
  • Centralized page-table validation for BF16 and NVFP4 paths.
  • Updated the CuTe tensor alignment and compilation cache keys.
  • Added coverage for direct page tables, mixed dispatch, precedence, and non-16-byte-aligned inputs.

View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need. Autofix is disabled.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant