Skip to content

add parallel orchestrator variants - #1

Draft
network4agent wants to merge 1 commit into
mainfrom
agent/parallel-orchestrator
Draft

add parallel orchestrator variants#1
network4agent wants to merge 1 commit into
mainfrom
agent/parallel-orchestrator

Conversation

@network4agent

Copy link
Copy Markdown
Owner

变更内容

  • 新增 Qwen3 并行 Orchestrator V3:Planner、多 Builder 与保序 Committer 流水线。
  • 新增 V4 分片 TensorMap、并行 shard owner 与保序 Publisher。
  • 对齐 RingBuffer、Task、TensorMap 与 Scheduler 的配套源码接口,并补充 Windows/MinGW 构建入口。
  • 新增 DAG/descriptor 一致性探针、端到端基准脚本及实现、评估和性能文档。

原因与影响

现有动态 TensorMap 路径主要以串行方式构建 descriptor 和依赖,限制了编排阶段的并行度。本提交将可并行的构建阶段与必须保序的依赖发布阶段拆分,同时保持任务描述和 DAG 与串行基线完全一致。

用户可通过 qwen3_parallel.hqwen3_parallel_v4.h 选择并行实现,并使用 BUILDER_THREADSTM_SHARDSDEFER_SCHEDULER 调整构建和测量方式。默认既有 case 仍保留。

验证

  • run-windows.cmd -B test-tensormap:11 项 TensorMap 测试全部通过。
  • 串行、V3、V4 probe 均生成 864 tasks、3096 subtasks、2742 edges;descriptor hash ae1f01a977b624fd、DAG hash e60bfbb9b34505e1 完全一致。
  • benchmark_parallel_orchestrator.ps1 -Warmups 0 -Runs 1:纯编排、并发调度和延后调度路径全部完成。
  • git diff --check origin/main..HEAD:通过。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant