feat(server): add transactional managed cache lineage - #1414
Open
Changyong Kwak (samkwak188) wants to merge 17 commits into
Open
feat(server): add transactional managed cache lineage#1414Changyong Kwak (samkwak188) wants to merge 17 commits into
Changyong Kwak (samkwak188) wants to merge 17 commits into
Conversation
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Preserve transactional cache commit and abort semantics while adopting upstream multi-tool parsing, reasoning-aware streaming, and current SDK changes. Update compatibility tests and remove the stale single-tool documentation claim.
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Changyong Kwak (samkwak188)
force-pushed
the
feat/managed-cache-lineage
branch
from
September 1, 2026 01:49
a5fb544 to
d1086b3
Compare
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Changyong Kwak (samkwak188)
force-pushed
the
feat/managed-cache-lineage
branch
from
September 1, 2026 02:58
f2de799 to
b8f0ab6
Compare
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Signed-off-by: Sam Kwak <samisme2005@gmail.com>
Changyong Kwak (samkwak188)
force-pushed
the
feat/managed-cache-lineage
branch
from
September 2, 2026 19:11
9dac627 to
d9c2c2f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds an opt-in, transaction-safe managed cache protocol to the OpenAI-compatible chat server and reconciles it with current Qualcomm
main.reset / previous_not_reusable.GenieX-Cache-Protocol: 2and the five-field cache record.Protocol version 2 accepts scalar text messages with
system,user, andassistantroles. It rejects managed VLM input, native tool messages, separated reasoning, speculative decoding, and system-only warm-up before generation. Session IDs are lineage labels, not authentication, authorization, or tenant isolation.QAIRT dependency
Managed reuse on QAIRT requires qualcomm/geniex-qairt-plugin#50. That correction renders the complete transcript, reconciles the exact token prefix against retained KV, rewinds divergent suffixes, rebuilds sampler history, and retains terminal EOG in KV without returning it as visible output.
The current gitlink pins
b3b85ab16c5106a7048ca2f24a3c9e4a8089cba7. The temporary fork URL is required only until PR 50 lands; it must be changed back to the Qualcomm submodule URL before this PR merges.Upstream reconciliation
Current PR head
d9c2c2fd7772a662614c9b9ae1be6a23add8de65contains Qualcommmaincommit2929a65788da939e2a02d5652624b2ff50a24adb. It preserves upstream automatic reset, VLM media replay, current native tool-call structures, and the existing single-handle request serialization.A security review found and fixed three documentation mismatches: ordinary mode is automatic rather than unconditional reset, the wire protocol is version 2, and the identity hashes model-manager-resolved model/tokenizer paths rather than every runtime-specific bundle file.
Verification
go vet ./cli/server/...passed6af9fee645de67dda649e487785d633b97b98ab4: https://github.com/samkwak188/GenieX/actions/runs/33668959554go test -racegate passedThe artifact CI ran at
6af9fee6; the current PR tree adds only the reviewed documentation alignment after that code commit. The on-device run used Qualcomm Qwen 3 0.6B as a protocol smoke model. It does not claim a latency improvement or substitute for the planned Llama 3.1 8B study.Remaining merge gate
.gitmodulesto the Qualcomm URL, and advance the gitlink to the merged upstream commitCloses #1413