Experimental series sharding (default off) - #112
Merged
Merged
Conversation
Route queries and writes through Active region peers with fallback metrics, add automatic primary failover, and expand integration tests plus docs for the experimental sharding data plane. Include perf bench scripts for multi-node ingest/query validation.
Per-node ClickHouse MVs, scatter-gather backfill, all-region dest reads with merge, transfer purge, and integration tests including Raft replication.
…reads. Propagate mutation/replication failures as HTTP errors, split on max peer series_count, and read global COUNT from region primaries so a 6-node Kind cluster converges without per-pod CREATE DATABASE. Co-authored-by: Cursor <cursoragent@cursor.com>
Bootstrap was hardcoding region_id=1 for every measurement, causing stale_epoch heartbeat rejections when multiple regions shared an ID. Allocate from next_region_id, reject duplicates on apply, and document the invariant plus clean-cluster kind runbook in deep-dive §15.
Park stuck split-transfers, replace dead region peers, and fail writes when the primary is down instead of accepting them on a replica. Drop the ConfigMap patch script in favor of operator spec.sharding and add e2e phase windows.
Align v1-stable-scope with CREATE MATERIALIZED VIEW on sharded clusters, and document the operator sharding spec that already exists on the CRD.
…inator scatter Raft voters stuck in Syncing 503 /health and stalled OrderedReady; last_split_at=0 binary-split every tick; coordinators without a local catalog could not scatter SELECT/DELETE.
CI check_doc_links resolved those paths from docs/superpowers/plans/, so the docs/ prefixes missed clustering, advanced-features, and glossary.
![cursor[bot]](https://avatars.githubusercontent.com/in/1210556?s=60&v=4){kind=small}
There was a problem hiding this comment.
Approved. Cursor Bugbot was not present on this run, so that signal was skipped; no applicable approval policy required human review and no unresolved automated findings were present. Reviewers were not assigned.
Sent by Cursor Approval Agent: Pull Request Router and Approver
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
spec.sharding.enabled/ ConfigMap); this is not a V1-stable claim./healthand stalled StatefulSet OrderedReady; bootstraplast_split_at=0let a hot region binary-split every scheduler tick; a coordinator that is not a region peer could not scatter SELECT/DELETE because it had no local catalog.region_max_series.origin/main...HEAD: no newunsafeon product paths (existingdisk_monitor.rsSAFETY comment only). Style nits in older commits are waived.Test plan
cargo fmt --all -- --checkcargo clippy --all-targets --no-deps -- -D warningscargo test --lib+cargo test --test '*'+cargo test -p hyperbytedb-cliDo not merge until CI is green.
Made with Cursor