Skip to content

CONTRIBUTING: document testing and commit/PR organization#533

Merged
swasik merged 1 commit into
masterfrom
vector-763-contributing-testing-docs
Jul 24, 2026
Merged

CONTRIBUTING: document testing and commit/PR organization#533
swasik merged 1 commit into
masterfrom
vector-763-contributing-testing-docs

Conversation

@swasik

@swasik swasik commented Jul 23, 2026

Copy link
Copy Markdown
Collaborator

Motivation

The Testing section of CONTRIBUTING.md only documented cargo test, and the repo had no written commit/PR organization conventions or agent-facing instructions. This PR documents how contributors actually test and structure changes.

Changes

CONTRIBUTING.md

Testing — two new subsections:

  • Validator harness (end-to-end tests): what it is (spawns its own ScyllaDB + Vector Store cluster), building vector-store and vector-search-validator with scripts/run-with-release-toolchain (and why the toolchain-built binaries must be used — glibc compatibility with the ScyllaDB image), running via scripts/run-validator-with-scylla-docker <scylla-image> <vs-bin> <validator-bin> [filters] --verbose, the <group>::<test> filter syntax, and listing test cases.
  • Manual testing with the example docker-compose stacks: the docs/examples/docker/docker-compose.yml (CQL / native) and docker-compose-alternator.yml (Alternator / DynamoDB) stacks, how to bring them up and exercise them with docs/examples/quick-start.cql, with a note that this is for local exploration only.

Commit and PR Organization — a new section based on the ScyllaDB patch organization guidelines: small self-contained patches, each individually compiling/correct with sensible ordering, the module: changes subject format (repo components vector-store/validator/scripts/README), specific summaries, ~72-char commit-log lines, non-expert self-contained descriptions, and the why-not-just-what motivation rule for patches and PRs.

Pre-Review Checklist — updated the issue-reference bullets from GitHub issues (Fixes: #XYZ / Reference: #XYZ) to Jira (Fixes: VECTOR-XYZ / Refs: VECTOR-XYZ), since the project no longer uses GitHub issues.

CLAUDE.md (new)

A repository-level agent-instructions file pointing at CONTRIBUTING.md and docs/rust_instructions.md, with a quick reference (format/lint/test commands, OpenAPI regeneration, and a pointer to the Commit and PR Organization section) so the contributor guidelines and Rust conventions are surfaced as repo instructions.

Test plan

Documentation-only change. Verified the rendered Markdown structure and that all referenced paths and scripts exist in the repo.

Refs: VECTOR-763

@swasik
swasik force-pushed the vector-763-contributing-testing-docs branch 4 times, most recently from 8107680 to b794fd5 Compare July 23, 2026 07:44
@swasik swasik changed the title CONTRIBUTING: document validator harness and docker-compose testing CONTRIBUTING: document testing and commit/PR organization Jul 23, 2026
@swasik
swasik requested a review from Copilot July 23, 2026 07:44

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Documents repository testing workflows, contribution conventions, and agent-facing development guidance.

Changes:

  • Adds validator and Docker Compose testing instructions.
  • Defines commit, PR, and Jira-reference conventions.
  • Adds repository instructions for coding agents.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 7 comments.

File Description
CONTRIBUTING.md Expands testing and change-organization guidance.
CLAUDE.md Adds an agent-facing development quick reference.
Comments suppressed due to low confidence (2)

CONTRIBUTING.md:137

  • The referenced CQL file says to wait after CREATE INDEX, but cqlsh -f ignores that comment and immediately executes the ANN query while index creation may still be in progress. This makes the documented manual test race the asynchronous index build. Either provide an actual readiness wait/poll in the example or instruct users to execute the statements interactively and pause at that point.
cqlsh -f docs/examples/quick-start.cql   # create a vector table + index and run an ANN query

CLAUDE.md:21

  • This runs tests only for the workspace's default member, crates/vector-store (Cargo.toml:6), so agents following the repository instructions will skip tests in the other crates. Add --workspace to make the command match its unit-and-integration-test description.
- Run unit and integration tests: `cargo test --verbose`.

Comment thread CONTRIBUTING.md Outdated
Comment thread CONTRIBUTING.md Outdated
Comment thread CONTRIBUTING.md Outdated
Comment thread CONTRIBUTING.md Outdated
Comment thread CONTRIBUTING.md Outdated
Comment thread CLAUDE.md Outdated
Comment thread CONTRIBUTING.md Outdated
@swasik
swasik force-pushed the vector-763-contributing-testing-docs branch from b794fd5 to 12c5aaf Compare July 23, 2026 08:05

@QuerthDP QuerthDP left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks really good. Please consider my comments

Comment thread CLAUDE.md Outdated
Comment thread CONTRIBUTING.md Outdated
Comment thread CONTRIBUTING.md Outdated
Comment thread CONTRIBUTING.md
@swasik
swasik force-pushed the vector-763-contributing-testing-docs branch from 12c5aaf to aaa089b Compare July 24, 2026 06:39
Comment thread CONTRIBUTING.md Outdated
Comment thread CONTRIBUTING.md Outdated

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated no new comments.

Comments suppressed due to low confidence (1)

CONTRIBUTING.md:168

  • Running the whole quick-start with cqlsh -f does not honor its WAIT FEW SECONDS marker: comments do not pause execution, so the ANN query runs immediately after the asynchronous index creation and can fail while the index is not ready. The validator explicitly polls for IndexStatus::Serving (crates/validator/src/common.rs:477-483), and the repository notes that ANN queries against a not-yet-built index error (latte/vector-search/README.md:45-49). Make this an interactive procedure (or add a real readiness poll) instead of executing the file in one shot.
cqlsh -f docs/examples/quick-start.cql   # create a vector table + index and run an ANN query

The Testing section of CONTRIBUTING.md only covered `cargo test`. Expand
it with two subsections: how to run the end-to-end validator harness
(building the binaries with the release toolchain and running them via
`scripts/run-validator-with-scylla-docker`, including the glibc
compatibility caveat and the test-filter syntax), and how to use the
ready-made docker-compose stacks under `docs/examples/docker/` for manual
functional testing.

Add a Commit and PR Organization section based on the ScyllaDB patch
organization guidelines, and update the pre-review checklist to reference
Jira issues (Fixes/Refs: VECTOR-XYZ) instead of GitHub issues.

Also add a repository-level CLAUDE.md so the contributor guidelines and
Rust conventions are picked up as agent instructions for the repo.

Refs: VECTOR-763
@swasik
swasik force-pushed the vector-763-contributing-testing-docs branch from aaa089b to 41e3e42 Compare July 24, 2026 07:01
@swasik
swasik added this pull request to the merge queue Jul 24, 2026
Comment thread CLAUDE.md
@swasik
swasik removed this pull request from the merge queue due to a manual request Jul 24, 2026
@swasik
swasik added this pull request to the merge queue Jul 24, 2026
Merged via the queue into master with commit baa8cdd Jul 24, 2026
46 checks passed
@swasik
swasik deleted the vector-763-contributing-testing-docs branch July 24, 2026 12:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants