Skip to content

tests: add Hugging Face corpus audit lane#23

Merged
gaelic-ghost merged 1 commit into
mainfrom
tests/huggingface-corpus-audit-lane
May 31, 2026
Merged

tests: add Hugging Face corpus audit lane#23
gaelic-ghost merged 1 commit into
mainfrom
tests/huggingface-corpus-audit-lane

Conversation

@gaelic-ghost

Copy link
Copy Markdown
Owner

Summary

  • add a SwiftPM executable that downloads bounded Hugging Face Dataset Viewer slices and audits FetchKit ranking/snippet behavior in memory
  • add an opt-in repo-maintenance wrapper for the live corpus lane
  • document tuning knobs, Dataset Viewer boundaries, and roadmap progress without making default CI network-dependent

Verification

  • swift build
  • swift test
  • scripts/repo-maintenance/validate-all.sh
  • scripts/repo-maintenance/run-huggingface-corpus-audit.sh

@coderabbitai

coderabbitai Bot commented May 31, 2026

Copy link
Copy Markdown

Warning

Review limit reached

@gaelic-ghost, we couldn't start this review because you've reached your PR review rate limit.

More reviews will be available in 33 minutes and 45 seconds. Learn how PR review limits work.

Your organization has run out of usage credits. Purchase more in the billing tab.

⌛ How to resolve this issue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans include higher PR review limits than trial, open-source, and free plans. In all cases, reviews become available again over time. During sustained high-volume PR review activity, CodeRabbit may temporarily slow when the next review becomes available.

Please see our Fair Usage Limits Policy for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: ce834c2c-bbad-40cc-9cd5-b6dc8dc360ff

📥 Commits

Reviewing files that changed from the base of the PR and between 7142d81 and 38cfe69.

📒 Files selected for processing (5)
  • Package.swift
  • ROADMAP.md
  • Sources/SwiftlyFetchCorpusAudit/main.swift
  • docs/maintainers/fixture-corpus.md
  • scripts/repo-maintenance/run-huggingface-corpus-audit.sh
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch tests/huggingface-corpus-audit-lane

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@gaelic-ghost gaelic-ghost merged commit 00867d7 into main May 31, 2026
2 checks passed
@gaelic-ghost gaelic-ghost deleted the tests/huggingface-corpus-audit-lane branch May 31, 2026 16:37

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 38cfe695bb

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

throw AuditError.invalidURL("Could not build a Dataset Viewer URL for \(dataset).")
}

var request = URLRequest(url: url, timeoutInterval: requestTimeout)

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Restore Linux build for the new audit target

On non-Darwin Swift toolchains this new executable is still compiled by the default swift build, but URLRequest and URLSession.shared are provided by FoundationNetworking, not Foundation; I verified a minimal SwiftPM target with these same imports fails to type-check on Linux with cannot find 'URLRequest' in scope. Add a conditional import FoundationNetworking for Linux so the opt-in audit lane does not break the repository’s standard build/validation command outside macOS.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant