Skip to content

⚡ Bolt: Pre-compile regex for performance#152

Closed
abhimehro wants to merge 1 commit intomainfrom
bolt-regex-optimization-7067273405053221020
Closed

⚡ Bolt: Pre-compile regex for performance#152
abhimehro wants to merge 1 commit intomainfrom
bolt-regex-optimization-7067273405053221020

Conversation

@abhimehro
Copy link
Owner

💡 What:
Pre-compiled the regex patterns used for validating rules and profile IDs into module-level constants.

🎯 Why:
The application iterates over potentially hundreds of thousands of rules from blocklists. Calling re.match() repeatedly inside these hot loops involves an internal cache lookup and function call overhead that adds up. By pre-compiling the regex (re.compile), we bypass this overhead.

📊 Impact:
Benchmarks show the pre-compiled regex match is approximately 2x faster than calling re.match repeatedly. For a blocklist with 100,000 rules, this saves measurable CPU time during the filtering phase.

🔬 Measurement:

  • Verified using a micro-benchmark script comparing re.match vs compiled_pattern.match over 1M iterations.
  • Verified correctness using the existing test_main.py suite (all tests passed).

PR created automatically by Jules for task 7067273405053221020 started by @abhimehro

- Added `RULE_PATTERN` and `PROFILE_ID_PATTERN` pre-compiled regex constants in `main.py`.
- Updated `is_valid_rule` and `is_valid_profile_id_format` to use these constants.
- Reduces CPU overhead when validating large lists of rules (e.g., 100k+ items).
- Measured ~2x speedup in raw regex matching benchmarks.
- Verified with existing tests.

Co-authored-by: abhimehro <84992105+abhimehro@users.noreply.github.com>
Copilot AI review requested due to automatic review settings February 1, 2026 15:00
@google-labs-jules
Copy link

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

@trunk-io
Copy link

trunk-io bot commented Feb 1, 2026

Merging to main in this repository is managed by Trunk.

  • To merge this pull request, check the box to the left or comment /trunk merge below.

@github-actions github-actions bot added the python label Feb 1, 2026
@gemini-code-assist
Copy link

Summary of Changes

Hello @abhimehro, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request introduces a crucial performance enhancement by pre-compiling regular expressions used for validating rule and profile IDs. By moving the compilation of these patterns to module-level constants, the system avoids redundant compilation overhead during frequent validation checks, leading to a measurable speedup in data-intensive operations.

Highlights

  • Performance Optimization: Pre-compiled regular expression patterns (RULE_PATTERN and PROFILE_ID_PATTERN) into module-level constants in main.py.
  • Impact on Hot Loops: This change significantly improves performance (benchmarked at ~2x faster) for validation functions called repeatedly in hot loops, especially when processing large datasets like blocklists with hundreds of thousands of rules.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a valuable performance optimization by pre-compiling frequently used regular expressions. The change is well-motivated and correctly implemented, replacing re.match() calls with the compiled pattern's match() method in performance-sensitive validation functions. This will certainly reduce CPU overhead when processing large numbers of rules.

I have one suggestion in main.py to further improve performance by removing a redundant validation check that currently exists in the validate_profile_id function. Overall, this is a great enhancement.

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Pre-compiles the regex patterns used in rule and profile ID validation to reduce overhead in hot loops.

Changes:

  • Added module-level compiled regex constants for rule and profile ID validation.
  • Updated validation functions to use compiled_pattern.match(...) instead of re.match(...).
  • Documented the optimization in Bolt’s journal.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
main.py Introduces RULE_PATTERN / PROFILE_ID_PATTERN and uses them in validation paths to avoid repeated re.match calls.
.jules/bolt.md Adds an entry documenting the “pre-compile regex in hot loops” learning/action.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot AI added a commit that referenced this pull request Feb 8, 2026
…itization, add dry-run plan details

Incorporates the best changes from 36 Jules PRs, addressing review feedback:

Bolt (Performance) - from PR #173:
- Pre-compile PROFILE_ID_PATTERN and RULE_PATTERN at module level
- Use compiled patterns in is_valid_profile_id_format, validate_profile_id, and is_valid_rule
- Supersedes PRs: #140, #143, #152, #155, #158, #161, #167, #170, #173

Sentinel (Security) - from PR #172 with review feedback:
- Enhance sanitize_for_log to redact Basic Auth credentials in URLs
- Redact sensitive query parameters (token, key, secret, password, etc.)
- Handle fragment separators (#) per Gemini Code Assist review
- Use [^&#\s]* pattern per Copilot reviewer suggestion
- Update docstring per reviewer suggestion
- Supersedes PRs: #142, #145, #148, #151, #154, #157, #160, #169, #172

Palette (UX) - from PR #174 with lint fixes:
- Add print_plan_details function for dry-run visibility
- Fix duplicate render_progress_bar definition bug
- Supersedes PRs: #139, #141, #144, #147, #150, #153, #156, #159, #162, #165, #168, #171, #174

Also: #146, #149, #164 (parallel folder deletion) and #166 (auto-fix .env perms) are independent features not consolidated here.

Co-authored-by: abhimehro <84992105+abhimehro@users.noreply.github.com>
@abhimehro abhimehro closed this Feb 9, 2026
@abhimehro abhimehro deleted the bolt-regex-optimization-7067273405053221020 branch February 9, 2026 00:16
abhimehro added a commit that referenced this pull request Feb 9, 2026
…itization, add dry-run plan details

Incorporates the best changes from 36 Jules PRs, addressing review feedback:

Bolt (Performance) - from PR #173:
- Pre-compile PROFILE_ID_PATTERN and RULE_PATTERN at module level
- Use compiled patterns in is_valid_profile_id_format, validate_profile_id, and is_valid_rule
- Supersedes PRs: #140, #143, #152, #155, #158, #161, #167, #170, #173

Sentinel (Security) - from PR #172 with review feedback:
- Enhance sanitize_for_log to redact Basic Auth credentials in URLs
- Redact sensitive query parameters (token, key, secret, password, etc.)
- Handle fragment separators (#) per Gemini Code Assist review
- Use [^&#\s]* pattern per Copilot reviewer suggestion
- Update docstring per reviewer suggestion
- Supersedes PRs: #142, #145, #148, #151, #154, #157, #160, #169, #172

Palette (UX) - from PR #174 with lint fixes:
- Add print_plan_details function for dry-run visibility
- Fix duplicate render_progress_bar definition bug
- Supersedes PRs: #139, #141, #144, #147, #150, #153, #156, #159, #162, #165, #168, #171, #174

Also: #146, #149, #164 (parallel folder deletion) and #166 (auto-fix .env perms) are independent features not consolidated here.

Co-authored-by: abhimehro <84992105+abhimehro@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants