Skip to content

chore: use the lean-llvm LLVM for benchmarking#13634

Open
hargoniX wants to merge 18 commits intomasterfrom
hbv/consistent-llvm
Open

chore: use the lean-llvm LLVM for benchmarking#13634
hargoniX wants to merge 18 commits intomasterfrom
hbv/consistent-llvm

Conversation

@hargoniX
Copy link
Copy Markdown
Contributor

@hargoniX hargoniX commented May 4, 2026

No description provided.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 4, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 4, 2026

Benchmark results for 9bf40f4 against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 4, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 4, 2026

Benchmark results for 8a60f7c against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 4, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 4, 2026

Benchmark results for 7aebbba against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 4, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 4, 2026

Benchmark results for ea89da1 against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 4, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 4, 2026

Benchmark results for e649808 against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 4, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 4, 2026

Benchmark results for 96b2bbd against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 4, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 4, 2026

Benchmark results for 7552dff against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 4, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 4, 2026

Benchmark results for 9823bb1 against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 4, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 4, 2026

Benchmark results for a0227f5 against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@github-actions github-actions Bot added the toolchain-available A toolchain is available for this PR, at leanprover/lean4-pr-releases:pr-release-NNNN label May 4, 2026
@mathlib-lean-pr-testing
Copy link
Copy Markdown

mathlib-lean-pr-testing Bot commented May 4, 2026

Mathlib CI status (docs):

  • ❗ Batteries/Mathlib CI will not be attempted unless your PR branches off the nightly-with-mathlib branch. Try git rebase 9e5c86eac9ef4c50ca487106942f61298549aec5 --onto dae325700c89e23c453b1d6d5ed5432d87880062. You can force Mathlib CI using the force-mathlib-ci label. (2026-05-04 20:25:53)
  • ❗ Batteries/Mathlib CI will not be attempted unless your PR branches off the nightly-with-mathlib branch. Try git rebase 94a29d19520cecdf3a2ad10c9cdfed4b07e92ec5 --onto dae325700c89e23c453b1d6d5ed5432d87880062. You can force Mathlib CI using the force-mathlib-ci label. (2026-05-05 13:02:16)

@leanprover-bot
Copy link
Copy Markdown
Collaborator

leanprover-bot commented May 4, 2026

Reference manual CI status:

  • ❗ Reference manual CI will not be attempted unless your PR branches off the nightly-with-manual branch. Try git rebase 9e5c86eac9ef4c50ca487106942f61298549aec5 --onto 3fc99eef102549c743c6c63547983319bfae6f01. You can force reference manual CI using the force-manual-ci label. (2026-05-04 20:25:55)
  • ❗ Reference manual CI will not be attempted unless your PR branches off the nightly-with-manual branch. Try git rebase 94a29d19520cecdf3a2ad10c9cdfed4b07e92ec5 --onto 3fc99eef102549c743c6c63547983319bfae6f01. You can force reference manual CI using the force-manual-ci label. (2026-05-05 13:02:18)

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 5, 2026

Benchmark results for ee208d4 against 9e5c86e are in. No significant results found. @hargoniX

  • build//instructions: -516.9M (-0.00%)

Small changes (2🟥)

  • 🟥 elab/grind_list2//task-clock: +1s (+15.93%)
  • 🟥 elab/grind_list2//wall-clock: +120ms (+9.56%)

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 5, 2026

Benchmark results for be620ea against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 5, 2026

Benchmark results for 9ebcf3f against 9e5c86e are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

Benchmark results for 9ebcf3f against 9e5c86e are in. (These commits have already been benchmarked in a previous command.) There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@hargoniX hargoniX force-pushed the hbv/consistent-llvm branch from 9ebcf3f to ef761cd Compare May 5, 2026 11:54
@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 5, 2026

Benchmark results for ef761cd against 94a29d1 are in. There are significant results. @hargoniX

  • 🟥 build exited with code 143
  • 🟥 other exited with code 143

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 5, 2026

Benchmark results for 2233800 against 94a29d1 are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 5, 2026

Benchmark results for 11e5677 against 94a29d1 are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 5, 2026

Benchmark results for c2da7b2 against 94a29d1 are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

leanprover-radar commented May 5, 2026

Benchmark results for 5f3abf0 against 94a29d1 are in. There are significant results. @hargoniX

  • 🟥 build exited with code 1
  • 🟥 other exited with code 1

No significant changes detected.

@hargoniX
Copy link
Copy Markdown
Contributor Author

hargoniX commented May 5, 2026

!bench

@leanprover-radar
Copy link
Copy Markdown

Benchmarking 84acdcf against 94a29d1 (preliminary results).

React with 👀 to be notified when the results are in. The command author is always notified.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

toolchain-available A toolchain is available for this PR, at leanprover/lean4-pr-releases:pr-release-NNNN

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants