Skip to content

curve-llamalend: Gemini Pro voice (3.1-pro, 5 slices)#122

Open
hell0men wants to merge 3 commits into
guil-lambert:mainfrom
hell0men:add-llamalend-gemini
Open

curve-llamalend: Gemini Pro voice (3.1-pro, 5 slices)#122
hell0men wants to merge 3 commits into
guil-lambert:mainfrom
hell0men:add-llamalend-gemini

Conversation

@hell0men
Copy link
Copy Markdown

Adds Gemini Pro Thinking model evaluation for curve-llamalend across all five DeFi punk slices, with verified on-chain context attached to every prompt (OneWayLendingFactory, Sub-DAO admin = DAO Agent + Emergency multisig, current market set, Aragon Voting thresholds, Vyper стек).

Files: per-slice JSON под data/submissions/curve-llamalend//gemini-...json (control, ability-to-exit, autonomy, open-access, verifiability).

@vercel
Copy link
Copy Markdown

vercel Bot commented Apr 30, 2026

Someone is attempting to deploy a commit to the guillambert's projects Team on Vercel.

A member of the Team first needs to authorize it.

@github-actions
Copy link
Copy Markdown

DEFI@home validator — issues found

data/submissions/curve-llamalend/ability-to-exit/gemini-3.1-pro-2026-04-29.json

warnings:

  • snapshot_generated_at: snapshot pin does not match current snapshot (2026-04-27T08:19:52.420Z); downweighted by quorum

data/submissions/curve-llamalend/autonomy/gemini-3.1-pro-2026-04-29.json

warnings:

  • snapshot_generated_at: snapshot pin does not match current snapshot (2026-04-27T08:19:52.420Z); downweighted by quorum

data/submissions/curve-llamalend/control/gemini-3.1-pro-2026-04-29.json

errors:

  • evidence.0.shows: Required
  • evidence.1.shows: Required
  • evidence.2.shows: Required
  • evidence.3.shows: Required

data/submissions/curve-llamalend/open-access/gemini-3.1-pro-2026-04-29.json

warnings:

  • snapshot_generated_at: snapshot pin does not match current snapshot (2026-04-27T08:19:52.420Z); downweighted by quorum

data/submissions/curve-llamalend/verifiability/gemini-3.1-pro-2026-04-29.json

warnings:

  • snapshot_generated_at: snapshot pin does not match current snapshot (2026-04-27T08:19:52.420Z); downweighted by quorum

@github-actions
Copy link
Copy Markdown

DEFI@home validator — all submissions valid

data/submissions/curve-llamalend/ability-to-exit/gemini-3.1-pro-2026-04-29.json

clean

data/submissions/curve-llamalend/autonomy/gemini-3.1-pro-2026-04-29.json

clean

data/submissions/curve-llamalend/control/gemini-3.1-pro-2026-04-29.json

clean

data/submissions/curve-llamalend/open-access/gemini-3.1-pro-2026-04-29.json

clean

data/submissions/curve-llamalend/verifiability/gemini-3.1-pro-2026-04-29.json

clean

@guil-lambert
Copy link
Copy Markdown
Owner

guil-lambert commented Apr 30, 2026

The chat url returns gemini-3-flash as the model:

"chat_url": "https://gemini.google.com/share/a83024e46b8a",
image

…ni Pro re-runs by @AlexandrPeshkov

Manual re-runs by @AlexandrPeshkov on Gemini Pro (gemini.google.com/app, footer
label "Pro", 2026-05-03) for the three slices that were criticised on canonical-
methodology grounds (clean Pro, no augmented Thinking context).

Share URLs (verified opening in incognito; footer "Создано с помощью Pro"):
- ability-to-exit: https://gemini.google.com/share/7dd8e1fff28f
- autonomy:        https://gemini.google.com/share/fab6551dc5cc
- open-access:     https://gemini.google.com/share/88da4064e364

All three returned grade=unknown (Gemini Pro had no live web-fetch in those
sessions and could not read the on-chain ground truth - Alex was aware before
re-running). Filenames bumped to 2026-05-03; old 04-29 files removed so quorum
does not double-count gemini-3.1-pro per slice.

control + verifiability are unchanged carry-over from the 04-29 batch.

Editorial fixes vs raw model output:
- prompt_version normalised to 12 (model self-tagged 24, but the canonical
  prompt sent by Alex pins prompt_version=12; v24 does not exist in this repo).
- chat_url filled with the public share URLs above (model returned null per
  Hard Rule 11).
- autonomy: Gemini omitted the boilerplate header fields (schema_version, slug,
  slice, snapshot_generated_at, prompt_version, analysis_date, model). They
  were re-applied from the prompt's pinned inputs - these are submission
  identifiers, not model output.
- open-access: protocol_metadata.upgradeability null -> "unknown" so the strict
  zod enum validates (semantics identical: not-determined).

Validator: all three submissions PASS pnpm --filter @defipunkd/validator validate.
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 3, 2026

DEFI@home validator — all submissions valid

data/submissions/curve-llamalend/ability-to-exit/gemini-3.1-pro-2026-05-03.json

clean

data/submissions/curve-llamalend/autonomy/gemini-3.1-pro-2026-05-03.json

clean

data/submissions/curve-llamalend/control/gemini-3.1-pro-2026-04-29.json

clean

data/submissions/curve-llamalend/open-access/gemini-3.1-pro-2026-05-03.json

clean

data/submissions/curve-llamalend/verifiability/gemini-3.1-pro-2026-04-29.json

clean

@hell0men
Copy link
Copy Markdown
Author

hell0men commented May 4, 2026

@guil-lambert it was updated to gemini pro with url, please check again

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants