Update build scripts + migration to use Buf#737

Closed

WhitWaldo wants to merge 39 commits intomainfrom

update-build-scripts

Contributor

WhitWaldo commented Mar 10, 2026 •

edited

Loading

Description

The protos generation has been flaky in recent releases, so this PR migrates the entire project to use Buf. This was a greater lift than expected given that it uses a different signature/approach to creating instances from the generated types and then all the tests had to be updated, but now the whole solution builds and tests as expected on my machine.

Further, this also updates the entire build pipeline to use a cross-platform compatible approach.

Issue reference

We strive to have all PR being opened based on an issue, where the problem or feature have been discussed prior to implementation.

Please reference the issue this PR will close: #[issue number]

Checklist

Please make sure you've completed the relevant tasks for this PR, out of the following list:

Code compiles correctly
Created/updated tests
Extended the documentation

WhitWaldo added 28 commits

September 25, 2025 18:14


          Added rimraf to project as dev dependency

971472f

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Added some packages as well as the updated fetch-proto.js script for …

52fb461

…retrieving the protos

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updating build scripts to make them cross-platform compatible (e.g. u…

9580ad4

…sing node runtime instead of bash)

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updated to use buf to generate the protos and .d.ts/.js files

1517e03

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed errors in file due to use of buf

983d4f0

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Correcting the updated proto changes

2fc06d6

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Modernized health.ts to accommodate changes by buf

b2ad66b

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updating to accommodate buf changes

f4f0be6

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updated to support @buf

21d2ed4

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed errors through utility type

533059b

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed and added helper methods for type conversion

c9ef37a

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Added script to generate version.ts file as a pre-build step so the v…

36fc1c1

…alue can be used in the JS output without having to hard code and remember it - it automatically pulls from the value in package.json

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed secret to accommodate buf changes

48c0066

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed lingering errors in state

31969b8

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed lingering buf issues in sidecar

0b24aa9

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Making function generic

7e98be8

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Allowing implicit any for error responses

4a16da3


          Fixed lingering buf issues

3ece42d

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed buf issues

a250a11

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixing bad never type matching

62f95c6

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updated script to write version.ts out to the right place

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Tweak to fix license address in generated header

f2b9722

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Removed unnecessary bash script - replaced by JS equivalent

96a142e

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed crypto and utility to use buf signature

0ddd175

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed build errors

ebb969d

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updating build script to support cross-OS builds and to use Buf to ge…

0f62ce2

…nerate prototype types

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          WIP updating the solution to use Buf for protos generation

1f76727

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Finished work to migrate to use buf for protos type generation + upda…

8c3a4b6

…ted all tests to pass

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>

WhitWaldo self-assigned this

WhitWaldo requested a review from a team as a code owner

March 10, 2026 13:08

WhitWaldo requested a review from a team as a code owner

March 10, 2026 13:08

WhitWaldo added the dependencies label

WhitWaldo added 11 commits

March 10, 2026 09:29


          Added test mocks

759749b

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updated protos

9bf6caa

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Added npm install step

aa33c54

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Fixed install command

26bfda3

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updated packages in package-lock.json

6a2a222

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Removed outdated comment in build step

7e01b04

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updating Dapr versions to 1.17, adding missing npm install step to …

adcf7d3

…e2e script

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Added cross-env support to e2e tests

97c5f7a

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updated to use the new connect-style approach per Buf

7da248d

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Additional tweaks to e2e tests to accommodate Buf

fbf11f0

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>


          Updated tests

c571363

Signed-off-by: Whit Waldo <whit.waldo@innovian.net>

nelson-parente added a commit to nelson-parente/js-sdk that referenced this pull request


          feat: update protos to Dapr v1.17.0-rc.1 and add Buf scaffolding

d9d8882

Update fetch-proto.sh to download proto definitions from Dapr v1.17.0-rc.1
(previously pinned to v1.16.0-rc.3). This adds all new building block
message type protos that were split out of dapr.proto in v1.17:

- runtime/v1/actors.proto
- runtime/v1/ai.proto (Conversation Alpha2)
- runtime/v1/binding.proto
- runtime/v1/configuration.proto
- runtime/v1/crypto.proto
- runtime/v1/invoke.proto
- runtime/v1/jobs.proto (Jobs/Scheduler Alpha1)
- runtime/v1/lock.proto
- runtime/v1/metadata.proto
- runtime/v1/pubsub.proto (streaming subscriptions)
- runtime/v1/secret.proto
- runtime/v1/state.proto
- runtime/v1/workflow.proto (Beta1/Stable)

Also adds:
- google/protobuf/struct.proto and duration.proto (new dependencies)
- Pin Google WKT downloads to protobuf v28.3 (was floating master)
- buf.yaml and buf.gen.yaml scaffolding for future Buf migration
- Correct compilation order (message types before service definitions)

The generated proto stubs are NOT regenerated in this commit — run
`./scripts/fetch-proto.sh` locally to regenerate after merging.

Relates to: dapr#737, dapr#667, dapr#664, dapr#668

Signed-off-by: Nelson Parente <nelson_parente@live.com.pt>

nelson-parente mentioned this pull request

feat: update protos to Dapr v1.17.0-rc.1 and add Buf scaffolding #740

Closed

4 tasks

WhitWaldo mentioned this pull request

Support building on windows + migration to Buf for prototype type generation #745

Open

3 tasks

Contributor Author

WhitWaldo commented Apr 10, 2026

Superseded by #745

WhitWaldo closed this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels