mirrors/etcd
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,612 Commits 124 Branches 418 Tags
ab65ee3d01c7e9273180cf224c22f85f808e75b4
Commit Graph

94 Commits

Author SHA1 Message Date
Wei Fu
1fcb782780 chore: introduce strict bash mode for scripts,.github 
REF: #15514

Signed-off-by: Wei Fu <fuweid89@gmail.com>
 2023-03-22 18:00:41 +08:00
Marek Siarkowicz
5f68ecc1ef tests: Remove functional testing as they were replaced by linearizability tests 
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
 2023-02-11 13:20:44 +01:00
Benjamin Wang
cc58edecf2 raft: add raft into the tools/mod 
Previously etcdservers depends on raft/raftpb/raft.proto directly.
After moving raft to a separate repo, we need to add raft to the
tools/mod, and get raft included in the -I protc flags.

Signed-off-by: Benjamin Wang <wachao@vmware.com>
 2022-12-02 15:36:41 +08:00
Benjamin Wang
b1cdf16988 scripts: cleanup raft from all script files 
No need to generate proto file;
No need to test coverage for raft;
No need to run any test for raft module;
NO need to run any test for raftexample;

Signed-off-by: Benjamin Wang <wachao@vmware.com>
 2022-12-02 13:58:11 +08:00
spacewander
e73a25a1d0 ci: ensure the generated code is up-to-date 
See https://github.com/etcd-io/etcd/pull/14612#issue-1419792069
Signed-off-by: spacewander <spacewanderlzx@gmail.com>
 2022-10-31 19:58:21 +08:00
Chao Chen
9038e65359 scripts/genproto.sh: fix module path of wal proto files 2021-10-15 22:00:16 -07:00
Marek Siarkowicz
1b4e54c238 api: Annotate proto messages and use it to detect etcd version that generated wal 
Co-authored-by: Lili Cosic <cosiclili@gmail.com>
 2021-08-04 13:36:08 +02:00
Piotr Tabor
b00803a9c1 Merge pull request #13071 from serathius/genproto 
tests: Switch regenerating functional/rpcpb proto to scripts/genproto.sh
 2021-06-04 13:30:02 +02:00
Nate W
9e4dd4dc4e updating scripts/genproto.sh 
Changing API-reference generator

- matching changes mentioned in https://github.com/etcd-io/website/issues/330
- generating page frontmater
- updating .gitignore

Signed-off-by: Nate W <4453979+nate-double-u@users.noreply.github.com>
 2021-06-02 10:29:35 -07:00
Marek Siarkowicz
af5cf1ac1c tests: Switch regenerating functional/rpcpb proto to scripts/genproto.sh 2021-06-02 16:42:35 +02:00
Piotr Tabor
9180e8e56e wal: Update WAL Snapshot format to contain ConfState. 2021-03-25 00:31:44 +01:00
Joel Smith
19f7c6ef3e *: Update gogo/protobuf to v1.3.2, rerun ./scripts/genproto.sh 
While it appears that etcd is not vulnerable to CVE-2021-3121,
it is a good idea to update to the new generator so that new
vulnerable code isn't generated in any future APIs. Also, this
lays the issue to rest of whether there is any issue with
etcd and CVE-2021-3121.
 2021-03-23 11:48:06 -06:00
Sahdev Zala
6bbef10721 Clarify the root directory comment 
A contributor had an issue when ran script changing the directory
name after clone. This was discussed on the etcd slack channel.
 2021-02-01 15:41:36 -05:00
Piotr Tabor
90d1b838ad Fix shellcheck warnings: Escaping. 
```
build:3:65: note: Backslash is literal in "\n". Prefer explicit escaping: "\\n". [SC1117]
test:3:64: note: Backslash is literal in "\n". Prefer explicit escaping: "\\n". [SC1117]
scripts/fix.sh:23:17: note: Backslash is literal in "\n". Prefer explicit escaping: "\\n". [SC1117]
scripts/fix.sh:23:46: note: Backslash is literal in "\n". Prefer explicit escaping: "\\n". [SC1117]
scripts/fix.sh:30:17: note: Backslash is literal in "\n". Prefer explicit escaping: "\\n". [SC1117]
scripts/genproto.sh:38:17: note: Backslash is literal in "\n". Prefer explicit escaping: "\\n". [SC1117]
scripts/genproto.sh:53:17: note: Backslash is literal in "\n". Prefer explicit escaping: "\\n". [SC1117]
scripts/genproto.sh:73:23: note: Backslash is literal in "\(". Prefer explicit escaping: "\\(". [SC1117]
scripts/genproto.sh:73:33: note: Backslash is literal in "\(". Prefer explicit escaping: "\\(". [SC1117]
scripts/genproto.sh:74:69: note: Backslash is literal in "\1". Prefer explicit escaping: "\\1". [SC1117]
scripts/genproto.sh:74:78: note: Backslash is literal in "\2". Prefer explicit escaping: "\\2". [SC1117]
scripts/genproto.sh:75:40: note: Backslash is literal in "\(". Prefer explicit escaping: "\\(". [SC1117]
scripts/genproto.sh:75:52: note: Backslash is literal in "\1". Prefer explicit escaping: "\\1". [SC1117]
scripts/genproto.sh:91:17: note: Backslash is literal in "\n". Prefer explicit escaping: "\\n". [SC1117]
scripts/genproto.sh:115:17: note: Backslash is literal in "\n". Prefer explicit escaping: "\\n". [SC1117]
./test.sh:71:29: warning: Quote to prevent word splitting, or split robustly with mapfile or read -a. [SC2206]
./test.sh:400:28: note: Backslash is literal in "\t". Prefer explicit escaping: "\\t". [SC1117]
./test.sh:406:33: note: Backslash is literal in "\t". Prefer explicit escaping: "\\t". [SC1117]
./test.sh:415:36: note: Backslash is literal in "\*". Prefer explicit escaping: "\\*". [SC1117]
./test.sh:415:176: note: Backslash is literal in "\'". Prefer explicit escaping: "\\'". [SC1117]
./test.sh:493:56: note: Backslash is literal in "\.". Prefer explicit escaping: "\\.". [SC1117]
./test.sh:601:57: note: Backslash is literal in "\(". Prefer explicit escaping: "\\(". [SC1117]
./test.sh:601:64: note: Backslash is literal in "\)". Prefer explicit escaping: "\\)". [SC1117]
./test.sh:601:67: note: Backslash is literal in "\(". Prefer explicit escaping: "\\(". [SC1117]
./test.sh:601:74: note: Backslash is literal in "\)". Prefer explicit escaping: "\\)". [SC1117]
./test.sh:601:77: note: Backslash is literal in "\(". Prefer explicit escaping: "\\(". [SC1117]
./test.sh:601:84: note: Backslash is literal in "\)". Prefer explicit escaping: "\\)". [SC1117]
./test.sh:601:91: note: Backslash is literal in "\1". Prefer explicit escaping: "\\1". [SC1117]
./test.sh:601:94: note: Backslash is literal in "\2". Prefer explicit escaping: "\\2". [SC1117]
./test.sh:601:103: note: Backslash is literal in "\3". Prefer explicit escaping: "\\3". [SC1117]
```
 2021-01-29 22:32:43 +00:00
Piotr Tabor
23340bb62a Refresh proto generation script after moving modules files. 
With modulatiozation server protos get moved into ./server directory,
but it was not reflected in scripts/genproto.sh.
 2021-01-08 16:33:12 +01:00
CFC4N
2e55875cc7 scripts: install github.com/myitcv/gobin while gobin doesn't exist. 2020-10-30 20:58:00 +08:00
Piotr Tabor
0ba16d8ee1 *: Convert tabulators to whitespaces in bash scripts. 
Execution of `./scripts/fix.sh` that executed:
```
find ./ -name '*.sh' | xargs sed --follow-symlinks -i 's|\t|  |g'
```
 2020-10-26 10:59:40 +01:00
Piotr Tabor
da5ca2c0d5 tools: Update of go.mod for protos (gogo/protobuf 1.3.1, grpc 1.29.1, grpc-gateway 1.14.6) 
This brings consistency between proto-generation code and actual versions of libraries being used in runtime:

github.com/gogo/protobuf                        v1.2.1,v1.0.0 -> v1.3.1
github.com/golang/protobuf                             v1.3.2 -> v1.3.5
github.com/grpc-ecosystem/grpc-gateway  v1.9.5,v1.4.1,v1.15.2 -> v1.14.6
google.golang.org/grpc                                v1.26.0 -> v1.29.1

Moved as far as possible, without bumping on grpc 1.30.0 "naming" decomissioning.
Please also notice that gogo/protobuf is likely to reach EOL: https://github.com/gogo/protobuf/issues/691
 2020-10-14 18:46:38 +02:00
Piotr Tabor
dfdda47bd8 script/genproto.sh: Refactor to be explicit about versions. 
Refactoring script/genproto.sh around state-of-the-art techniques of
managing tooling in go:
  - https://github.com/golang/go/wiki/Modules#how-can-i-track-tool-dependencies-for-a-module
  - uses https://github.com/myitcv/gobin instead of customly created gopath.proto dir
  - caches tools between executions
  - guaratees hermetics runs (it was not guaranteed for protoc_grpc_gateway that used latest)

The change is no-op for the generated code.

The commit reveals a few 'worring things':
  1  We depend on : github.com/grpc-ecosystem/grpc-gateway/@v/v1.4.1/protoc-gen-grpc-gateway
  2. And also     : github.com/grpc-ecosystem/grpc-gateway/@v/v1.15.0/protoc-gen-swagger/protoc-gen-swagger
  3. And on extremely old: github.com/gogo/protobuf@v1.0.0 protoc-gen-gofast that is out of sync with the library linked to binaries: github.com/gogo/protobuf@v1.2.1
 2020-10-08 19:52:27 +02:00
Piotr Tabor
28f2b07623 *: Update references to code moved to the api/ dir. 
Follow up to file-moves done in the previous commit.

The commit contains purely mechanical consequences of execution (apart
of scripts/genproto.sh):

  % find ./ -name '*.go'  | xargs sed --follow-symlinks -i 's|v3/etcdserver/api/v3rpc/rpctypes|v3/api/v3rpc/rpctypes|g'
  % find ./ -name '*.go'  | xargs sed --follow-symlinks -i 's|v3/version|v3/api/version|g'
  % find ./ -name '*.go'  | xargs sed --follow-symlinks -i 's|v3/mvcc/mvccpb|v3/api/mvccpb|g'
  % find ./ -name '*.go'  | xargs sed --follow-symlinks -i 's|v3/etcdserver/etcdserverpb|v3/api/etcdserverpb|g'
  % find ./ -name '*.go'  | xargs sed --follow-symlinks -i 's|v3/etcdserver/api/membership/membershippb|v3/api/membershippb|g'
  % find ./ -name '*.go'  | xargs sed --follow-symlinks -i 's|v3/auth/authpb|v3/api/authpb|g'

  % find ./ -name '*.proto' -o -name '*.md'  | xargs -L 1 sed --follow-symlinks -i 's|/mvcc/mvccpb/kv.proto|/api/mvccpb/kv.proto|g'
  % find ./ -name '*.proto' -o -name '*.md'  | xargs -L 1 sed --follow-symlinks -i 's|/auth/authpb/auth.proto|/api/authpb/auth.proto|g'
  % find ./ -name '*.proto' -o -name '*.md'  | xargs -L 1 sed --follow-symlinks -i 's|/etcdserver/api/membership/membershippb/membership.proto|/api/membershippb/membership.proto|g'

  I also modified manually paths in scripts/genproto.sh.

  % go fmt ./...
 2020-10-06 11:56:16 +02:00
Gyuho Lee
d93c36bbb9 *: run "gofmt -s" on genproto complete 
Signed-off-by: Gyuho Lee <leegyuho@amazon.com>
 2020-05-09 23:14:32 -07:00
Brandon Philips
2ea4d88299 *: use go.etcd.io/etcd/v3 where needed 
Found potential locations via

```
git grep 'go.etcd.io/etcd$'
```
 2020-04-28 00:57:52 +00:00
Jingyi Hu
dcd622b2c7 etcdserver: add v3 request type for cluster attr 
Added ClusterVersionSetRequest for setting cluster version via v3 apply.

Added ClusterMemberAttrSetRequest for setting clsuter member attributes
via v3 apply.
 2019-12-05 16:25:13 -08:00
Tobias Schottdorf
14625b847c scripts: have genproto.sh clean up after itself 
We don't want it to leave gopath.proto around for reasons detailed in
the previous commit (messing up vgo).
 2019-07-16 14:01:04 +02:00
Gyuho Lee
c8ffa36d9e scripts/genproto: bump up protoc 3.7.1 
Signed-off-by: Gyuho Lee <leegyuho@amazon.com>
 2019-05-28 15:39:35 -07:00
Sam Batschelet
a011b2c4c4 scripts: disable go mod and bump protoc to 3.6.1 
Signed-off-by: Sam Batschelet <sbatsche@redhat.com>
 2019-01-22 16:55:01 +00:00
Gyuho Lee
a8a3efd27a scripts: update import paths in "go.etcd.io/etcd" 
Signed-off-by: Gyuho Lee <leegyuho@amazon.com>
 2018-08-28 17:47:55 -07:00
Gyuho Lee
453db62d84 scripts/genproto: use protoc 3.6.0 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-07-10 10:16:37 -07:00
Sam Batschelet
fe15c3250e scripts/genproto: use latest "grpc-ecosystem/grpc-gateway" 2018-05-23 08:36:58 -04:00
Sam Batschelet
05554119c9 vendor: use latest "grpc-ecosystem/grpc-gateway" 2018-05-22 17:35:15 -04:00
Gyuho Lee
d29a0c7172 scripts/genproto: use latest "gogo/protobuf" 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-05-22 13:42:43 -07:00
Gyuho Lee
2d542d336a scripts/genproto.sh: rename 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-05-21 07:45:34 -07:00
Gyuho Lee
906a40bced scripts/genproto: fix shellcheck 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-03-22 10:39:31 -07:00
Gyuho Lee
b24d81c30d scripts: remove "internal" 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-02-26 17:11:40 -08:00
Gyuho Lee
dac6948774 scripts/genproto: run "protodoc" by default 
Do not skip "protodoc" by default.

Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-02-13 13:51:13 -08:00
Gyuho Lee
264f8f6577 *: regenerate proto 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-01-28 23:43:15 -08:00
Gyuho Lee
2c91007591 *: regenerate proto 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-01-26 11:21:40 -08:00
Gyuho Lee
2b6fd3094f *: rename "snap" to "raftsnap" package 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-01-24 10:26:07 -08:00
Gyuho Lee
fd16656af1 scripts/genproto: use "grpc-gateway" v1.3.1 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2018-01-09 12:41:49 -08:00
Gyuho Lee
7800fd9fff scripts/genproto: require protoc 3.5.1 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2017-12-31 13:20:40 -08:00
Gyuho Lee
b1c6b98f3d scripts/genproto: require protoc 3.5, update gogo/proto 
Signed-off-by: Gyuho Lee <gyuhox@gmail.com>
 2017-12-07 21:31:13 -08:00
Gyu-Ho Lee
ec881b0507 scripts/genproto: upgrade protoc to 3.4 
Signed-off-by: Gyu-Ho Lee <gyuhox@gmail.com>
 2017-11-08 18:50:29 -08:00
tamal
c0c19465fc *: upgrade grpc-gateway to v1.3 2017-11-08 18:38:41 -08:00
Anthony Romano
9abe9da9db *: fix shellcheck warnings 
Fixes scripts and removes shellcheck warning suppressions.

* regexp warnings
* use ./*glob* so names don't become options
* use $(..) instead of legacy `..`
* read with -r to avoid mangling backslashes
* double quote to prevent globbing and word splitting
 2017-09-06 19:18:04 -07:00
Sam Batschelet
e5aa938fec scripts: generate swagger with authorization support 2017-06-15 13:41:43 -04:00
Anthony Romano
4ebeba0e18 *: regen protofiles with latest protobuf tools 2017-06-12 15:14:43 -07:00
Anthony Romano
85f433232a *: clear rarer shellcheck errors on scripts 
Clean up the tail of the warnings
 2017-06-06 09:36:25 -07:00
Anthony Romano
1be245269e scripts, Documentation: fix swagger generation 
Changes to the genproto to support splitting out the grpc-gateway broke
swagger generation.
 2017-06-02 10:54:05 -07:00
Anthony Romano
156612bb25 Documentation, scripts: regen RPC docs 
Was missing the new cancel_reason field. Also includes updated protodoc
sha to fix generating documentation for upcoming txn compare range patchset.
 2017-06-02 10:15:12 -07:00
Anthony Romano
10b1ba7886 Documentation, scripts: regenerate protobuf docs with updated protodoc 2017-05-19 14:57:16 -07:00