open-consul/proto
Dan Upton 1d95609fb7
grpc: protoc plugin for generating gRPC rate limit specifications (#15564)
Adds automation for generating the map of `gRPC Method Name → Rate Limit Type`
used by the middleware introduced in #15550, and will ensure we don't forget
to add new endpoints.

Engineers must annotate their RPCs in the proto file like so:

```
rpc Foo(FooRequest) returns (FooResponse) {
  option (consul.internal.ratelimit.spec) = {
    operation_type: READ,
  };
}
```

When they run `make proto` a protoc plugin `protoc-gen-consul-rate-limit` will
be installed that writes rate-limit specs as a JSON array to a file called
`.ratelimit.tmp` (one per protobuf package/directory).

After running Buf, `make proto` will execute a post-process script that will
ingest all of the `.ratelimit.tmp` files and generate a Go file containing the
mappings in the `agent/grpc-middleware` package. In the enterprise repository,
it will write an additional file with the enterprise-only endpoints.

If an engineer forgets to add the annotation to a new RPC, the plugin will
return an error like so:

```
RPC Foo is missing rate-limit specification, fix it with:

	import "proto-public/annotations/ratelimit/ratelimit.proto";

	service Bar {
	  rpc Foo(...) returns (...) {
	    option (hashicorp.consul.internal.ratelimit.spec) = {
	      operation_type: OPERATION_READ | OPERATION_WRITE | OPERATION_EXEMPT,
	    };
	  }
	}
```

In the future, this annotation can be extended to support rate-limit
category (e.g. KV vs Catalog) and to determine the retry policy.
2023-01-04 16:07:02 +00:00
..
pbacl Update hcp-scada-provider to fix diamond dependency problem with go-msgpack (#15185) 2022-11-07 11:34:30 -05:00
pbautoconf Update hcp-scada-provider to fix diamond dependency problem with go-msgpack (#15185) 2022-11-07 11:34:30 -05:00
pbcommon Update hcp-scada-provider to fix diamond dependency problem with go-msgpack (#15185) 2022-11-07 11:34:30 -05:00
pbconfig Update hcp-scada-provider to fix diamond dependency problem with go-msgpack (#15185) 2022-11-07 11:34:30 -05:00
pbconfigentry add extensions for local service to GetExtensionConfigurations (#15871) 2022-12-22 10:03:33 -08:00
pbconnect Update hcp-scada-provider to fix diamond dependency problem with go-msgpack (#15185) 2022-11-07 11:34:30 -05:00
pboperator grpc: protoc plugin for generating gRPC rate limit specifications (#15564) 2023-01-04 16:07:02 +00:00
pbpeering grpc: protoc plugin for generating gRPC rate limit specifications (#15564) 2023-01-04 16:07:02 +00:00
pbpeerstream grpc: protoc plugin for generating gRPC rate limit specifications (#15564) 2023-01-04 16:07:02 +00:00
pbservice [OSS] feat: access logs for listeners and listener filters (#15864) 2022-12-22 15:18:15 -05:00
pbstatus Update hcp-scada-provider to fix diamond dependency problem with go-msgpack (#15185) 2022-11-07 11:34:30 -05:00
pbsubscribe grpc: protoc plugin for generating gRPC rate limit specifications (#15564) 2023-01-04 16:07:02 +00:00
prototest Fix early return in prototest.AssertElementsMatch (#14467) 2022-09-02 11:57:28 -04:00
buf.gen.yaml grpc: protoc plugin for generating gRPC rate limit specifications (#15564) 2023-01-04 16:07:02 +00:00
buf.yaml Migrate from protoc to buf (#12841) 2022-05-23 10:37:52 -04:00