.*: Introduce graceful shutdown for gRPC Servers

[kakkoyun]

This PR,

• introduces a grace period for components which use gRPC to wait (5s by default) for connections to drain before the shutdown.
• adds a new --grpc-grace-period CLI option to specify the period.

Signed-off-by: Kemal Akkoyun kakkoyun@gmail.com

• I added CHANGELOG entry for this change.
• Change is not relevant to the end user.

Changes

• Add a new --grpc-grace-period CLI option to components which serve gRPC to set how long to wait until gRPC Server shuts down.
• Components which use gRPC Server now wait (5s by default) for connections to drain before the shutdown.

Verification

• make test-local
• MINIO_ENABLED=1 ./scripts/quickstart.sh

[kakkoyun]

This should be rebased and include the fixes that will be introduced after #1689 merged.

[kakkoyun]

cc @bwplotka @squat @brancz

I have tried to be extra careful, in order to prevent issues such as #1689, I'd be glad if you can double-check the work.

[brancz]

lgtm, but good to have another pair of eyes on this I think cc @squat @bwplotka

[kakkoyun]

This PR might have conflicting changes with #1672

[brancz]

My personal opinion, this PR is larger and would be harder to rebase than #1672, so I'd prefer to merge this first.

[squat]

Great work, @kakkoyun :))) I have some nits but nothing major

[bwplotka]

Nice, it looks good, but have some minor comments (:

[bwplotka]

Let's go with this! Good work, thanks 👍

Let's rebase and merge.

[kakkoyun]

@bwplotka Is CI failure a Netlify issue? Is it something related to these changes?