Make Inbound http queue capacity configurable per service

[himanshu-garg-zepto]

What problem are you trying to solve?

Currently, the default Inbound http queue capacity is 10_000 and it is only configurable through environment variable LINKERD2_PROXY_INBOUND_HTTP_QUEUE_CAPACITY. We want to tune it at a service level because the default is not good enough for some services.

Can we allow for that..?

How should the problem be solved?

maybe using annotations..?

Any alternatives you've considered?

the default is what we're using right now but it's not good enough for some services.
in envoy, we've successfully used max_requests config

How would users interact with this feature?

No response

Would you like to work on this feature?

yes

[zep-sayantan]

In addition to that, we would also like to know if the DEFAULT_INBOUND_HTTP_FAILFAST_TIMEOUT can be tuned as per requirements. We want to tune those parameters. We also want to know the rational behind those values not exposed , what was the fundamental issue observed earlier