Export Fluent Bit metrics to Amazon Managed Prometheus

[sriharsha-ZS]

Describe the question/issue

Question: I want to forward the metrics captured by Fluent Bit to Amazon Managed Prometheus using Output Prometheus Plugin. How to configure the OUTPUT on configmap with Amazon Managed Prometheus Configuration.

[hossain-rayhan]

Hi @sriharsha-ZS , can you please provide some details here. Which input plugin you are planning to use? From the documentation-The Prometheus remote write plugin only works with metrics collected by one of the from metric input plugins.

I want to make sure we are not talking about Fluent Bit monitoring metrcs which we can get from /api/v1/metrics/prometheus endpoint.

Also, I am not sure if we need any modification to the prometheus remote write exporter to send data to Amazon Managed Prometheus (AMP). I will double check and confirm.

[sriharsha-ZS]

Hi, Mainly looking at using Fluent Bit with Prometheus Plugin to export Node metrics to Amazon Managed Prometheus. We have Prometheus Remote Write Exporter but is it gonna work with AMP ? If yes, Please provide the sample of output section to config same on our environment

[hossain-rayhan]

Talked to our Amazon Managed Prometheus (AMP) team to see if they have tested this. This prometheus remote write support is pretty new and none of us has used it. I will look for details and update here.

[hossain-rayhan]

We need to modify the prometheus remote write exporter to sign the API requests with SigV4 before sending to AWS. As I said, this output plugin is pretty new and we will take some time to adapt and enhance it. But this is definitely on our focus list.

[hasancc]

Hi all,

Any updates on this?

Best,