Endpoint events missing

[tigattack]

Describe the bug

Sometimes I see events missing from an endpoint. It doesn't appear to be consistent, and I haven't been able to figure out how to reliably reproduce it.

I think it's typically the most recent event that I notice missing, but I can't confidently say whether this is consistent.

Endpoint config:

  - ui:
      hide-url: true
      hide-hostname: true
    alerts:
      - type: discord
    name: will
    group: labbers
    url: https://<URL>/api/endpoint
    conditions:
      - '[BODY].labUp == yes'

What do you see?

Note how the endpoint is currently healthy, but the last event is "Endpoint is unhealthy".

What do you expect to see?

All endpoint events (healthy, unhealthy) in the list.

List the steps that must be taken to reproduce this issue

No response

Version

v5.16.0

Additional information

No response

[balaaagi]

Am seeing the health correct but events are missing. It suddenly started happening for me too. Version using is 5.11.0

[olehrakovych]

Same behaviour. We are using version 5.16

[TomDeSchutter]

Same behaviour: version 5.17 on postgresql

[TwiN]

I was able to replicate this recently, but it also seems sporadic 🤔

[tigattack]

Let me know if there's anything I can do to help (extra logs, config changes, etc.)

[DenisMkS]

I see the same with the v5.23.2

[dennisoderwald]

Same issue in 5.24.1 & 5.24.2

[TwiN]

I tried to look into this last week, but I wasn't able to find the issue for the life of me. If somebody wants to give investigating this a go, please feel free.

P.S. What storage type are you folks using? memory, sqlite or postgres?

[TwiN]

I think I'm an idiot 🤦