Vector validate should also validate disk buffer integrity

[fpytloun]

A note for the community

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Use Cases

When disk buffer is corrupted, Vector fails to start but vector validate pass fine. Validation should also test buffer integrity so that this issue can be determined (and fixed eg. by removing disk buffer) before vector attempt to start.

Attempted Solutions

No response

Proposal

Make vector validate load all configured disk buffers.

References

• Uptick in dropped events from disk buffer InvalidProtobufPayload errors #18130

Version

No response

[jszwedko]

I like this idea 👍