I am talking about a library that would allow me to register events from different machines and align these events on the "global" time axis with fairly high accuracy.
Actually, I ask, because I wrote this myself during the cluster computing project, I found it extremely useful, and I was surprised that I could not find analogues.
Therefore, the bottom line is whether something like this exists (and I better contribute to it), or nothing exists (and it is better to write an open-source analogue of my solution).
Here are the functions that I expect from such a library:
- Independence of clock offset between different machines
- Synchronization accuracy of the order of at least milliseconds, preferably microseconds
- Scalability to thousands of parallel logging processes with at least a few megabytes of aggregated logs per second
- Real-time operation (ti) I don’t want to collect 200 large logs from 200 cars, and then calculate the clock offsets and combine them. I want to see what happens “live”, perhaps with a slight lag of 10 seconds)
source
share