I have a binary file on a Linux server that is being actively appended by a process (written in C with a constantly open file handler and flushing non-ASCII buffer to this file). I would like to replicate this file to another server without locking the write (C process), preferably, and not copying the entire file every time (file size ~1+GB and replication frequency < 1 sec).
I've explored the following: rsync: I believe rsync does a full replication, but not incremental.
filebeat by elasticsearch: it requires ASCII text and newlines (I have neither).
I would preferably like to leverage standard Linux tools, but I am open to any other 3rd party solution or creating a C program myself :).