MemSync
Process-to-process object synchronization. Backed by node-ipc
.
- Multiple NodeJS processes can write to and read from the shared object.
- No extra server host process is needed, every process can act as a host, when the host process exits, the host role is taken over by another process.
API
Instantiate the memsync object
import { MemSync } from 'memsync'
let memsync = new MemSync(/* name */ 'my_shared_object', /* defaultObject */ {
foo: 1,
bar: 2,
qux: [ 'one', 'two' ]
});
await memsync.start();
start
discovers other nodes
- When the server already exists, we connect to the server and receive current object. Now our process holds the up-to-date data, receives new patches from the network and sends the changes to the host. When the host exits, we rediscover the network, and will try to act as a server, as we now holding the up-to-date object.
- When the process-to-process network does not exists, we create a server and start accepting new processes to join and will later share the current data with the clients
Make changes
We support partially the mongodb
update operators
await memsync.patch({
$set: {
foo: 2
}
})
We apply the patch immediately the object, and will try to
- if client: send to the host, which will accept the patch to itself, and broadcast the patch to other nodes.
- if server: broadcast the patch to nodes, if any.
Race conditions and conflict resolutions
- When multiple processes modify different parts of the object - there is no conflicts and the patch order has no matter.
- When multiple patches for the same data are made - the host acts as the source of truth - it accepts the patches by timestamp (patch creation date by client), if for any reason a patch is delivered to the host with older timestamp, as already was applied, it will be rejected and the sender (the client) will be notified about current state and current patches.
Stop
You can stop the node anytime
- if it is a client, it just disconnects
- if it is a server, it also stops listening, and one of alive nodes (if any) will act then as a server
memsync.stop()
Observe
Observe the objects properties
memsync.observe('foo', (fooValue) => {
console.log(`FooValue changed`, fooValue);
})
Server
The process may expose a server to query the object and it current state
let memory = new MemSync('foo-bar', { num: 0 }, {
server: { port: 8883 }
});
// Starts memory sync process, and also exposes the 8883 for http queries
await memory.start();
You can query the state of the foo-bar
object from extern
curl http://localhost:8883/foo-bar
//e.g.> `{ num: 1}`