Persistent PostgreSQL storage for a y-websocket server. You can use this adapter to easily store and retrieve Yjs documents in/from PostgreSQL.
You need Node version 16 or newer.
It is available at npm.
There are full working server examples in the example-servers
directory.
import 'dotenv/config'; import http from 'http'; import { WebSocketServer } from 'ws'; import * as Y from 'yjs'; import { setPersistence, setupWSConnection } from './websocket/utils.js'; import { IWSSharedDoc } from './websocket/interfaces.js'; import { PostgresqlPersistence } from 'y-postgresql'; const server = http.createServer((request, response) => { response.writeHead(200, { 'Content-Type': 'text/plain' }); response.end('okay'); }); // y-websocket const wss = new WebSocketServer({ server }); wss.on('connection', yUtils.setupWSConnection); /* * y-postgresql * with all available options. Check API below for more infos. */ const pgdb = await PostgresqlPersistence.build( { host: process.env.PG_HOST, port: parseInt(process.env.PG_PORT, 10), database: process.env.PG_DATABASE, user: process.env.PG_USER, password: process.env.PG_PASSWORD, }, { tableName: 'yjs-writings', useIndex: false, flushSize: 200 }, ); /* Persistence must have the following signature: { bindState: function(string,WSSharedDoc):void, writeState:function(string,WSSharedDoc):Promise } */ yUtils.setPersistence({ bindState: async (docName, ydoc) => { // Here you listen to granular document updates and store them in the database // You don't have to do this, but it ensures that you don't lose content when the server crashes // See https://github.com/yjs/yjs#Document-Updates for documentation on how to encode // document updates // official default code from: https://github.com/yjs/y-websocket/blob/37887badc1f00326855a29fc6b9197745866c3aa/bin/utils.js#L36 const persistedYdoc = await pgdb.getYDoc(docName); const newUpdates = Y.encodeStateAsUpdate(ydoc); pgdb.storeUpdate(docName, newUpdates); Y.applyUpdate(ydoc, Y.encodeStateAsUpdate(persistedYdoc)); ydoc.on('update', async (update: Uint8Array) => { pgdb.storeUpdate(docName, update); }); }, writeState: async (docName, ydoc) => { // This is called when all connections to the document are closed. // In the future, this method might also be called in intervals or after a certain number of updates. return new Promise((resolve) => { // When the returned Promise resolves, the document will be destroyed. // So make sure that the document really has been written to the database. resolve(); }); }, }); server.listen(process.env.PORT, () => { console.log(`listening on port:${process.env.PORT}`); });
persistence = await PostgresqlPersistence.build(connectionOptions: pg.PoolConfig, persistenceOptions: object)
Create a y-postgresql persistence instance.
import { PostgresqlPersistence } from 'y-postgresql'; const pgdb = await PostgresqlPersistence.build(connectionOptions, { tableName: 'yjs-writings', useIndex: false, flushSize: 200, });
Options:
"yjs-writings"
200
false
persistence.getYDoc(docName: string): Promise<Y.Doc>
Create a Y.Doc instance with the data persistet in PostgreSQL. Use this to temporarily create a Yjs document to sync changes or extract data.
persistence.storeUpdate(docName: string, update: Uint8Array): Promise<number>
Store a single document update to the database. It returns the id of the stored update.
persistence.getStateVector(docName: string): Promise<Uint8Array>
The state vector (describing the state of the persisted document - see Yjs docs) is maintained in a separate field and constantly updated.
This allows you to sync changes without actually creating a Yjs document.
Performance Note: The state vector in the database is frequently outdated, leading to its recreation within this function. This process requires the creation of the Yjs document, which often makes it no more efficient than simply loading the entire document.
persistence.getDiff(docName: string, stateVector: Uint8Array): Promise<Uint8Array>
Get the differences directly from the database. The same as Y.encodeStateAsUpdate(ydoc, stateVector)
.
Note on performance: This function first loads the full document behind "docName".
persistence.clearDocument(docName: string): Promise
Delete a document, and all associated data from the database.
persistence.destroy(): Promise
Close the database connection for a clean exit.
We welcome contributions! Please follow these steps to contribute:
npm install
.npm test
.To run the test suite, you first need to copy the EXAMPLE_TEST.env
, rename it to .env
and fill in the connection options for the PostgreSQL database. Then run the following command:
y-postgresql is licensed under the MIT License.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4