Show HN: S2-lite, an open source Stream Store

Summary

S2, the durable streams API s2.dev is a serverless datastore for real-time, streaming data. s2-lite is an open source, self-hostable server implementation of the S2 API. It uses SlateDB as its storage engine, which relies entirely on object storage for durability. It is easy to run s2-lite against object stores like AWS S3 and Tigris. It is a single-node binary with no other external dependencies. Just like s2.dev, data is always durable on object storage before being acknowledged or returned to readers. You can also simply not specify a --bucket , which makes it operate entirely in-memory. This is great for integration tests involving S2. Quickstart Note Point the S2 CLI or SDKs at your lite instance like this: export S2_ACCOUNT_ENDPOINT= " http://localhost:8080 " export S2_BASIN_ENDPOINT= " http://localhost:8080 " export S2_ACCESS_TOKEN= " redundant " Here's how you can run in-memory without any external dependency: docker run -p 8080:80 ghcr.io/s2-streamstore/s2-lite AWS S3 bucket example docker run -p 8080:80 \ -e AWS_PROFILE= ${AWS_PROFILE} \ -v ~ /.aws:/root/.aws:ro \ ghcr.io/s2-streamstore/s2-lite \ --bucket ${S3_BUCKET} \ --path s2lite Static credentials example (Tigris, R2 etc) docker run -p 8080:80 \ -e AWS_ACCESS_KEY_ID= ${AWS_ACCESS_KEY_ID} \ -e AWS_SECRET_ACCESS_KEY= ${AWS_SECRET_ACCESS_KEY} \ -e AWS_ENDPOINT_URL_S3= ${AWS_ENDPOINT_URL_S3} \ ghcr.io/s2-streamstore/s2-lite \ --bucket ${S3_BUCKET} \ --path s2lite Let's make sure the server is ready: while ! curl -sf ${S2_ACCOUNT_ENDPOINT} /ping -o /dev/null ; do echo Waiting... ; sleep 2 ; done && echo Up ! Install the CLI or upgrade it if s2 --version is older than 0.25 Let's create a basin with auto-creation of streams enabled: s2 create-basin liteness --create-stream-on-append --create-stream-on-read Test your performance: s2 bench liteness --target-mibps 10 --duration 5s --catchup-delay 0s Now let's try streaming sessions. In one or more new terminals (make sure you re-export the env vars noted above)...