Skip to content

A real-time pipeline to stream AT Protocol (Bluesky) firehose events into Elasticsearch for search and analytics.

License

Notifications You must be signed in to change notification settings

walterra/atproto2elasticsearch

Repository files navigation

WORK IN PROGRESS

atproto2elasticsearch

atproto2elasticsearch connects to the Bluesky (AT Protocol) firehose, processes events, and indexes them into an Elasticsearch cluster. This allows you to perform powerful search and analytics on real-time Bluesky data.

run via npx

ES_NODE=https://<username>:<password>@localhost:9200 npx atproto2elasticsearch

setup

  • Create a .env file and add your Elasticsearch endpoint, e.g. ES_NODE=https://<username>:<password>@localhost:9200.
  • Run yarn, yarn build and yarn start.

feedback

Create an issue in the repo or contact me on Bluesky: https://bsky.app/profile/walterra.dev

development

Clone this repository and install its dependencies:

git clone https://github.com/walterra/atproto2elasticsearch
cd atproto2elasticsearch
yarn

yarn build builds the library to dist.

To commit, use cz. To prepare a release, use e.g. yarn release -- --release-as 1.0.0-alpha1.

About

A real-time pipeline to stream AT Protocol (Bluesky) firehose events into Elasticsearch for search and analytics.

Resources

License

Stars

Watchers

Forks

Packages

No packages published