PeerDB logo

PeerDBFast, native ETL for Postgres 🐘 πŸš€

At PeerDB, we are building a fast, simple and the most cost effective way to stream data from Postgres to Data Warehouses, Queues and Storage engines. If you are running Postgres at the heart of your data-stack and move data at scale from Postgres to any of the above targets, PeerDB can provide value. We support different modes of streaming - log based (CDC), cursor based (timestamp or integer) and XMIN based. Performance wise, we are 10x faster than existing tools. Features wise, we support native Postgres features such as comprehensive set of data-types incl. jsonb/arrays/postgis, efficiently streaming toast columns, schema changes and so on.

2023-06-14
Active
Early
S23
2
B2B
RemotePartly Remote
PeerDB screenshot
More About PeerDB

PeerDB: Fast, Simple, Cost-effective Postgres Replication

Introduction

PeerDB offers a fast, simple, and cost-effective solution for replicating Postgres data to data warehouses and queues. With native support for Postgres and optimized performance, PeerDB ensures seamless data transfer and real-time change data capture (CDC).

Key Features

  • Schema Changes: Utilizes Postgres replication messages to replay schema changes.
  • Alerts: Provides alerts for slot-growth and connections.
  • Toast Column Support: Native support for Postgres toast columns and large JSONB columns.
  • Warehouse Cost Control: Optimized query design to reduce warehouse costs.
  • Partitioned Tables: Supports partitioned tables via both publish.
  • Low Latency: Achieves low latency replication starting at 10 seconds.
  • Parallel Initial Load: Blazing fast and consistent initial load by transaction snapshotting and CTID scans.

Use Cases

  • Real-time CDC: Postgres to BigQuery, Snowflake, and other data warehouses.
  • Streaming Query: Efficient data streaming from Postgres to Snowflake, BigQuery, S3, and more.
  • Data Migration: Seamless migration of large datasets from Postgres to other platforms.
  • IoT Data Handling: Supports large JSONB columns for IoT applications.

Pricing

Cloud Plans

  • Hobby: Up to 2 vcores, $250/mo. Suitable for up to 10 million rows moved per month.
  • Small: Up to 4 vcores, $1000/mo. Suitable for 10 to 100 million rows moved per month.
  • Medium: Up to 8 vcores, $2000/mo. Suitable for 100 to 500 million rows moved per month.
  • Large: Up to 16 vcores, $4000/mo. Suitable for 500 million+ rows moved per month.

Open Source

  • Free: Ideal for individuals. Supports change data capture from Postgres to Snowflake, BigQuery, ClickHouse, Queues, and Postgres.

Teams

PeerDB is backed by Combinator and trusted by companies worldwide. Our team is dedicated to providing high-availability, in-place upgrades, autoscaling, advanced logs, metrics, monitoring dashboards, and 24x7 production support with SLAs. We offer white-glove implementation support with a dedicated Slack channel to ensure seamless integration and operation.

PeerDB is designed to enhance your workflow with multiple connectors, making it easy to get data in and out of Postgres efficiently.