Awesome Open Source
Awesome Open Source
databend

What is Databend?

Databend is an open-source Elastic and Workload-Aware modern cloud data warehouse.

Databend uses the latest techniques in vectorized query processing to allow you to do blazing-fast data analytics on object storage(S3, Azure Blob or MinIO).

  • Instant Elasticity

    Databend completely separates storage from compute, which allows you easily scale up or scale down based on your application's needs.

  • Blazing Performance

    Databend leverages data-level parallelism(Vectorized Query Execution) and instruction-level parallelism(SIMD) technology, offering blazing performance data analytics.

  • Git-like Storage

    Databend stores data with snapshots. It's easy to query, clone, and restore historical data in tables.

  • Support for Semi-Structured Data

    Databend supports ingestion of semi-structured data in various formats like CSV, JSON, and Parquet, which are located in the cloud or your local file system; Databend also supports semi-structured data types: ARRAY, MAP, JSON, which is easy to import and operate on semi-structured.

  • MySQL/ClickHouse Compatible

    Databend is ANSI SQL compliant and MySQL/ClickHouse wire protocol compatible, making it easy to connect with existing tools(MySQL Client, ClickHouse Client, Vector, DBeaver, Jupyter, JDBC, etc.).

  • Easy to Use

    Databend has no indexes to build, no manual tuning required, no manual figuring out partitions or shard data, its all done for you as data is loaded into the table.

Architecture

Databend Architecture

Try Databend

Install Databend

Prepare the image (once) from Docker Hub (this will download about 170 MB data):

docker pull datafuselabs/databend

To run Databend quickly:

docker run --net=host  datafuselabs/databend

Connect to Databend

MySQL wire protocol on port 3307

mysql -h127.0.0.1 -uroot -P3307

Let's run some benchmark queries.

Getting Started

Deployment

Connect

Users

Tables

Views

User-Defined Functions

Load Data

Use Case

Performance

Contributing

Databend is an open source project, you can help with ideas, code, or documentation, we appreciate any efforts that help us to make the project better! Once the code been merged, your name will be stored in the system.contributors table forever.

To get started with contributing:

Community

For general help in using Databend, please refer to the official documentation. For additional help, you can use one of these channels to ask a question:

  • Slack (For live discussion with the Community)
  • Github (Feature/Bug reports, Contributions)
  • Twitter (Get the news fast)
  • Weekly (A weekly newsletter about Databend)
  • I'm feeling lucky (Pick up a good first issue now!)

Roadmap

License

Databend is licensed under Apache 2.0.

Acknowledgement

Related Awesome Lists
Top Programming Languages
Top Projects

Get A Weekly Email With Trending Projects For These Topics
No Spam. Unsubscribe easily at any time.
Database (92,945
Rust (57,337
Sql (21,995
Serverless (9,825
Object Storage (367
Olap (334
Query Processing (4