Airbyte
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Airbyte | 11,865 | | 10 | 17 hours ago | 234 | August 03, 2023 | 5,079 | other | Python | |
| Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes. | ||||||||||
| Roadtools | 1,350 |  | 2 | 4 days ago | 18 | August 02, 2023 | 7 | mit | Python | |
| A collection of Azure AD tools for offensive and defensive security purposes | ||||||||||
| Datakit | 1,044 | 2 years ago | 34 | apache-2.0 | OCaml | |||||
| Connect processes into powerful data pipelines with a simple git-like filesystem interface | ||||||||||
| Paddleocr2pytorch | 553 | 6 months ago | 45 | apache-2.0 | Python | |||||
| PaddleOCR inference in PyTorch. Converted from [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR) | ||||||||||
| Versatile Data Kit | 360 | a day ago | 121 | June 24, 2022 | 180 | apache-2.0 | Python | |||
| One framework to develop, deploy and operate data workflows with Python and SQL. | ||||||||||
| Data Engineering With Python | 302 | 8 months ago | 1 | mit | Python | |||||
| Data Engineering with Python, published by Packt | ||||||||||
| Yuniql | 292 |  | 1 | 7 | a year ago | 25 | May 25, 2022 | 65 | apache-2.0 | C# |
| Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released! | ||||||||||
| Logrange | 192 | 7 months ago | 12 | February 05, 2021 | 15 | apache-2.0 | Go | |||
| High performance data aggregating storage | ||||||||||
| Datajoint Python | 157 |  | 12 | 23 | 5 days ago | 65 | September 21, 2022 | 140 | lgpl-2.1 | Python |
| Relational data pipelines for the science lab | ||||||||||
| Marcel | 129 | 24 days ago | 102 | June 07, 2022 | 2 | gpl-3.0 | Python | |||
| A modern shell | ||||||||||
Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes
We believe that only an open-source solution to data movement can cover the long tail of data sources while empowering data engineers to customize existing connectors. Our ultimate vision is to help you move data from any source to any destination. Airbyte already provides the largest catalog of 300+ connectors for APIs, databases, data warehouses, and data lakes.
Screenshot taken from Airbyte Cloud.
Getting Started
- Deploy Airbyte Open Source or set up Airbyte Cloud to start centralizing your data.
- Create connectors in minutes with our no-code Connector Builder or low-code CDK.
- Explore popular use cases in our tutorials.
- Orchestrate Airbyte syncs with Airflow, Prefect, Dagster, Kestra or the Airbyte API.
- Easily transform loaded data with SQL or dbt.
Try it out yourself with our demo app, visit our full documentation and learn more about recent announcements. See our registry for a full list of connectors already available in Airbyte or Airbyte Cloud.
Join the Airbyte Community
The Airbyte community can be found in the Airbyte Community Slack, where you can ask questions and voice ideas. You can also ask for help in our Airbyte Forum, or join our Office Hours. Airbyte's roadmap is publicly viewable on GitHub.
For videos and blogs on data engineering and building your data stack, check out Airbyte's Content Hub, Youtube, and sign up for our newsletter.
Dedicated support with direct access to our team is also available for Open Source users. If you are interested, please fill out this form.
Contributing
If you've found a problem with Airbyte, please open a GitHub issue. To contribute to Airbyte and see our Code of Conduct, please see the contributing guide. We have a list of good first issues that contain bugs that have a relatively limited scope. This is a great place to get started, gain experience, and get familiar with our contribution process.
Security
Airbyte takes security issues very seriously. Please do not file GitHub issues or post on our public forum for security vulnerabilities. Email [email protected] if you believe you have uncovered a vulnerability. In the message, try to provide a description of the issue and ideally a way of reproducing it. The security team will get back to you as soon as possible.
Airbyte Enterprise also offers additional security features (among others) on top of Airbyte Open Source.
License
See the LICENSE file for licensing information, and our FAQ for any questions you may have on that topic.
Thank You
Airbyte would not be possible without the support and assistance of other open-source tools and companies. Visit our thank you page to learn more about how we build Airbyte.
