Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Airbyte | 12,918 | 11 | 3 months ago | 311 | December 08, 2023 | 5,111 | other | Python | ||
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted. | ||||||||||
Yuniql | 292 | 1 | 7 | 2 years ago | 25 | May 25, 2022 | 65 | apache-2.0 | C# | |
Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released! | ||||||||||
Datajoint Python | 158 | 12 | 26 | 5 months ago | 66 | September 21, 2022 | 143 | lgpl-2.1 | Python | |
Relational data pipelines for the science lab | ||||||||||
Pythoncrawler Scrapy Mysql File Template | 153 | 7 years ago | 2 | mit | Python | |||||
scrapy爬虫框架模板,将数据保存到Mysql数据库或者文件中。 | ||||||||||
Dolphinbeat | 153 | 5 years ago | apache-2.0 | Go | ||||||
A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka. | ||||||||||
Spider Roach | 72 | 7 years ago | 1 | Python | ||||||
分布式定向抓取集群 | ||||||||||
Ensembl Hive | 50 | 4 months ago | 3 | apache-2.0 | Perl | |||||
EnsEMBL Hive - a system for creating and running pipelines on a distributed compute resource | ||||||||||
Mydataharbor | 50 | a year ago | 6 | February 03, 2023 | gpl-3.0 | Java | ||||
:cn: MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步,主要定位是为实时交易系统服务,亦可用于大数据的数据同步(ETL领域)。 | ||||||||||
Pyodbc | 29 | 4 months ago | mit | Python | ||||||
Docker Image with python 3.11 and pyodbc with drivers for MySQL, PostgreSQL and MSSQL | ||||||||||
Bitbucket Pipelines Debian 8 | 19 | 5 years ago | mit | Dockerfile | ||||||
Bitbucket Pipelines Docker image based on Debian 8 (Jessie) with PHP/MySQL (and more !) |