Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for python avro
avro
x
python
x
56 search results found
Avro
⭐
2,691
Apache Avro is a data serialization system.
Dataprofiler
⭐
1,310
What's in your data? Extract schema, statistics and entities from datasets
Adam
⭐
966
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Devops Python Tools
⭐
709
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
Fastavro
⭐
602
Fast Avro for Python
Avro Rpc Quickstart
⭐
403
Apache Avro RPC Quick Start.
Hdfs
⭐
257
API and command line interface for HDFS
Dataclasses Avroschema
⭐
189
Generate avro schemas from python classes. Code generation from avro schemas. Serialize/Deserialize python instances with avro schemas
Python Schema Registry Client
⭐
159
Python Rest Client to interact against Schema Registry confluent server
Bigdata Playground
⭐
154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Clickhouse Sink Connector
⭐
140
Replicate data from MySQL, Postgres and MongoDB to ClickHouse
Aptos
⭐
140
☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats
Pandavro
⭐
127
Apache Avro <-> pandas DataFrame
Python Avro Json Serializer
⭐
118
Serializes data into a JSON format using AVRO schema.
Elastic Git
⭐
103
Store data in Git, find it in Elasticsearch.
Djangoevents
⭐
64
Faust Docker Compose Example
⭐
62
Faust dockerized application
Python Kafka Avro
⭐
62
A simple examle for Python Kafka Avro
Pyavroc
⭐
46
An Avro file reader/writer for Python
Collecting Data
⭐
31
This is a HOWTO for collecting data in Ruby and Python applications and sending it to S3 via Kafka.
Kafkian
⭐
29
An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka
Kafka Compose
⭐
28
🎼 Docker compose files for various kafka stacks
Data_pipeline_avro_util
⭐
26
Provides a Pythonic interface for reading and writing Avro schemas
Py Avro Schema
⭐
24
Generate Apache Avro schemas for Python types including standard library data-classes and Pydantic data models.
Market Data Transcoder
⭐
24
ffmpeg for market data
Avro To Python
⭐
24
Light tool for compiling avro schema files (.avsc) to python classes
Avro_validator
⭐
24
A pure python avro schema validator
Spavro
⭐
23
Spavro is a (sp)eedier avro library -- Spavro is a fork of the official Apache AVRO python 2 implementation with the goal of greatly improving data read deserialization and write serialization performance.
Aws Glue Schema Registry Python
⭐
19
Use the AWS Glue Schema Registry in Python projects.
Schema Uml
⭐
19
Visualize (.avdl and .proto format) schema files as a UML diagram using Graphviz
Confluent Avro Py
⭐
18
An Avro SerDe implementation that integrates with the confluent schema registry and serializes and deserializes data according to the defined confluent wire format
Avro_gen
⭐
16
Avro record class and reader generator
Aptos
⭐
16
☀️ Avro, Protobuf, Thrift on Swagger
Pykafarr
⭐
15
A high-performance Python Kafka client. Efficiently from Kafka to Pandas and back.
Gelreportmodels
⭐
14
Kafka_store
⭐
14
Consistent archives of Kafka topics to an object store.
Pg2avro
⭐
12
Utility generating avro files from postgres
Kafka Aggregator
⭐
12
A Kafka aggregator based on the Faust Python Stream Processing library
Avrocat
⭐
12
CLI tool for consuming and producing Avro messages on Kafka.
Cmsspark
⭐
12
General purpose framework to run CMS experiment workflows on HDFS/Spark platform
Pyavrophonetic
⭐
11
Python implementation of Avro Phonetic
Alert_packet
⭐
10
Alert schemas in Avro format.
Data Rivers
⭐
9
Apache Airflow and Beam ETL scripts for the City of Pittsburgh's data analysis pipelines
Rec Avro
⭐
8
Avro schema and data converters supporting storing arbitrary nested python data structures.
Pbcommand
⭐
8
PacBio common models, CLI tool contract interface and SMRT Link Service Interface
Scrapy Contrib Bigexporters
⭐
7
Scrapy exporter for Big Data formats
Banglish Sentiment Analysis
⭐
7
Sentiment analysis for phonetic Bengali sentences.
Async Python Schema Registry Client
⭐
7
Async Python Rest Client to interact against Schema Registry confluent server
Robotframework Pykafka
⭐
7
Robot framework library for producing and consuming messages on Kafka 1.0+
Avro Data Model
⭐
7
A Python ORM for Avro Schemas
Faust Avro Serializer
⭐
7
An improved version of https://github.com/marcosschroh/python-schema-regi
Ztf Alert Server
⭐
6
Alert repository for ZTF alerts
Quickavro
⭐
6
a fast Python Avro library
Sphotik
⭐
6
An Avro-like phonetic Bangla keyboard for Linux using IBus input method.
Kafka Desktop Consumer
⭐
5
A simple desktop client for Kafka.
Kafka Serialization
⭐
5
Experiments and demonstrations of AVRO, Protobuf serialisation
Related Searches
Python Django (28,897)
Python Machine Learning (20,195)
Python Flask (17,643)
Python Dataset (14,792)
Python Docker (14,113)
Python Tensorflow (13,736)
Python Command Line (13,351)
Python Deep Learning (13,092)
Python Jupyter Notebook (12,976)
Python Network (11,495)
1-56 of 56 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.