Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Sparkdantic | 17 | 5 months ago | 2 | Python | ||||||
✨ A Pydantic to PySpark schema library | ||||||||||
Marshmallow Pyspark | 12 | 6 months ago | 5 | November 11, 2022 | apache-2.0 | Python | ||||
Marshmallow serializer integration with pyspark | ||||||||||
Birgitta | 12 | a year ago | 34 | September 10, 2020 | 20 | mit | Python | |||
Birgitta is a Python ETL test and schema framework, providing automated tests for pyspark notebooks/recipes. | ||||||||||
Sparkql | 10 | 9 months ago | 20 | September 18, 2023 | 22 | mit | Python | |||
sparkql: Apache Spark SQL DataFrame schema management for sensible humans | ||||||||||
Microdrill | 7 | 8 years ago | 3 | March 01, 2016 | 1 | apache-2.0 | Python | |||
Simple Apache Drill alternative using PySpark |