Awesome Open Source

Programming Languages

Search results for python databricks

68 search results found

Redash ⭐ 24,479

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Dolly ⭐ 10,354

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

Sqlglot ⭐ 4,652

Python SQL Parser and Transpiler

Delta Rs ⭐ 1,634

A native Rust library for Delta Lake, with bindings into Python

Optscale ⭐ 854

MLOps and FinOps platform to run ML/AI experiments and regular cloud workloads with optimal performance and cost.

🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.

Databricks Sdk Py ⭐ 263

Databricks SDK for Python (Beta)

Dbldatagen ⭐ 234

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

Testing framework for Databricks notebooks

Cicd Templates ⭐ 166

Manage your Databricks deployments and CI with code.

Dbt Databricks ⭐ 165

A dbt adapter for Databricks.

Lakehouse Engine ⭐ 154

The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.

Databricks Sql Python ⭐ 105

Databricks SQL Connector for Python

Apachespark ⭐ 59

This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.

Dstoolkit Mlops Databricks ⭐ 58

ML Ops Accelerator: Databricks & Azure Machine Learning Unification

Databricks Api ⭐ 57

A simplified, autogenerated API client interface using the databricks-cli package

Mlflow Tracking Server ⭐ 51

MLFLow Tracking Server based on Docker and AWS S3

Blackbricks ⭐ 44

Black for Databricks notebooks

Azure Databricks Mlops Mlflow ⭐ 44

Azure Databricks MLOps sample for Python based source code using MLflow without using MLflow Project.

Prefect Databricks ⭐ 43

Prefect integrations for interacting with Databricks.

Architect_big_data_solutions_with_spark ⭐ 42

code, labs and lectures for the course

Azure Databricks ⭐ 37

Azure Databricks - Advent of 2020 Blogposts

PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows

Johnsnowlabs ⭐ 35

Gateway into the John Snow Labs Ecosystem

Dash Dbx Sql ⭐ 28

Simple Dash app demonstrating connection to Databricks via the Python SQL connector

Ml Azuredatabricks ⭐ 24

Collection of Machine Learning Examples for Azure Databricks

Splunk Integration ⭐ 23

Databricks Add-on for Splunk

Databricks Notebooks ⭐ 22

Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )

Sqlalchemy Databricks ⭐ 21

SQLAlchemy dialect for Databricks

Databricks Dbapi ⭐ 19

DBAPI and SQLAlchemy dialect for Databricks Workspace and SQL Analytics clusters

Databricks Streamlit Demo ⭐ 15

Demo of Streamlit application with Databricks SQL Endpoint

Azure Databricks Sdk Python ⭐ 13

[archived] A Python SDK for the Azure Databricks REST API 2.0

Db Rocket ⭐ 13

Keep your local python scripts installed and in sync with a databricks notebook. Shortens the feedback loop to develop projects using a hybrid environment.

Storeitemdemand ⭐ 13

(117th place - Top 26%) Deep learning using Keras and Spark for the "Store Item Demand Forecasting" Kaggle competition.

Astro Provider Databricks ⭐ 12

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows

Mobile_trends_using_spark_and_dash ⭐ 11

Asynchronous, classic OOP on the Spark engine with a light front-end

Batcomputer ⭐ 10

A working example of DevOps & operationalisation applied to Machine Learning and AI

Pyspark Dataframe Made Easy ⭐ 10

pyspark dataframe made easy

Apache Airflow Providers Transfers ⭐ 10

Databricks Kubernetes Online Inference Poc ⭐ 10

End-to-end proof of concept showing core MLOps practices to develop, deploy and monitor a machine learning model for online inference scenarios using Databricks and Kubernetes on Microsoft Azure.

Freeza Offset ⭐ 9

Spark stream consumption commit in kafka consumer group

Metadata Comparison Toolkit. As of now, V-1.0.0 only consists Comparison of two DDL file ( .sql ) or two DDL statement.

Learn Databricks ⭐ 9

Notebooks to learn Databricks Lakehouse Platform

Artificial Data Generator ⭐ 9

Pipelines for generating large volumes of anonymous artificial data that share some of the characteristics of real NHS data

Ondemandmlflowtrainandserve ⭐ 9

A solution for on-demand training and serving of Machine Learning models, using Azure Databricks and MLflow

Rules_databricks ⭐ 8

This repository contains rules for interacting with Databricks.

Portfolio_powerbi_sql ⭐ 8

Projetos de estudo em Power BI e Databricks (utilizando linguagens Python, SQL, DAX e M) | Study projects in Power BI and Databricks.

Spotify_etl ⭐ 8

Using an ETL pipeline to investigate the change in hip-hop/rap genre over time

Dlt With Debug ⭐ 8

A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT run and Non-DLT interactive notebook run.

Atc Dataplatform ⭐ 8

A common set of python libraries for DataBricks

Great Assertions ⭐ 7

This library is inspired by the Great Expectations library. The library has made the various expectations found in Great Expectations available when using the inbuilt python unittest assertions.

Run Databricks queries from your terminal or editor

Databricks Cdk ⭐ 7

Deployment of databricks resources with cdk

Au Azure Databricks ⭐ 7

NHSX AU-Data Engineering - Azure Databricks Analytics

Databrickstraining ⭐ 6

Repository for Microsoft Databricks Training Events - Hosted by BlueGranite

Databricks Admin Center

Formacao Engenheiro De Dados Cloud E Big Data Azure Databricks ⭐ 6

Formação Engenheiro de Dados Cloud e Big Data (Azure & DataBricks)

Azure Databricks Api ⭐ 6

A wrapper for the Azure Databricks REST API

Spark Databricks ⭐ 6

🔥 Master Apache Spark & Databricks! Dive into a world of big data with exclusive insights from Udemy courses, personal notes, and practical guides. Whether you're starting out or scaling new heights in data engineering, this is your ultimate resource hub! 🌟🚀

Clarifai Pyspark ⭐ 6

Interfaces for Unstructured data and ML pipelines with Databricks and Clarifai

Pyspark Connectors ⭐ 6

Spark For Dummies ⭐ 5

Mastering Spark 2 from the very beginning

Microsoft Big Data Scientist And Ai ⭐ 5

Microsoft Big Data, Data Scientist, and AI

Blueprint Dataverse To Delta Accelerator ⭐ 5

Databricks notebook that integrates data from Microsoft Dataverse to Databricks Delta table, including the schema inference

Waterbear ⭐ 5

Automated provisioning of an industry Lakehouse with enterprise data model

Terraform Dlt Public ⭐ 5

Deploying Delta Live Tables Pipelines on AWS with Terraform

Az Databricks Realtime Alert System ⭐ 5

Building a real-time alert monitoring pipeline that sends email notifications off of Azure Event Hubs, Azure Databricks, and a Azure Logic App

Data_engineer_end2end ⭐ 5

End-to-end data engineer project

Related Searches

Python Machine Learning (20,195)

Python Deep Learning (17,860)

Python Docker (14,113)

Python Jupyter Notebook (12,976)

Python Natural Language Processing (9,064)

Python Amazon Web Services (8,079)

Python Server (7,793)

Python Testing (7,358)

Python Keras (6,821)

Python Pandas (6,193)

1-68 of 68 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.