Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Snowplow | 6,468 | 3 days ago | 42 | December 03, 2019 | 57 | apache-2.0 | Scala | |||
The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP | ||||||||||
Scio | 2,451 | 1 | 34 | 3 days ago | 82 | March 30, 2020 | 147 | apache-2.0 | Scala | |
A Scala API for Apache Beam and Google Cloud Dataflow. | ||||||||||
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference | 159 | 3 years ago | 4 | apache-2.0 | Jupyter Notebook | |||||
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required | ||||||||||
Selfservicekiosk Audio Streaming | 117 | 3 months ago | 62 | apache-2.0 | JavaScript | |||||
A best practice for streaming audio from a browser microphone to Dialogflow or Google Cloud STT by using websockets. | ||||||||||
Streamx | 95 | 4 years ago | 26 | apache-2.0 | Java | |||||
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3) | ||||||||||
Pixelstreamingcloudguide | 69 | a month ago | cc-by-4.0 | |||||||
A guide to Pixel Streaming in the cloud (AWS, Azure, GCP, Linux, Windows). | ||||||||||
Vue Speech Streaming | 64 | 7 months ago | 2 | mit | JavaScript | |||||
A Vue2 Streaming Speech Recognition Speech to text with Google Cloud Speech | ||||||||||
Weddell | 22 | 2 years ago | 5 | mit | Elixir | |||||
A Google Pub/Sub library for Elixir | ||||||||||
Kio | 12 | 2 | 5 months ago | 1 | July 20, 2020 | 1 | apache-2.0 | Kotlin | ||
Kotlin extensions for Apache Beam | ||||||||||
Streaming Data Workshop | 10 | 5 years ago | 13 | Java | ||||||
Streaming data workshop with Infinispan, Vert.x and OpenShift |
Snowplow is a developer-first engine for collecting behavioral data. In short, it allows you to:
Thousands of organizations around the world generate, enhance, and model behavioral data with Snowplow to fuel advanced analytics, AI/ML initiatives, or composable CDPs.
Snowplow Open Source | Snowplow Behavioral Data Platform |
---|---|
Our Open Source solution equips you with everything you need to start creating behavioral data in a high-fidelity, machine-readable way. Head over to the Quick Start Guide to set things up. | Looking for an enterprise solution with a console, APIs, data governance, workflow tooling? The Behavioral Data Platform is our managed service that runs in your AWS or GCP cloud. Check out Try Snowplow. |
The documentation is a great place to learn more, especially:
Would rather dive into the code? Then you are already in the right place!
The repository structure follows the conceptual architecture of Snowplow, which consists of six loosely-coupled sub-systems connected by five standardized data protocols/formats.
To briefly explain these six sub-systems:
For more information on the current Snowplow architecture, please see the Technical architecture.
To make sure all the components work well together, we strongly recommended you take a look at the compatibility matrix when setting up a Snowplow pipeline.
This repository is an umbrella repository for all loosely-coupled Snowplow components and is updated on each component release.
Since June 2020, all components have been extracted into their dedicated repositories (more info here) and this repository serves as an entry point for Snowplow users, the home of our public roadmap and as a historical artifact.
Components that have been extracted to their own repository are still here as git submodules.
A full list of supported trackers can be found on our documentation site. Popular trackers and use cases include:
Web | Mobile | Gaming | TV | Desktop & Server |
---|---|---|---|---|
JavaScript | Android | Unity | Roku | Command line |
AMP | iOS | C++ | iOS | .NET |
React Native | Lua | Android | Go | |
Flutter | React Native | Java | ||
Node.js | ||||
PHP | ||||
Python | ||||
Ruby | ||||
Scala | ||||
C++ | ||||
Rust | ||||
Lua |
This repository also contains the Snowplow Public Roadmap. The Public Roadmap lets you stay up to date and find out what's happening on the Snowplow Platform. Help us prioritize our cards: open the issue and leave a 👍 to vote for your favorites. Want us to build a feature or function? Tell us by heading to our Discourse forum 💬.
We want to make it super easy for Snowplow users and contributors to talk to us and connect with one another, to share ideas, solve problems and help make Snowplow awesome. Join the conversation:
Snowplow is copyright 2012-2023 Snowplow Analytics Ltd.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this software except in compliance with the License.
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.