Deepflow

Application Observability using eBPF
Alternatives To Deepflow
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Netdata63,310
an hour ago333gpl-3.0C
Real-time performance monitoring, done right! https://www.netdata.cloud
Cilium15,5531531 minutes ago547September 14, 20221,167apache-2.0Go
eBPF-based Networking, Security, and Observability
Victoriametrics8,6314an hour ago174September 08, 2022676apache-2.0Go
VictoriaMetrics: fast, cost-effective monitoring solution and time series database
Prometheus Operator8,067259an hour ago295September 20, 2022288apache-2.0Go
Prometheus Operator creates/configures/manages Prometheus clusters atop Kubernetes
Scope5,555
8 months ago72January 25, 2022451apache-2.0Go
Monitoring, visualisation & management for Docker & Kubernetes
Ntopng5,329
2 hours ago1February 27, 2018227gpl-3.0Lua
Web-based Traffic and Security Network Traffic Monitoring
Cortex5,0959617 hours ago325July 15, 2022188apache-2.0Go
A horizontally scalable, highly available, multi-tenant, long term Prometheus.
Pixie4,635
10 hours ago88April 24, 2021234apache-2.0C++
Instant Kubernetes-Native Application Observability
Kube State Metrics4,571482 hours ago93June 03, 202268apache-2.0Go
Add-on agent to generate and expose cluster-level metrics.
Opencost3,79214 hours ago68September 19, 2022146apache-2.0Go
Cross-cloud cost allocation models for Kubernetes workloads
Alternatives To Deepflow
Select To Compare


Alternative Project Comparisons
Readme

DeepFlow

DeepFlow is an automated observability platform for cloud-native developers.

GitHub Release docker pulls License


English |

What is DeepFlow

DeepFlow is a highly automated observability platform for cloud-native developers. Using new technologies such as eBPF, WASM, and OpenTelemetry, DeepFlow innovatively implements core mechanisms such as AutoTracing, AutoMetrics, AutoTagging, and SmartEncoding, which greatly avoids code instrumentation and significantly reduces the resource overhead of back-end data warehouses. With the programmability and open API of DeepFlow, developers can quickly integrate it into their own observability stack.

Key Features

  • Any Stack: With the AutoMetrics mechanism implemented by eBPF and cBPF, DeepFlow can automatically collect RED (Request, Error, Delay) performance metrics of any application, down to every request, covering all software technologie stacks from application to infrastructure. In cloud-native environments, the AutoTagging mechanism automatically discovers the attributes of services, instances and APIs, and automatically injects rich tags into each observability data, thereby eliminating data silos and releasing data drill-down capabilities.
  • End to End: DeepFlow innovatively implements the AutoTracing mechanism using eBPF technology. It automatically traces the distributed request of any application and infrastructure service in cloud-native environments. On this basis, by integrating and automatically correlating data from OpenTelemetry, DeepFlow implements a complete full-stack, full-path distributed tracing, eliminating all blind spots.
  • High Performance: The innovative SmartEncoding tag injection mechanism can improve the storage performance by 10 times, no more high-cardinality and sampling anxiety. DeepFlow Agent is implemented in Rust for extreme processing performance and memory safety. DeepFlow Server is implemented in Golang, and rewrites standard library map and pool for a nearly 10x performance in data query and memory GC.
  • Programmability: DeepFlow supports collect HTTP(S), Dubbo, MySQL, PostgreSQL, Redis, Kafka, MQTT and DNS at the moment, and will iterate to support more application protocols. In addition, DeepFlow provides a programmable interface based on WASM technology, allowing developers to add private protocols quickly, and can be used to construct business analysis capabilities for specific scenarios, such as 5GC signaling analysis, financial transaction analysis, vehicle computer communication analysis, etc.
  • Open Interface: DeepFlow embraces the open source community, supports a wide range of observability data sources, and uses AutoTagging and SmartEncoding to provide high-performance, unified tag injection capabilities. DeepFlow has a plugable database interface, developers can freely add and replace the most suitable database. DeepFlow provides a unified standard SQL query capability for all observability data, which is convenient for users to quickly integrate into their own observability platform.
  • Easy to Maintain: The core of DeepFlow only consists of two components, Agent and Server, hiding the complexity within the process and reduces the maintenance difficulty to the extreme. The DeepFlow Servers can manage Agents in multiple kubernetes clusters, legacy hosts and cloud hosts in a unified manner, and can achieve horizontal scaling and load balancing without any external components.

Documentation

For more information, please visit the documentation website.

Quick start

There are three editions of DeepFlow:

  • DeepFlow Community: for developers
  • DeepFlow Enterprise: for organizations, solving team collaboration problems
  • DeepFlow Cloud: SaaS service, currently in beta

The DeepFlow Community Edition consists of the core components of the Enterprise Edition.

DeepFlow Community

Please refer to the deployment documentation.

At the same time, we have also built a complete DeepFlow Community Demo, welcome to experience it. Login account/password: deepflow/deepflow.

DeepFlow Cloud

DeepFlow Cloud is the fully-managed service of DeepFlow, currently in beta and only supports Chinese.

DeepFlow Enterprise

DeepFlow Enterprise supports full-stack and end-to-end monitoring of hybrid cloud, covering containers, cloud servers, hosts, and NFV gateways, currently only supports Chinese, welcome to contact us for experience.

Compile DeepFlow from Source

Software Architecture

DeepFlow Community Edition consists of two components, Agent and Server. An Agent runs in each K8s node, legacy host and cloud host, and is responsible for AutoMetrics and AutoTracing data collection of all application processes on the host. Server runs in a K8s cluster and provides Agent management, tag injection, data ingest and query services.

DeepFlow Architecture

Milestones

Here is our future feature plan. Issues and Pull Requests are welcome.

Contact Us

  • DiscordClick here to join our discussion.
  • TwitterDeepFlow
  • WeChat Group

Acknowledgments

  • Thanks eBPF, a revolutionary Linux kernel technology.
  • Thanks OpenTelemetry, provides vendor-neutral APIs to collect application telemetry data.

Landscapes

Popular Kubernetes Projects
Popular Monitoring Projects
Popular Virtualization Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Go
K8s
Kubernetes
Monitoring
Prometheus
Tracing
Cloud Native
Apm