The Top 80 Benchmarking Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 80 Benchmarking Open Source Projects

Categories > Software Performance > Benchmarking

Vegeta ⭐ 16,184

HTTP load testing tool and library. It's over 9000!

Locust ⭐ 15,094

Scalable user load testing tool written in Python

Benchmarkdotnet ⭐ 6,141

Powerful .NET library for benchmarking

Cleverhans ⭐ 4,901

An adversarial example library for constructing attacks, building defenses, and benchmarking both

Processhacker ⭐ 4,173

A free, powerful, multi-purpose tool that helps you monitor system resources, debug software and detect malware.

Bombardier ⭐ 2,454

Fast cross-platform HTTP benchmarking tool written in Go

Generate HTTP load and plot the results in real-time

Mangohud ⭐ 2,070

A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU load and more. Discord: https://discordapp.com/invite/Gj5YmBb

Tsung ⭐ 2,051

Tsung is a high-performance benchmark framework for various protocols including HTTP, XMPP, LDAP, etc.

Reproducible Image Denoising State Of The Art ⭐ 1,442

Collection of popular and reproducible image denoising works.

Phoronix Test Suite ⭐ 1,301

The Phoronix Test Suite open-source, cross-platform automated testing/benchmarking software.

Phpbench ⭐ 1,209

PHP Benchmarking framework

Jsperf.com ⭐ 1,166

jsperf.com v2. https://github.com/h5bp/lazyweb-requests/issues/174

Benchee ⭐ 940

Easy and extensible benchmarking in Elixir providing you with lots of statistics!

Performance monitoring and benchmarking suite

Bench Scripts ⭐ 842

A compilation of Linux server benchmarking scripts.

Advertorch ⭐ 792

A Toolbox for Adversarial Robustness Research

Pytest Benchmark ⭐ 697

py.test fixture for benchmarking code

Swift Benchmark ⭐ 637

A swift library to benchmark code snippets.

Fuzzbench ⭐ 583

FuzzBench - Fuzzer benchmarking as a service.

Harmful workload generator for PostgreSQL

Performance Analysis Js ⭐ 514

Map/Reduce/Filter/Find Vs For loop Vs For each Vs Lodash vs Ramda

Time Series Benchmark Suite, a tool for comparing and evaluating databases for time series data

Lzbench ⭐ 468

lzbench is an in-memory benchmark of open-source LZ77/LZSS/LZMA compressors

Simple profiling and performance monitoring for Clojure/Script

goben is a golang tool to measure TCP/UDP transport layer throughput between hosts.

A PyTorch reinforcement learning library for generalizable and reproducible algorithm implementations with an aim to improve accessibility in RL

Toolkit to run Python benchmarks

Benchmarking Keras Pytorch ⭐ 341

🔥 Reproducibly benchmarking Keras and PyTorch models

Hrm Solutions ⭐ 327

Human Resource Machine solutions and size/speed hacks

Pedestron ⭐ 326

[Pedestron] Generalizable Pedestrian Detection: The Elephant In The Room. On ArXiv 2020

Sqlbench ⭐ 317

sqlbench measures and compares the execution time of one or more SQL queries.

A C++ micro-benchmarking framework

Blockbench ⭐ 288

BLOCKBENCH: A Framework for Analyzing Private Blockchains. Blockbench contains workloads for measuring the data processing performance, and workloads for understanding the performance of different layers of Blockchain systems.

Web Tooling Benchmark ⭐ 284

JavaScript benchmark for common web developer workloads

Mobile Ai Bench ⭐ 282

Benchmarking Neural Network Inference on Mobile Devices

Powerful Benchmarker ⭐ 255

A PyTorch library for benchmarking deep metric learning. It's powerful.

Pyperform ⭐ 221

An easy and convienent way to performance test python code.

Profilinggo ⭐ 216

A quick tour (or reminder) of Go performance tools

Benchmarknet ⭐ 206

Benchmark for testing the reliable UDP networking solutions

Node Ab ⭐ 200

A command tool to test the performance of HTTP services.

Sklearn Benchmarks ⭐ 194

A centralized repository to report scikit-learn model performance across a variety of parameter settings and data sets.

Rabbitmq Perf Test ⭐ 189

A load testing tool

GERBIL - General Entity annotatoR Benchmark

An Authentic Dataset for Visual-Inertial Odometry

Are We Fast Yet ⭐ 156

Are We Fast Yet? Comparing Language Implementations with Objects, Closures, and Arrays

Mqtt Benchmark ⭐ 137

Simple MQTT (broker) benchmarking tool

Shadowreader ⭐ 137

Serverless load testing for replaying website traffic. Powered by AWS Lambda.

A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.

Sltbench ⭐ 136

C++ benchmark tool. Practical, stable and fast performance testing framework.

Criterion ⭐ 134

Microbenchmarking for Modern C++

Gatling Dubbo ⭐ 129

A gatling plugin for running load tests on Apache Dubbo(https://github.com/apache/incubator-dubbo) and other java ecosystem.

Pulkovo ⭐ 127

Kotlin friendly library to measure elapsed time for methods, code blocks, RxJava chains

Benchmarking Tools ⭐ 124

Repository for the GA4GH Benchmarking Team work developing standardized benchmarking methods for germline small variant calls

Benchttp ⭐ 114

HTTP server benchmarking tool

Dlcookbook Dlbs ⭐ 112

Deep Learning Benchmarking Suite

Dynbenchmark ⭐ 107

Comparison of methods for trajectory inference on single-cell data 🥇

Benchexec ⭐ 101

BenchExec: A Framework for Reliable Benchmarking and Resource Measurement

Hs Gauge ⭐ 91

Lean Haskell Benchmarking

Simple NVME/SAS/SATA SSD test framework for Linux and Windows

Karma Benchmark ⭐ 87

A Karma plugin to run Benchmark.js over multiple browsers with CI compatible output.

Cloudsuite ⭐ 86

A Benchmark Suite for Cloud Services.

Profiling Nodejs ⭐ 85

🌌 Collection of articles and tools to efficiently profile Node.js

A non-sampling profiler purpose built to measure and optimize performance of ultra low latency/real time systems

Openml R ⭐ 80

R package to interface with OpenML

Structural variant toolkit for VCFs

Envoy Perf ⭐ 68

Envoy performance testing

Gobenchdata ⭐ 68

📉 Run Go benchmarks, publish results to an interactive web app, and check for performance regressions in your pull requests

Scalajs Benchmark ⭐ 62

Benchmarks: write in Scala or JS, run in your browser. Live demo:

Dynverse ⭐ 58

A set of tools supporting the development, execution, and benchmarking of trajectory inference methods. 🌍

Pytest Django Queries ⭐ 50

Generate performance reports from your django database performance tests.

Test/benchmark regression and comparison system with dashboard

Image Denoising Benchmark ⭐ 46

Benchmarking Denoising Algorithms with Real Photographs

Benchmarking framework for index structures on persistent memory

Jsbench Me ⭐ 38

jsbench.me - JavaScript performance benchmarking playground

Benchmarking tool to stress real-time protocols

Vector Test Harness ⭐ 32

End-to-end test harness for the Vector observability data router

Har Remix ⭐ 19

Easily serve a HAR archive with loose matching and alterations.

Simple C++ code for simple tasks

Sysbench Docker Hpe ⭐ 14

Sysbench Dockerfiles and Scripts for VM and Container benchmarking MySQL

1-80 of 80 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210