The Top 87 Benchmarking Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 87 Benchmarking Open Source Projects

Categories > Software Performance > Benchmarking

Vegeta ⭐ 17,490

HTTP load testing tool and library. It's over 9000!

Locust ⭐ 16,321

Scalable user load testing tool written in Python

Benchmarkdotnet ⭐ 6,567

Powerful .NET library for benchmarking

Cleverhans ⭐ 5,139

An adversarial example library for constructing attacks, building defenses, and benchmarking both

Processhacker ⭐ 4,751

A free, powerful, multi-purpose tool that helps you monitor system resources, debug software and detect malware.

Bombardier ⭐ 2,677

Fast cross-platform HTTP benchmarking tool written in Go

Generate HTTP load and plot the results in real-time

Mangohud ⭐ 2,430

A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU load and more. Discord: https://discordapp.com/invite/Gj5YmBb

Tsung ⭐ 2,114

Tsung is a high-performance benchmark framework for various protocols including HTTP, XMPP, LDAP, etc.

Reproducible Image Denoising State Of The Art ⭐ 1,585

Collection of popular and reproducible image denoising works.

Phoronix Test Suite ⭐ 1,378

The Phoronix Test Suite open-source, cross-platform automated testing/benchmarking software.

Phpbench ⭐ 1,359

PHP Benchmarking framework

Jsperf.com ⭐ 1,194

jsperf.com v2. https://github.com/h5bp/lazyweb-requests/issues/174

Likwid ⭐ 1,008

Performance monitoring and benchmarking suite

Benchee ⭐ 993

Easy and extensible benchmarking in Elixir providing you with lots of statistics!

Bench Scripts ⭐ 900

A compilation of Linux server benchmarking scripts.

Advertorch ⭐ 870

A Toolbox for Adversarial Robustness Research

Pytest Benchmark ⭐ 772

py.test fixture for benchmarking code

Swift Benchmark ⭐ 688

A swift library to benchmark code snippets.

Fuzzbench ⭐ 649

FuzzBench - Fuzzer benchmarking as a service.

Harmful workload generator for PostgreSQL

Time Series Benchmark Suite, a tool for comparing and evaluating databases for time series data

Performance Analysis Js ⭐ 547

Map/Reduce/Filter/Find Vs For loop Vs For each Vs Lodash vs Ramda

Lzbench ⭐ 527

lzbench is an in-memory benchmark of open-source LZ77/LZSS/LZMA compressors

Avalanche ⭐ 463

Avalanche: an End-to-End Library for Continual Learning.

goben is a golang tool to measure TCP/UDP transport layer throughput between hosts.

Simple profiling and performance monitoring for Clojure/Script

Pedestron ⭐ 381

[Pedestron] Generalizable Pedestrian Detection: The Elephant In The Room. @ CVPR2021

Toolkit to run Python benchmarks

A PyTorch reinforcement learning library for generalizable and reproducible algorithm implementations with an aim to improve accessibility in RL

Benchmarking Keras Pytorch ⭐ 357

🔥 Reproducibly benchmarking Keras and PyTorch models

Hrm Solutions ⭐ 338

Human Resource Machine solutions and size/speed hacks

Sqlbench ⭐ 333

sqlbench measures and compares the execution time of one or more SQL queries.

A C++ micro-benchmarking framework

Powerful Benchmarker ⭐ 310

A PyTorch library for benchmarking deep metric learning. It's powerful.

Blockbench ⭐ 307

BLOCKBENCH: A Framework for Analyzing Private Blockchains. Blockbench contains workloads for measuring the data processing performance, and workloads for understanding the performance of different layers of Blockchain systems.

Web Tooling Benchmark ⭐ 303

JavaScript benchmark for common web developer workloads

Mobile Ai Bench ⭐ 294

Benchmarking Neural Network Inference on Mobile Devices

A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.

Pyperform ⭐ 223

An easy and convienent way to performance test python code.

Profilinggo ⭐ 220

A quick tour (or reminder) of Go performance tools

Rabbitmq Perf Test ⭐ 208

A load testing tool

Benchmarknet ⭐ 206

Benchmark for testing the reliable UDP networking solutions

Node Ab ⭐ 202

A command tool to test the performance of HTTP services.

Sklearn Benchmarks ⭐ 195

A centralized repository to report scikit-learn model performance across a variety of parameter settings and data sets.

Kdiskmark ⭐ 186

A simple open-source disk benchmark tool for Linux distros

GERBIL - General Entity annotatoR Benchmark

An Authentic Dataset for Visual-Inertial Odometry

Are We Fast Yet ⭐ 175

Are We Fast Yet? Comparing Language Implementations with Objects, Closures, and Arrays

Mqtt Benchmark ⭐ 153

MQTT broker benchmarking tool

Criterion ⭐ 146

Microbenchmarking for Modern C++

Extensive de-novo TE Annotator

Shadowreader ⭐ 140

Serverless load testing for replaying website traffic. Powered by AWS Lambda.

Sltbench ⭐ 138

C++ benchmark tool. Practical, stable and fast performance testing framework.

Benchmarking Tools ⭐ 132

Repository for the GA4GH Benchmarking Team work developing standardized benchmarking methods for germline small variant calls

Gatling Dubbo ⭐ 132

A gatling plugin for running load tests on Apache Dubbo(https://github.com/apache/incubator-dubbo) and other java ecosystem.

Pulkovo ⭐ 128

Kotlin friendly library to measure elapsed time for methods, code blocks, RxJava chains

Dlcookbook Dlbs ⭐ 118

Deep Learning Benchmarking Suite

Benchexec ⭐ 114

BenchExec: A Framework for Reliable Benchmarking and Resource Measurement

Benchttp ⭐ 114

HTTP server benchmarking tool

Dynbenchmark ⭐ 114

Comparison of methods for trajectory inference on single-cell data 🥇

Reqstress ⭐ 103

a benchmarking&stressing tool that can send raw HTTP requests

Structural variant toolkit for VCFs

Profiling Nodejs ⭐ 97

🌌 Collection of articles and tools to efficiently profile Node.js

Simple NVME/SAS/SATA SSD test framework for Linux and Windows

Ake Datasets ⭐ 96

Large, curated set of benchmark datasets for evaluating automatic keyphrase extraction algorithms.

Cloudsuite ⭐ 95

A Benchmark Suite for Cloud Services.

Hs Gauge ⭐ 92

Lean Haskell Benchmarking

A non-sampling profiler purpose built to measure and optimize performance of ultra low latency/real time systems

Karma Benchmark ⭐ 88

A Karma plugin to run Benchmark.js over multiple browsers with CI compatible output.

Openml R ⭐ 82

R package to interface with OpenML

Envoy Perf ⭐ 80

Envoy performance testing

Gobenchdata ⭐ 72

📉 Run Go benchmarks, publish results to an interactive web app, and check for performance regressions in your pull requests

Jsbench Me ⭐ 65

jsbench.me - JavaScript performance benchmarking playground

Scalajs Benchmark ⭐ 64

Benchmarks: write in Scala or JS, run in your browser. Live demo:

Dynverse ⭐ 59

A set of tools supporting the development, execution, and benchmarking of trajectory inference methods. 🌍

Pytest Django Queries ⭐ 57

Generate performance reports from your django database performance tests.

Image Denoising Benchmark ⭐ 54

Benchmarking Denoising Algorithms with Real Photographs

Test/benchmark regression and comparison system with dashboard

Benchmarking framework for index structures on persistent memory

Gccontent Benchmark ⭐ 42

Benchmarking different languages for a simple bioinformatics task (Counting the GC fraction of DNA in a FASTA file)

Benchmarking tool to stress real-time protocols

Benchbot ⭐ 35

BenchBot is a tool for seamlessly testing & evaluating semantic scene understanding tools in both realistic 3D simulation & on real robots

Vector Test Harness ⭐ 32

End-to-end test harness for the Vector observability data router

Har Remix ⭐ 19

Easily serve a HAR archive with loose matching and alterations.

Simple C++ code for simple tasks

Sysbench Docker Hpe ⭐ 14

Sysbench Dockerfiles and Scripts for VM and Container benchmarking MySQL

1-87 of 87 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210