Awesome Open Source
Awesome Open Source
Combined Topics
task-queue x
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194

The Top 124 Task Queue Open Source Projects on Github

Categories > Messaging > Task Queue
Rq ⭐ 7,895
Simple job queues for Python
Flower ⭐ 4,907
Real-time monitor and web admin for Celery distributed task queue
Huey ⭐ 3,641
a little task queue for python
Asynq ⭐ 1,554
Asynq: simple, reliable, and efficient distributed task queue in Go
Sandglass ⭐ 1,529
Sandglass is a distributed, horizontally scalable, persistent, time sorted message queue.
Django Rq ⭐ 1,445
A simple app that provides django integration for RQ (Redis Queue)
Taskq ⭐ 641
Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends
Lmstfy ⭐ 455
Implements task queue in Golang which based on Redis storage
Yotaq ⭐ 336
yotaq - Your Own Task Queue for Python
Quirrel ⭐ 327
The Task Queueing Solution for Serverless.
Dingo ⭐ 282
An easy-to-use, distributed, extensible task/job queue framework for #golang
Cadence Client ⭐ 236
Framework for authoring workflows and activities running on top of the Cadence orchestration engine.
Ppspider ⭐ 216
web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案
Flask Redis Queue ⭐ 154
Example of how to handle background processes with Flask, Redis Queue, and Docker
Pyexpool ⭐ 141
Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture
Celery.node ⭐ 132
Celery task queue client/worker for nodejs
Archer ⭐ 131
基于协程Swoole的Task组件，支持多种模式。轻松实现协程Task的队列、并发、Defer、计时器等 | Swoole coroutine task kit - Swoole Humanization Library
Rqmonitor ⭐ 103
Flask based more dynamic and actionable frontend dashboard for monitoring Redis Queue 👩🏿‍💻 http://python-rq.org
Bull Master ⭐ 102
Nice UI for bull and bullmq
Celery Tasks Checklist ⭐ 97
Useful checklist for building great Celery tasks.
Cadence Java Client ⭐ 91
Java framework for Cadence Workflow Service
Distex ⭐ 85
Distributed process pool for Python
Pytask Io ⭐ 82
Python Async Task Queue
Atq ⭐ 80
distributed task queue for asyncio
Tasq ⭐ 70
A simple task queue implementation to enqeue jobs on local or remote processes.
Batch Rs ⭐ 63
Background job library for Rust supporting RabbitMQ
Django Carrot ⭐ 56
A lightweight task queue for Django using RabbitMQ
Celery Kubernetes Operator ⭐ 52
An operator to manage celery clusters on Kubernetes (Work in Progress)
Psched ⭐ 46
Priority-based Task Scheduling for Modern C++
Orkid Node ⭐ 36
Reliable and modern Redis Streams based task queue for Node.js 🤖
Falcon Celery ⭐ 29
Example of how to handle background processes with Falcon, Celery, and Docker
Conveyor Mq ⭐ 28
A fast, robust and extensible distributed task/job queue for Node.js, powered by Redis.
Simple Task Queue ⭐ 28
asynchronous task queues using python's multiprocessing library
Dramatiq_sqs ⭐ 28
A Dramatiq broker that can be used with Amazon SQS.
Chunk ⭐ 27
🐺 Asynchronous Task Queue Based on Distributed Message Passing for PHP.
Buha.js ⭐ 26
Browser based Strictly ordered Task Queue for Sync/Async Javascript Functions
Ucron ⭐ 25
A micro Crontab & Task Queue for Python Web.
Flask_dramatiq_example ⭐ 22
An example app demonstrating how you can use Dramatiq with Flask.
Concurrent Tasks ⭐ 21
A simple task runner which will run all tasks till completion, while maintaining concurrency limits.
Gostalkd ⭐ 16
Meesee ⭐ 14
Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.
D4c Queue ⭐ 14
Execute tasks sequentially or concurrently. Wrap an async/promise-returning/sync function as a queue-ready async function for easy reusing. Support passing arguments/getting return value, decorators
Queue ⭐ 14
A task queue library for Go.
Magne ⭐ 14
Curio, RabbitMQ, Distributed Task Queue(celery)
Go Taskqueue ⭐ 13
Golang Task Queue
Gohive ⭐ 12
🐝 A Highly Performant and easy to use goroutine pool for Go
Izta ⭐ 12
Izta - a drop-in asynchronous job queue for Rust
Gputasker ⭐ 11
An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star
Python Task Queue ⭐ 11
Asynchronous serverless task queue with timed leasing of tasks. Threaded implementations for SQS and local filesystem.
Js Service Wrapper ⭐ 10
Promise based collective service wrapper with queue support for browsers and NodeJS
Flask Huey Example ⭐ 10
Example of setting up Flask with the Huey task queue
Pgtq ⭐ 10
PostgreSQL-backed python task queue
Backend Microservices ⭐ 9
Monorepo for backend microservices golang
Job Queue ⭐ 9
Persisted job queue for android
Framework ⭐ 9
The Strontium Framework is a high performance and developer friendly web framework for developing SAAS applications on top of NodeJS.
Taskhawk Python ⭐ 9
A simple asynchronous task queue that works on AWS SQS
Queue Task ⭐ 8
Lightweight task queue framework
Smartthreadpool ⭐ 7
A smart C++11 thread pool. Efficiently schedule your threads using "Classify Thread Pool", "Priority Task Queue". And also provide "Self-Adaption Pool Capacity" policy, "State Monitor" of tasks and workers function.
Coil ⭐ 7
Futures-based background work queue built with SQLx and Postgres
Musicload Bot ⭐ 7
Telegram Bot written in Go
Pods Jobs Queue ⭐ 6
Queue callbacks to be ran with arguments, unlike wp_cron which is scheduled jobs, these are queued and run concurrently as needed
Hapi Rabbitmq ⭐ 6
A HAPI server plugin exposing RabbitMQ-backed PubSub and task queue pattern methods from librabbitmq.
Curlew ⭐ 6
Curlew is a job pool based on a local machine.
Jobschedulers.jl ⭐ 6
A Julia-based job scheduler and workload manager inspired by Slurm and PBS.
Redis Tq ⭐ 6
redis-based task queue written in Python
Redis X Stream ⭐ 5
An AsyncIterable interface for reading redis streams
Reactivetasks ⭐ 5
Priority-based task/job queue driven by RxJava
Gpu Monitor ⭐ 5
GPU resource monitoring and task management
Librabbitmq ⭐ 4
Easy to use methods implementing common PubSub and task queue patterns with RabbitMQ.
Php Rmqlib ⭐ 4
This is a php wrapper built on top of php-amqplib (@videlalvaro).
Task Queue ⭐ 4
Simple task queue implementation in Java
Simpletaskqueue ⭐ 4
A simple task queue used for coordinating distributed, parallel work.
Mgap ⭐ 4
Experimental data pipeline for testing feature recognition capabilities of various ML models on images from UCLA Library digital collections.
Messages ⭐ 4
Vitess messages client
Riak Task Queue ⭐ 4
Persistent task queue with scheduler and multiple worker instances on top of Riak KV
Smartpipeline ⭐ 3
A framework for fast development of scalable data pipelines following a simple design pattern
Vulpes ⭐ 3
Job management framework
Learn Task Queue ⭐ 3
TaskQueue ServerをDockerとPythonで理解するためのリポジトリ
You No Superhero ⭐ 3
Source code for a tutorial on medium.
Blackfyre ⭐ 3
Distributed asynchronous task queue/job queue
Cloth ⭐ 3
A simple thread pool and task queue for Node.
Parallel ⭐ 3
parallel programming primitives for C++; pausable thread, task_queue, etc.
Orkid Ui ⭐ 3
Dashboard to monitor and manage Orkid task queue ✨
Rafx ⭐ 2
requestAnimationFrame based `thenable` for animations and task management
Tasq ⭐ 2
Async Sqs Tasks Js ⭐ 2
Provides a publisher and consumer for tasks enqueued using AWS SQS
Walrus ⭐ 2
A task execution engine in GO, that also supports deferred tasks using Redis as queue
Spring_base_exmaple_annotation_based ⭐ 2
Spring Base Example
Mfworker ⭐ 2
A memory and file based task worker for Golang. Queue jobs only for single process application.
Task Queue ⭐ 2
A customizable job/task queue for javascript processes.
Conveyor Mq ⭐ 2
Conveyor MQ: A fast, robust and extensible distributed task/job queue for Node.js, powered by Redis.
Qflow ⭐ 2
Distributed ANUGA & Tuflow Modelling
Python_rabbitmq_work_queue ⭐ 2
sample python/nodejs rabbitmq work queue
Asynctaskqueue.js ⭐ 1
JavaScript worker queue to execute tasks asynchronously, based on (deferred) promises
Js Taskcontrol ⭐ 1
Control, Create, Run named workflows tasks with before / after middlewares (auth, data fetch / save, logging, cleanup, etc) with plugins support: npm install
Task Queue ⭐ 1
Py Taskcontrol ⭐ 1
Control, Create, Run named workflows tasks with before/after middlewares (auth, data fetch/save, logging, cleanup, etc) with plugins support - pip3 install taskcontrol https://pypi.org/project/taskcontrol
Taskorganizer ⭐ 1
Script to help organize the running of scripts. I use it mainly to run all my reporting scripts, to make sure they are run in the proper order and on the correct date.
Kueue ⭐ 1
Distributed Task Queue - backed by Kafka
Spq ⭐ 1
Persistent queue library putting fail safety over speed.
1-100 of 124 projects

Related Projects

Python Task Queue Projects (42)
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2021