Awesome Open Source
Awesome Open Source
Combined Topics
large-scale x

The Top 348 Large Scale Open Source Projects

Categories > Data Processing > Large Scale
Pinpoint ⭐ 12,490
APM, (Application Performance Management) tool for large-scale distributed systems.
total releases 7most recent commit 17 hours ago
Colossalai ⭐ 6,783
Colossal-AI: A Unified Deep Learning System for Big Model Era
most recent commit 15 hours ago
Electrode ⭐ 2,071
Web applications with node.js and React
dependent packages 140total releases 75most recent commit 21 days agonpm electrode-archetype-react-component} Downloads
Bosh ⭐ 1,992
Cloud Foundry BOSH is an open source tool chain for release engineering, deployment and lifecycle management of large scale distributed services.
dependent packages 30total releases 362most recent commit 6 days agorubygems bosh_cli} Downloads
Dialogpt ⭐ 1,751
Large-scale pretraining for dialogue
most recent commit a month ago
Lightning ⭐ 1,513
Large-scale linear classification, regression and ranking in Python
dependent packages 1total releases 12most recent commit 10 months agopypi sklearn-contrib-lightning} Downloads
Vaquarkhan ⭐ 1,474
most recent commit 3 months ago
Fleet ⭐ 1,206
Manage large fleets of Kubernetes clusters
dependent packages 16total releases 36most recent commit 8 hours ago
Ccpd ⭐ 1,068
[ECCV 2018] CCPD: a diverse and well-annotated dataset for license plate detection and recognition
most recent commit 2 years ago
Cdial Gpt ⭐ 944
A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models
most recent commit 6 months ago
Trilinos ⭐ 827
Primary repository for the Trilinos Project
most recent commit 2 days ago
Fewrel ⭐ 632
A Large-Scale Few-Shot Relation Extraction Dataset
most recent commit 7 months ago
Superpoint_graph ⭐ 614
Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs
most recent commit 7 months ago
Openlongtailrecognition Oltr ⭐ 462
Pytorch implementation for "Large-Scale Long-Tailed Recognition in an Open World" (CVPR 2019 ORAL)
most recent commit 2 years ago
Crosswoz ⭐ 444
A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Dataset
most recent commit 14 days ago
Paddlefl ⭐ 416
Federated Deep Learning in PaddlePaddle
total releases 17most recent commit 25 days ago
Postgresql_cursor ⭐ 405
ActiveRecord PostgreSQL Adapter extension for using a cursor to return a large result set
dependent packages 4total releases 14most recent commit a month agorubygems postgresql_cursor} Downloads
Omrchecker ⭐ 369
Read OMRs fast and accurately using a scanner 🖨 or your phone 🤳.
most recent commit 13 days ago
Sensaturban ⭐ 361
🔥Urban-scale point cloud dataset (CVPR 2021 & IJCV 2022)
most recent commit 4 months ago
Hfnet ⭐ 324
From Coarse to Fine: Robust Hierarchical Localization at Large Scale with HF-Net (https://arxiv.org/abs/1812.03506)
most recent commit 2 years ago
High Performance Face Recognition ⭐ 323
🔥🔥Several High-Performance Models for Unconstrained/Large-Scale/Low-Shot Face Recognition🔥🔥
most recent commit a year ago
Cruise Control Ui ⭐ 284
Cruise Control Frontend (CCFE): Single Page Web Application to Manage Large Scale of Kafka Clusters
most recent commit 11 days ago
Pybliometrics ⭐ 284
Python-based API-Wrapper to access Scopus
total releases 34most recent commit 12 days ago
Paddlefleetx ⭐ 281
Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep
most recent commit 8 hours ago
Lava ⭐ 275
LAVA: Large-scale Automated Vulnerability Addition
most recent commit a year ago
Brayns ⭐ 272
Visualizer for large-scale and interactive ray-tracing of neurons
dependent packages 1total releases 9most recent commit 11 days agopypi brayns} Downloads
Libai ⭐ 251
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
most recent commit 20 hours ago
Vuex Feature Scoped Structure ⭐ 208
📈 Feature scoped Vuex modules to have a better organization of business logic code inside Vuex modules based on Large-scale Vuex application structures @3yourmind
most recent commit 4 years ago
Spinnet ⭐ 188
[CVPR 2021] SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration
most recent commit a year ago
Torrage ⭐ 185
Torrage - Torrent Storage Cache
most recent commit 11 years ago
Triviaqa ⭐ 176
Code for the TriviaQA reading comprehension dataset
most recent commit 3 years ago
Electricalage ⭐ 175
Electrical Age (ELN) is a Minecraft Mod offering the ability to perform large-scale in-game electrical simulations.
most recent commit 3 years ago
Vuejs_tutorial ⭐ 164
This is the source code for our Vue.js Tutorial Series on DevMarketer.
most recent commit 6 years ago
Lego ⭐ 161
👾 Create large scale and reactive web applications brick by brick
dependent packages 2total releases 8most recent commit a year agonpm brickjs} Downloads
Doris ⭐ 160
A large scale distributed KV storage system.
most recent commit 5 years ago
Stormcv ⭐ 158
Apache Storm + OpenCV = large scale distributed image and video analysis.
most recent commit 6 years ago
Reasoning Rcnn ⭐ 155
Reasoning-RCNN: Unifying Adaptive Global Reasoning into Large-scale Object Detection (CVPR2019 Oral)
most recent commit 10 months ago
Evemu_server ⭐ 147
MAIN SERVER DEVELOPMENT
most recent commit 2 years ago
Vuex Namespaced Module Structure ⭐ 135
📈 A Vue.js project powered by Vuex namespaced modules in a simple structure based on Large-scale Vuex application structures
most recent commit 4 years ago
Sisl ⭐ 130
Electronic structure Python package for post analysis and large scale tight-binding DFT/NEGF calculations
dependent packages 2total releases 37most recent commit 6 days agopypi sisl} Downloads
Statsd.net ⭐ 123
A high-performance stats collection service that feeds into Graphite and aimed at small- to large-scale windows environments.
most recent commit 6 years ago
Unrealtext ⭐ 122
Synthetic Scene Text from 3D Engines
most recent commit 2 years ago
Librom ⭐ 115
Model reduction library with an emphasis on large scale parallelism and linear subspace methods
most recent commit a day ago
Distributed System Design ⭐ 114
A curated collection of approaches to creating large scale distributed systems.
most recent commit 19 days ago
Blvd ⭐ 112
Building A Large-scale 5D Semantics Benchmark for Autonomous Driving
most recent commit 3 years ago
Plsc ⭐ 111
Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, DeiT, FaceViT.
total releases 2most recent commit 10 hours ago
Cctools ⭐ 111
The Cooperative Computing Tools (cctools) enable large scale distributed computations to harness hundreds to thousands of machines from clusters, clouds, and grids.
dependent packages 1total releases 1most recent commit 6 days agopypi work-queue} Downloads
Gpu Planetary Rendering ⭐ 110
GPU atmosphertic scattering and planet generation in Unity 3D
most recent commit a year ago
Babar ⭐ 101
Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.
most recent commit 4 years ago
Py Cloudcv ⭐ 99
Python APIs for CloudCV
total releases 2most recent commit 3 years ago
Panns_inference ⭐ 98
total releases 7most recent commit 12 days ago
Cicada ⭐ 96
A Dapper based Large-Scale Distributed Systems Tracing Infrastructure
most recent commit 6 years ago
Keypointnet ⭐ 91
KeypointNet: A Large-scale 3D Keypoint Dataset Aggregated from Numerous Human Annotations (CVPR2020)
most recent commit a year ago
Hkrm ⭐ 87
Hybrid Knowledge Routed Module for Large-scale Object Detection (NerIPS2018)
most recent commit 2 years ago
Vuex Simple Structure ⭐ 79
📈 A repository showcasing a simple Vuex store inside a Vue.js application based on Large-scale Vuex application structures @3yourmind
most recent commit 4 years ago
Product Quantization Tree ⭐ 78
GPU-based large scale Approx. Nearest Neighbor Search, accepted at CVPR 2016
most recent commit 4 years ago
Dh3d ⭐ 77
DH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DOF Relocalization
most recent commit 2 years ago
Grailqa ⭐ 72
most recent commit a month ago
Structuredoptimization.jl ⭐ 67
Structured optimization in Julia
most recent commit 5 months ago
Ffhqr Dataset ⭐ 65
FFHQR -- the first large-scale retouching dataset for computer vision research.
most recent commit a year ago
Carlsim4 ⭐ 63
CARLsim is an efficient, easy-to-use, GPU-accelerated software framework for simulating large-scale spiking neural network (SNN) models with a high degree of biological detail.
most recent commit 2 years ago
Mixout ⭐ 61
Implementation of Mixout with PyTorch
most recent commit 2 months ago
Gorpc ⭐ 60
a golang rpc framework designed for Large-scale distributed system
dependent packages 1most recent commit 2 years ago
Brite ⭐ 59
Brite is a minimalistic but powerful DOM Centric MVC framework built on top of JQuery for large scale and high quality HTML5 and HTML4 application. (MIT Licensed)
most recent commit 4 months ago
Biodynamo ⭐ 57
BioDynaMo is a high-performance and modular, agent-based simulation platform.
most recent commit 4 days ago
Scope ⭐ 56
Fast visualization tool for large-scale and high dimensional single-cell data
most recent commit 8 months ago
Rglpk ⭐ 53
Ruby wrapper for the GNU linear programming kit (GLPK). The GLPK (GNU Linear Programming Kit) package is intended for solving large-scale linear programming (LP), mixed integer programming (MIP), and other related problems.
most recent commit 7 years ago
Evemu_incursion ⭐ 52
OLD - EVEmu server for Incursion client
most recent commit 11 years ago
Ps Dataset ⭐ 52
PhotoSynth Dataset for improving local patch Descriptors
most recent commit 3 years ago
Cobra.jl ⭐ 52
High-level, high-performance, constraint-based reconstruction and analysis in Julia
most recent commit 11 hours ago
Borges ⭐ 51
borges collects and stores Git repositories.
total releases 57most recent commit 3 years ago
Carlsim3 ⭐ 48
CARLsim is an efficient, easy-to-use, GPU-accelerated software framework for simulating large-scale spiking neural network (SNN) models with a high degree of biological detail.
most recent commit 5 years ago
Destiny ⭐ 47
R package for single cell and other data analysis using diffusion maps
most recent commit a month ago
Bufferkdtree ⭐ 46
A Python library for large-scale nearest neigbhor computations via k-d trees and GPUs.
total releases 10most recent commit 3 years ago
Learn By Contributing ⭐ 44
A curated list of open source projects that you can learn from
most recent commit 4 years ago
Lsd_slam ⭐ 41
LSD-SLAM
most recent commit 8 years ago
Bongard Logo ⭐ 41
Bongard-LOGO is a Python code repository with the purpose of generating synthetic Bongard problems on a large scale with little human intervention.
most recent commit 9 months ago
Comatch ⭐ 39
most recent commit 4 years ago
Varbvs ⭐ 38
Large-scale Bayesian variable selection for R and MATLAB.
total releases 5most recent commit 7 months ago
Sparc ⭐ 38
Simulation Package for Ab-initio Real-space Calculations
most recent commit 5 days ago
Displaycluster ⭐ 38
a collaborative software environment for large-scale tiled display systems
most recent commit 6 years ago
Esl ⭐ 37
​The Economic Simulation Library provides an extensive collection of tools to develop, test, analyse and calibrate economic and financial agent-based models. The library is designed to take advantage of different computer architectures. In order to facilitate rapid iteration during model development the library can use parallel computation. Economic models developed using the library can be deployed into large-scale distributed computing environments when working with large model instances and d
most recent commit 5 months ago
Dlinputs ⭐ 37
Input pipelines for large scale, sharded training of deep learning models.
most recent commit 3 years ago
Bigclam Apachespark ⭐ 34
Overlapping community detection in Large-Scale Networks using BigCLAM model build on Apache Spark
most recent commit 5 years ago
Openpv ⭐ 34
PetaVision is a C++ library for designing and deploying large-scale neurally-inspired computational models.
most recent commit 5 months ago
Es_pandas ⭐ 34
Read, write and update large scale pandas DataFrame with Elasticsearch
total releases 21most recent commit 2 months ago
Brails ⭐ 34
DL-based Building Information Modeling (BIM).
total releases 56most recent commit a month ago
Aeplanner ⭐ 34
An autonomous exploration planner for large scale 3D environments
most recent commit 2 years ago
Evemu_crucible ⭐ 33
OLD - EVEmu Server for Crucible client v1.6.5 build 360229
most recent commit 11 years ago
Lvr2 ⭐ 32
Las Vegas Reconstruction 2.0
most recent commit a year ago
Cyclops ⭐ 30
Cyclops (Cyclic coordinate descent for logistic, Poisson and survival analysis) is an R package for performing large scale regularized regressions.
dependent packages 1total releases 13most recent commit 5 months ago
Enkf C ⭐ 29
EnKF code for DA with large-scale layered geophysical models.
most recent commit 16 hours ago
Labr ⭐ 27
LABR: Large Scale Arabic Book Reviews Dataset
most recent commit 8 years ago
Abstractoperators.jl ⭐ 26
Abstract operators for large scale optimization in Julia
most recent commit a year ago
Juxta ⭐ 25
Generates large collages of images using OpenSeadragon
most recent commit 3 years ago
Paropt ⭐ 24
Interior-point and trust region optimizer for large-scale distributed design problems
most recent commit 8 months ago
Subdomaintakeovertools ⭐ 24
most recent commit 4 years ago
Gigasom.jl ⭐ 22
Huge-scale, high-performance flow cytometry clustering in Julia
most recent commit 3 months ago
Neorl ⭐ 21
NeuroEvolution Optimization with Reinforcement Learning
most recent commit 5 months ago
Erlang Utp ⭐ 21
uTP implementation in Erlang
most recent commit 10 years ago
1-100 of 348 projects
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,114,612)
Python  (860,459)
Java  (402,966)
Php  (292,746)
Typescript  (281,047)
C Plus Plus  (251,243)
Ruby  (223,115)
C  (189,468)
Shell  (178,484)
C Sharp  (173,233)
Golang  (167,331)
Swift  (67,673)
Rust  (64,694)
R  (60,818)
Dart  (58,623)
Objective C  (57,044)
Kotlin  (50,945)
Lua  (36,944)
Matlab  (32,297)
Perl  (30,697)
Language  (29,924)
Scala  (29,110)
Haskell  (20,749)
Powershell  (19,905)
Clojure  (19,387)
Bash  (19,012)
Coffeescript  (17,177)
Elixir  (17,147)
Assembly  (15,188)
Julia  (13,615)
Processing  (13,290)
Basic  (10,688)
Emacs Lisp  (10,669)
Flow  (10,517)
Solidity  (9,511)
Erlang  (9,088)
Groovy  (8,508)
Scheme  (8,422)
Ocaml  (6,870)
Pascal  (6,688)
Hack  (6,547)
Lisp  (6,346)
Fortran  (5,726)
Elm  (5,537)
Common Lisp  (5,421)
Visual Basic  (4,960)
Dlang  (4,780)
Shell Script  (4,761)
Python Library  (4,491)
Crystal  (4,419)
Privacy | About | Terms | Follow Us On Twitter | Top Projects

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.