Awesome Open Source

Programming Languages

Search results for s3

2,651 search results found

Minio ⭐ 42,715

The Object Store for AI Data Infrastructure

Rclone ⭐ 42,258

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

Seaweedfs ⭐ 20,994

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Transfer.sh ⭐ 14,640

Easy and fast file sharing from the command-line.

Siyuan ⭐ 14,236

A privacy-first, self-hosted, fully open source personal knowledge management software, written in typescript and golang.

Airbyte ⭐ 12,918

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Ceph ⭐ 12,859

Ceph is a distributed object, block, and file storage platform

Thanos ⭐ 12,561

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

Awesome Aws ⭐ 11,773

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

Litestream ⭐ 9,371

Streaming replication for SQLite.

Filestash ⭐ 9,313

🦄 A modern web client for SFTP, S3, FTP, WebDAV, Git, Minio, LDAP, CalDAV, CardDAV, Mysql, Backblaze, ...

Juicefs ⭐ 9,252

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

S3fs Fuse ⭐ 7,826

FUSE-based file system backed by Amazon S3

Sftpgo ⭐ 7,384

Fully featured and highly configurable SFTP server with optional HTTP/S, FTP/S and WebDAV support - S3, Google Cloud Storage, Azure Blob

A library that allows you to easily mock out tests based on AWS infrastructure.

Kodexplorer ⭐ 6,103

A web based file manager,web IDE / browser based code editor

Goofys ⭐ 4,929

a high-performance, POSIX-ish Amazon S3 file system written in Go

Backup ⭐ 4,815

Easy full stack backup operations on UNIX-like systems.

S3cmd ⭐ 4,363

Official s3cmd repo -- Command line tool for managing Amazon S3 and CloudFront services

Replibyte ⭐ 3,815

Seed your development database with real data ⚡️

Mountpoint S3 ⭐ 3,773

A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

Wal E ⭐ 3,408

Continuous Archiving for Postgres

Shrine ⭐ 3,142

File Attachment toolkit for Ruby applications

Smart_open ⭐ 3,065

Utils for streaming large files (S3, HDFS, gzip, bz2...)

0x4447_product_s3_email ⭐ 3,000

📫 A serverless email server on AWS using S3 and SES

Roapi ⭐ 2,969

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

Fake S3 ⭐ 2,905

A lightweight server clone of Amazon S3 that simulates most of the commands supported by S3 with minimal dependencies

Wal G ⭐ 2,820

Archival and Restoration for databases in the Cloud

Opendal ⭐ 2,807

Apache OpenDAL: access data freely.

Cyberduck ⭐ 2,793

Cyberduck is a libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift file transfer client for Mac and Windows.

Aws Sdk Js V3 ⭐ 2,739

Modularized AWS SDK for JavaScript.

Simple | Fast tool to manage MinIO clusters ☁️

S3scanner ⭐ 2,297

Scan for misconfigured S3 buckets across S3-compatible APIs!

S3_website ⭐ 2,259

Manage an S3 website: sync, deliver via CloudFront, benefit from advanced S3 website features.

Node.js framework made by a former @expressjs TC and @koajs team member. Built for @forwardemail, @spamscanner, @breejs, @cabinjs, and @lassjs.

Aws Mobile React Native Starter ⭐ 2,229

AWS Mobile React Native Starter App https://aws.amazon.com/mobile

S5cmd ⭐ 2,187

Parallel S3 and local filesystem execution tool.

Winscp ⭐ 2,185

WinSCP is a popular free SFTP and FTP client for Windows, a powerful file manager that will improve your productivity. It supports also Amazon S3, FTPS, SCP and WebDAV protocols. Power users can automate WinSCP using .NET assembly.

Minio Go ⭐ 2,168

MinIO Go client SDK for S3 compatible object storage

Pgbackrest ⭐ 2,051

Reliable PostgreSQL Backup & Restore

Notea ⭐ 2,011

📒 Self hosted note taking app stored on S3

Foundatio ⭐ 1,903

Pluggable foundation blocks for building distributed apps.

S3 Uploads ⭐ 1,856

The WordPress Plugin to Store Uploads on Amazon S3

Javakeeper ⭐ 1,766

✍️ Java 工程师必备架构体系知识总结：涵盖分布式、微服务、RPC等互联网公司常用架构，以及数据存储、缓存、搜索

Evaporatejs ⭐ 1,762

Javascript library for browser to S3 multipart resumable uploads

Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.

Tiledb ⭐ 1,700

The Universal Storage Engine

A self-hosted cloud disk base on the cloud storage./ 一个基于云存储的网盘系统，用于自建私人网盘或企业网盘。

S3proxy ⭐ 1,521

Access other storage backends via the S3 API

Bucket Stream ⭐ 1,447

Find interesting Amazon S3 Buckets by watching certificate transparency logs.

Byconity ⭐ 1,416

ByConity is an open source cloud data warehouse

Frontend ⭐ 1,346

The official @github repository of the Trovebox frontend software. A photo sharing and photo management web interface for data stored "in the cloud" (i.e. Amazon S3, Rackspace CloudFiles, Google Storage).

Leofs ⭐ 1,338

The LeoFS Storage System

Docker Volume Backup ⭐ 1,286

Backup Docker volumes locally or to any S3, WebDAV, Azure Blob Storage, Dropbox or SSH compatible storage

Piclist ⭐ 1,281

An image upload and manage tool, base on PicGo

Aws Toolkit Vscode ⭐ 1,253

Amazon Q, CodeWhisperer, CodeCatalyst, Local Lambda debug, SAM/CFN syntax, ECS Terminal, AWS resources

S4cmd ⭐ 1,249

Super S3 command line tool

Hasura Backend Plus ⭐ 1,167

🔑Auth and 📦Storage for Hasura. The quickest way to get Auth and Storage working for your next app based on Hasura.

📎 Flexible file upload and attachment library for Elixir

Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.

Clickhouse Backup ⭐ 1,133

Tool for easy ClickHouse backup and restore using object storage for backup files.

Terragoat ⭐ 1,071

TerraGoat is Bridgecrew's "Vulnerable by Design" Terraform repository. TerraGoat is a learning and training project that demonstrates how common configuration errors can find their way into production cloud environments.

S3 Lambda ⭐ 1,067

Lambda functions over S3 objects with concurrency control (each, map, reduce, filter)

Aistore ⭐ 980

AIStore: scalable storage for AI applications

Amazon S3 Php Class ⭐ 980

A standalone Amazon S3 (REST) client for PHP 5/CURL

S3 Sync Action ⭐ 960

🔄 GitHub Action to sync a directory with a remote S3 bucket 🧺

X File Storage ⭐ 950

一行代码将文件存储到本地、FTP、SFTP、WebDAV、谷歌云存储、阿里云OSS、华为云OBS、七牛云Kodo、腾讯云 BOS、又拍云USS、MinIO、 AWS S3、FastDFS、 Azure Blob Storage、金山云 KS3、美团云 MSS、京东云 OSS、天翼云 OOS、移动云 EOS、沃云 OSS、网易数帆 NOS、Ucloud US3、青云 QingStor、平安云 OBS、首云 OSS、IBM COS、其它兼容 S3 协议的平台。后续即将支持 Samba、NFS

Sneller ⭐ 947

World's fastest log analysis: λ + SQL + JSON + S3

Parliament ⭐ 937

AWS IAM linting library

A collection of bash shell scripts for automating various tasks with Amazon Web Services using the AWS CLI and jq.

Bareos is a cross-network Open Source backup solution (licensed under AGPLv3) which preserves, archives, and recovers data from all major operating systems.

Carthage cache for S3, Minio, Ceph, Google Storage, Artifactory and many others

AWS-S3 is a Ruby implementation of Amazon's S3 REST API

React S3 Uploader ⭐ 776

React component that renders an <input type="file"/> and automatically uploads to an S3 bucket

Aws Js S3 Explorer ⭐ 763

AWS JavaScript S3 Explorer is a JavaScript application that uses AWS's JavaScript SDK and S3 APIs to make the contents of an S3 bucket easy to browse via a web browser.

Scalable, redundant, and distributed object store for Apache Hadoop

Grafana Backup Tool ⭐ 751

A Python-based application to backup Grafana settings by using the Grafana API

A simple mock implementation of the AWS S3 API startable as Docker image, TestContainer, JUnit 4 rule, JUnit Jupiter extension or TestNG listener

S3 Bucket Listing ⭐ 667

Create nice directory listings for s3 buckets with javascript and HTML.

Aws Mobile React Sample ⭐ 649

A React Starter App that displays how web developers can integrate their front end with AWS on the backend. The App interacts with AWS Cognito, API Gateway, Lambda and DynamoDB on the backend.

S3_direct_upload ⭐ 648

Direct Upload to Amazon S3 With CORS

Dataengineeringproject ⭐ 644

Example end to end data engineering project.

Oio Sds ⭐ 634

High Performance Software-Defined Object Storage for Big Data and AI, that supports Amazon S3 and Openstack Swift

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

YAS3FS (Yet Another S3-backed File System) is a Filesystem in Userspace (FUSE) interface to Amazon S3. It was inspired by s3fs but rewritten from scratch to implement a distributed cache synchronized by Amazon SNS notifications. A web console is provided to easily monitor the nodes of a cluster.

Django S3direct ⭐ 602

Directly upload files to S3 compatible services with Django.

Goodreads_etl_pipeline ⭐ 593

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Storage ⭐ 553

S3 compatible object storage service that stores metadata in Postgres

Open Images Dataset ⭐ 551

Open Images is a dataset of ~9 million images that have been annotated with image-level labels and bounding boxes spanning thousands of classes.

S3 Benchmark ⭐ 536

Measure Amazon S3's performance from any location.

A fake S3 server written in NodeJs

Helm S3 ⭐ 527

⎈ Helm plugin that adds support for AWS S3 as a chart repository.

Ftpserver ⭐ 522

Golang based autonomous FTP server with SFTP, S3, Dropbox, and Google Drive connectors.

Go Storage ⭐ 499

A vendor-neutral storage library for Golang: Write once, run on every storage service.

Kafka Connect Ui ⭐ 494

Web tool for Kafka Connect |

S3backer ⭐ 490

FUSE/NBD single file backing store via Amazon S3

Faster deploy tool using tarballs and serf

S3 Plugin Webpack ⭐ 486

Uploads files to s3 after complete

Discharge ⭐ 483

⚡️ A simple, easy way to deploy static websites to Amazon S3.

Storage and image processing server written in Go

Related Searches

Amazon Web Services S3 (2,551)

Javascript S3 (1,284)

Python S3 (1,171)

Amazon S3 (1,059)

Upload S3 (773)

1-100 of 2,651 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.