Awesome Open Source

Programming Languages

Search results for python s3

703 search results found

Awesome Aws ⭐ 11,514

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

A library that allows you to easily mock out tests based on AWS infrastructure.

Clearml ⭐ 4,443

ClearML - Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management

S3cmd ⭐ 4,127

Official s3cmd repo -- Command line tool for managing Amazon S3 and CloudFront services

Wal E ⭐ 3,327

Continuous Archiving for Postgres

Smart_open ⭐ 2,876

Utils for streaming large files (S3, HDFS, gzip, bz2...)

S3scanner ⭐ 1,940

Scan for open S3 buckets and dump the contents

Bucket Stream ⭐ 1,447

Find interesting Amazon S3 Buckets by watching certificate transparency logs.

S4cmd ⭐ 1,249

Super S3 command line tool

Parliament ⭐ 896

AWS IAM linting library

Bareos is a cross-network Open Source backup solution (licensed under AGPLv3) which preserves, archives, and recovers data from all major operating systems.

Grafana Backup Tool ⭐ 680

A Python-based application to backup Grafana settings by using the Grafana API

Dataengineeringproject ⭐ 644

Example end to end data engineering project.

YAS3FS (Yet Another S3-backed File System) is a Filesystem in Userspace (FUSE) interface to Amazon S3. It was inspired by s3fs but rewritten from scratch to implement a distributed cache synchronized by Amazon SNS notifications. A web console is provided to easily monitor the nodes of a cluster.

Django S3direct ⭐ 602

Directly upload files to S3 compatible services with Django.

Oio Sds ⭐ 596

High Performance Software-Defined Object Storage for Big Data and AI, that supports Amazon S3 and Openstack Swift

Goodreads_etl_pipeline ⭐ 593

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Pypicloud ⭐ 476

S3-backed pypi server implementation

S3monkey ⭐ 403

A Python library that allows you to interact with Amazon S3 Buckets as if they are your local filesystem.

S3viewer ⭐ 399

Storage Explorer - Publicly open storage viewer (Amazon S3 Bucket, Azure Blob, FTP server, HTTP Index Of/)

Python library for AWS Access Policy Language creation

Django S3 Storage ⭐ 386

Django Amazon S3 file storage.

NoDB isn't a database.. but it sort of looks like one.

Paaster ⭐ 316

Paaster is a secure and user-friendly pastebin application that prioritizes privacy and simplicity. With end-to-end encryption and paste history, Paaster ensures that your pasted code remains confidential and accessible.

Cloudpathlib ⭐ 292

Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

S3 Parallel Put ⭐ 277

Parallel uploads to Amazon AWS S3

A simple python S3 upload library. Inspired by requests

Astro Sdk ⭐ 260

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Megabots ⭐ 256

🤖 State-of-the-art, production ready LLM apps made mega-easy, so you don't have to build them from scratch 🤯 Create a bot, now 🫵

Yolov5 Pip ⭐ 255

Packaged version of ultralytics/yolov5 + many extra features

Pysparkling ⭐ 253

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

S3 Tests ⭐ 250

Compatibility tests for S3 clones

S3contents ⭐ 228

Jupyter Notebooks in S3 - Jupyter Contents Manager implementation

Boto_rsync ⭐ 228

An rsync-like utility using boto's S3 and Google Storage interfaces. [DEPRECATED -- Use awscli instead]

Flask Cloudy ⭐ 219

A Flask extension to access, upload, download, save and delete files on cloud storage providers such as: AWS S3, Google Storage, Microsoft Azure, Rackspace Cloudfiles, and even Local file system

Bucketstore ⭐ 217

A simple library for interacting with Amazon S3.

Glacier_deep_archive_backup ⭐ 211

Extremely low cost, off-site backup/restore using AWS S3 Glacier Deep Archive

Amazon S3 Find And Forget ⭐ 209

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

Sqs S3 Logger ⭐ 183

Automated serverless logging to S3 via SQS.

S3transfer ⭐ 166

Amazon S3 Transfer Manager for Python

a python Path interface for file and cloud bucket storage

S3_disk_util ⭐ 164

Like `du` but for S3

Flask S3 ⭐ 164

Seamlessly serve your static assets of your Flask app from Amazon S3

S3 Account Search ⭐ 162

S3 Account Search

Chrome Prerender ⭐ 162

Render JavaScript-rendered page as HTML/PDF/mhtml/png/jpeg using Headless Chrome

s3path is a pathlib extension for AWS S3 Service

Tiledb Py ⭐ 159

Python interface to the TileDB storage engine

Smart Zoneminder ⭐ 155

Fast object detection, face recognition and S3 upload of ZoneMinder alarms.

Yum S3 Iam ⭐ 154

Yum package manager plugin for private S3 repositories. Uses Amazon IAM & EC2 Roles.

Aws Inventory ⭐ 150

Python script for AWS resources inventory (cheaper than AWS Config)

FestIn - S3 Bucket Weakness Discovery

S3 Multipart ⭐ 149

Utilities to do parallel upload/download with Amazon S3

Datajoint Python ⭐ 147

Relational data pipelines for the science lab

Mlflow Docker ⭐ 146

Ready to run docker-compose configuration for ML Flow with Mysql and Minio S3

Toolkit for storing files and attachments in web applications

Sumologic Aws Lambda ⭐ 143

A collection of lambda functions to collect data from Cloudwatch, Kinesis, VPC Flow logs, S3, security-hub and AWS Inspector

S3 Credentials ⭐ 143

A tool for creating credentials for accessing S3 buckets

S3 Pit Restore ⭐ 139

The new home for the s3-pit-restore tool!

Benji Backup: A block based deduplicating backup software for Ceph RBD images, iSCSI targets, image files and block devices

Python Aws S3 ⭐ 130

Demo of AWS S3 Walkthrough using Python

Amazon S3 Resumable Upload ⭐ 129

Amazon S3 MultiThread Resume Migration Solution (Amazon S3多线程断点续传迁移方案)

Asyncio compatible SDK for aws services.

Prefect Docker Compose ⭐ 121

A simple guide to understand Prefect and make it work with your own docker-compose configuration.

Docker Registry Manifest Cleanup ⭐ 120

Cleans up docker registry by removing untagged manifests from the registry

Cloud Volume ⭐ 112

Read and write Neuroglancer datasets programmatically.

Python Requests Aws ⭐ 112

AWS authentication for Amazon S3 for the python requests module

Parquet Tools ⭐ 111

easy install parquet-tools

S3_uploader ⭐ 109

An S3 File Uploader GUI written in Python

S3funnel ⭐ 104

multithreaded command line tool for Amazon's Simple Storage Service (S3)

locopy: Loading/Unloading to Redshift and Snowflake using Python.

Flask S3 Uploader ⭐ 96

A simple project to show how to use Flask with Amazon S3 to enable user's uploaded files to be stored directly to an S3 bucket

Sci Pype ⭐ 96

A Machine Learning API with native redis caching and export + import using S3. Analyze entire datasets using an API for building, training, testing, analyzing, extracting, importing, and archiving. This repository can run from a docker container or from the repository.

Simples3 ⭐ 93

Simple, quick Amazon AWS S3 interface in Python

K.E.V. (Keys, Extras, and Values) is a Python ORM for key-value stores based on Valley. Currently supported backends are Redis, S3, and a S3/Redis hybrid backend. Based on Valley.

Dbt Athena ⭐ 89

The athena adapter plugin for dbt (https://getdbt.com)

browsr 🗂️ a pleasant file explorer in your terminal

Synapse S3 Storage Provider ⭐ 85

Synapse storage provider to fetch and store media in Amazon S3

Historical ⭐ 85

A serverless, event-driven AWS configuration collection service with configuration versioning.

Django Minio Backend ⭐ 85

Minio Backend for Django

Frappe Attachments S3 ⭐ 84

A frappe app to upload file attachments in doctypes to s3.

Megvii FILE Library - Working with Files in Python

Heroku Django S3 ⭐ 80

A clean Django project running on Heroku with static files served from Amazon S3.

Api Examples ⭐ 77

CANedge API Examples for MDF4/S3

Cloudstorage ⭐ 76

Unified cloud storage API for storage services.

Python Remotezip ⭐ 75

Python module to access single members of a zip archive without downloading the full content from a remote web server.

[Python + Flask] DFile: A fancy S3-based file sharing mode

Sandcastle ⭐ 72

🏰 A Python script for AWS S3 bucket enumeration.

Aws Deployment ⭐ 70

Instructions to deploy django, django channels to AWS

Django S3file ⭐ 70

A lightweight file upload input for Django and Amazon S3

Skull stripping and brain tissue segmentation

Scrapy S3pipeline ⭐ 66

Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.

Insp3ctor ⭐ 66

AWS S3 Bucket/Object Finder

Virtual Waiting Room On Aws ⭐ 65

Virtual Waiting Room on AWS solution helps absorb and control incoming user requests to your website during an unusually large burst of traffic, usually due to a large-scale event.

S3_objects_check ⭐ 64

Whitebox evaluation of effective S3 object permissions, to identify publicly accessible files.

Tools for running OCR against files stored in S3

S3cmd Modification ⭐ 62

Modification of the s3cmd by s3tools.org to add parallel downloads and uploads. Forked as of revision 437.

Container able to run on a Kubernetes cluster, providing S3-compatible endpoints to applications.

S3 Backups ⭐ 61

S3 Backups provides easy scripts that system administrators can use to backup data from programs likes PostgreSQL, MySQL, Redis, etc.

Maintain YUM repositories of RPM packages on S3, intelligently.

Django Uploadify S3 ⭐ 59

A Django application that makes it easy to integrate the Uploadify uploader and Amazon S3 into your project.

Related Searches

Python Python3 (857,414)

Python Django (26,307)

Python Deep Learning (19,480)

Python Machine Learning (18,457)

Python Ml (18,457)

Python Pytorch (15,739)

Python Flask (15,633)

Python Dataset (14,792)

Python Docker (14,113)

Python Tensorflow (13,736)

1-100 of 703 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2023 Awesome Open Source. All rights reserved.