Aws Pdf Textract Pipeline

🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript

Categories > Data Processing > Pipeline

Suggest Alternative

Stars

148

License

mit

Open Issues

Most Recent Commit

5 months ago

Programming Language

TypeScript

Categories

Programming Languages > Typescript

Cloud Computing > Amazon Web Services

Data Processing > Pipeline

Computer Science > Stack

Cloud Computing > Lambda Functions

Cloud Computing > Serverless

Software Quality > Jest

Cloud Computing > S3

Cloud Computing > Cloudformation

Data Processing > Web Crawler

Repo

Alternatives To Aws Pdf Textract Pipeline

Project Name	Stars	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Ayakashi	177	2	a year ago	40	June 29, 2023	8	other	TypeScript
:zap: Ayakashi.io - The next generation web scraping framework
Aws Pdf Textract Pipeline	148		5 months ago			5	mit	TypeScript
:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Crawl Anywhere	98		7 years ago			38	other	PHP
Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration.
Dotnetcrawler	63		5 years ago					C#
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

Alternatives To Aws Pdf Textract Pipeline

Select To Compare

Ayakashi ⭐ 177

:zap: Ayakashi.io - The next generation web scraping framework

dependent packages 2total releases 40most recent commit a year ago

Aws Pdf Textract Pipeline ⭐ 148

:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript

most recent commit 5 months ago

Crawl Anywhere ⭐ 98

Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration.

most recent commit 7 years ago

Dotnetcrawler ⭐ 63

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-w

most recent commit 5 years ago

Suggest An Alternative To aws-pdf-textract-pipeline

Alternative Project Comparisons

Aws Pdf Textract Pipeline vs Ayakashi

Aws Pdf Textract Pipeline vs Crawl Anywhere

Aws Pdf Textract Pipeline vs Dotnetcrawler

Popular Pipeline Projects

Nushell ⭐ 28,304

A new type of shell

dependent packages 82total releases 77latest release November 20, 2023most recent commit 5 months ago

Jina ⭐ 19,573

☁️ Build multimodal AI applications with cloud-native stack

dependent packages 16total releases 2,453latest release December 01, 2023most recent commit 5 months ago

Luigi ⭐ 17,046

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

dependent packages 76total releases 80latest release October 05, 2023most recent commit 5 months ago

Vector ⭐ 16,326

A high-performance observability data pipeline.

total releases 3latest release March 13, 2021most recent commit 3 months ago

Argo Cd ⭐ 15,229

Declarative Continuous Deployment for Kubernetes

dependent packages 65total releases 359latest release December 01, 2023most recent commit 5 months ago

Popular Web Crawler Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 5 months ago

Huginn ⭐ 42,091

Create agents that monitor and act on your behalf. Your agents are standing by!

dependent packages 52total releases 8latest release September 22, 2017most recent commit 8 days ago

Changedetection.io ⭐ 13,943

The best and simplest free open source website change detection, website watcher, restock monitor and notification service. Restock Monitor, change detection. Designed for simplicity - Simply monitor which websites had a text change for free. Free Open source web page change detection, Website defacement monitoring, Price change notification

most recent commit 5 months ago

Crawlee ⭐ 12,832

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

dependent packages 42total releases 747latest release December 10, 2023most recent commit a day ago

Crawlab ⭐ 10,521

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

total releases 1latest release March 03, 2019most recent commit 6 months ago

Popular Data Processing Categories