Awesome Open Source

Programming Languages

Search results for java scraper

53 search results found

Webmagic ⭐ 11,080

A scalable web crawler framework for Java.

Jsoup ⭐ 10,463

jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.

Newpipeextractor ⭐ 1,070

NewPipe's core library for extracting data from streaming sites

Instagram4j ⭐ 875

📷 Instagram private API in Java

Javmoviescraper ⭐ 618

Scrape XBMC and Kodi movie metadeta and automatically rename files for Japanese Adult Videos (JAV), American Adult DVDs, and American Adult Webcontent

Jvppeteer ⭐ 549

Headless Chrome For Java （Java 爬虫）

Instagram Java Scraper ⭐ 401

Instagram Java Scraper. Get account information, photos, videos and comments.

Java Spider ⭐ 276

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集

Jsoup Annotations ⭐ 244

Jsoup Annotations POJO

Youtube Comment Suite ⭐ 220

Download YouTube comments from numerous videos, playlists, and channels for archiving, general search, and showing activity.

Screenslicer ⭐ 159

Automatic, zero-config web scraping -- written in Java, has no dependency on Java EE or app servers, and the web scraper has a restful/JSON API. Currently unmaintained.

Ctenopharyngodon Idella ⭐ 125

Hadoop, MapReduce Distributed Crawling of Data Information from All Chinese Universities. （Hadoop,mapreduce分布式爬取掌上高考的所有中国大学数据）

Your preferred open source focused crawler for the deep web.

Tinypornmanager ⭐ 67

A Pornhub.com scraper addon for tinyMediaManager v4

Introwebscraping ⭐ 60

Code exemple for my blog posts

🎼 Expandable lyrics-scraping API for Java

Android Scratchoutview ⭐ 49

高仿刮奖效果的View 可以设置刮开多少比例范围自动显现 - Scratch card effect view , and can set the scraping what percentage range automatically displayed below ui

Lezhin Comics Downloader ⭐ 48

📥 Downloader for lezhin comics

Tiktoklivejava ⭐ 44

Java implementation of TikTok-Live-Connector library. Receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

Scraping Microservice Java Python Rabbitmq ⭐ 40

A sample web scraping service demonstrating how to build a message driven application using RabbitMQ

Facebookcrawler ⭐ 39

Facebook Crawler - Crawl information from facebook

:octocat:A Fast and Powerful Scraping and Web Crawling Framework.

Socialinfo4j ⭐ 36

fetch data from Facebook, Instagram and LinkedIn

Vehicleinfoocr ⭐ 35

Use your camera to read number plates and obtain vehicle details. Simple, ad-free and faster alternative to existing playstore apps

Stormscraper ⭐ 29

A Storm based web crawler with Cassandra backend

Webgrude ⭐ 27

A java annotation library for Web scraping.

Prometheus Scraper ⭐ 25

A Java API that can be used to scrape Prometheus endpoints.

Twitterscraper4j ⭐ 22

a java library which scrapes twitter to fetch publicly available info

Crawling Framework ⭐ 21

Easily crawl news portals or blog sites using Storm Crawler.

Data Collection System For NLP/Speech Recognition

Scoopi Scraper ⭐ 20

Scoopi Web Scraper is a heavy duty tool to extract data from HTML pages.

Findmyiphone ⭐ 20

Find your iPhone by scraping the MobileMe site and turning it into a simple REST API

Android Scraper Club ⭐ 19

https://android.scraperclub.com This is an experimental technique to share mobile phones as scraper workers coordinated over a central server. Since these are all normal phones running normal android with normal mobile ip's they are indistinguishable from typical mobile users.

Spring Boot Web Scraper ⭐ 16

Simple web scrapping app made using Spring Boot + Thymeleaf + Jsoup + Java 8 Lambdas & Streams

Gumtree Scraper ⭐ 16

Are you looking for an apartment on gumtree.pl? You will like this a lot.

Google Grp Scraper ⭐ 14

It scraps all the topics present in any google group link and add them to HD of your machine

Serritor ⭐ 13

Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaScript to render data.

A simple web scraper built around the JavaFX WebEngine

Yelp Scraper ⭐ 12

Yelp Scraper for hassle-free public Yelp data collection, including search results, comments, profiles, posts, and more.

Universal Web Scraper ⭐ 12

Scrapes data from any website provided with a template target for it to fetch

Venom Tutorial ⭐ 12

A tutorial based on your preferred open source focused crawler for the deep web.

Steam Scraper ⭐ 11

Scrapes categories/genres/user tags from the Steam store pages and adds them as categories in the Steam client.

Bobik_java_sdk ⭐ 11

Web scraping in Java using remote bots

Web Scraping ⭐ 11

Code samples of web scraping using Java.

Motogp Api ⭐ 11

MotoGP Api: Library that reads the results of the MotoGP, 500cc, Moto2 and Moto3 classes from a website.

Semantic Web Scraper ⭐ 10

caustic lets you build scrapers in JSON, and run them on an android device.

Fantasy Football Database ⭐ 9

Fantasy football data scraping and projections.

Android Scrapper ⭐ 9

This project is uploaded as a demo to showcase various components and patterns

Googleplayscraper ⭐ 9

Simple web scraper to get app information from Google Play

Metric Registrar Examples ⭐ 9

Examples on how to use metric registrar endpoint scraping

Quora Loader ⭐ 9

A realtime read-only locator and extraction library for Quora questions and answers.

Resto Menu ⭐ 9

Android app and website scraper for the UGent resto's menu

Google Play Scraper Java ⭐ 8

A clone of https://github.com/facundoolano/google-play-scrape as Java version, with Retrofit and JavaRx

Invesdwin Webproxy ⭐ 8

A parallel download manager for web scraping that supports proxy servers

Sportsapi ⭐ 8

R, Python, Java: Scrapes and Handles Sports Data from the Web

Gotz - Heavy duty ETL to automate data extraction from tons of HTML pages

Musicreleasetracker ⭐ 7

Music Release Tracker finds latest songs from your favourite artists. No accounts needed.

Imdb Scraper ⭐ 7

A java class to get IMDb information of movies, series, etc

Xebia Essentials Android ⭐ 7

Android app that interacts with the Xebia Essentials cards

Structured Data Scraping Extension ⭐ 7

WebCombine. An early prototype of the technology that would eventually become the Helena web automation tool.

Born2crawl ⭐ 7

A highly performant and versatile crawling engine, designed with scalability and extensibility in mind.

Kotlin Headlessbrowser Selenium Jsoup Parser ⭐ 7

kotlin製のスクレイパーです

Pubfetcher ⭐ 6

A Java command-line tool and library to download and store publications with metadata by combining content from various online resources

Leetcodescraper ⭐ 6

A powerful multicore scraper and analyser for LeetCode contests.

Infk Uebungsscraper Java ⭐ 6

get all your exercises with one click

Vehicleinfoocr ⭐ 6

Vehicle-info-app

Giua Webscraper ⭐ 5

A webscraper of the online school workbook giua@school

Duckduckgo ⭐ 5

An unofficial Duckduckgo.com API with performance and simplicity in mind

Url Resolver Android Simple ⭐ 5

A simple apk to test how node-urlresolver-api works

Hackomaha Council Agendas ⭐ 5

City Council Agendas

Timetable Scraper Java ⭐ 5

UWO timetable scraper in Java

Scalable web crawling service

Smart Crawler ⭐ 5

A smart distributed crawler that infers navigation models of structured websites, used to cluster pages based on their structure and extract data from them.

Work in progress

Related Searches

Java Spring (21,350)

Java Spring Boot (11,982)

Java Gradle (8,113)

Java Video Game (8,093)

Java Docker (6,180)

Java Database (6,015)

Java Mysql (5,954)

Java Sdk (5,864)

Javascript Java (5,468)

Java Rest (4,956)

1-53 of 53 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.