Awesome Open Source

Programming Languages

Search results for python xpath

158 search results found

Rpa Python ⭐ 4,280

Python package for doing RPA

Ecommercecrawlers ⭐ 3,724

实战🐍多种网站、电商数据爬虫🕷。包含🕸：淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼

Reptile ⭐ 1,081

🏀 Python3 网络爬虫实战（部分含详细教程）猫眼腾讯视频豆瓣研招网微博笔趣阁小说百度热点 B站 CSDN 网易云阅读阿里文学百度股票今日头条微信公众号网易云音乐拉勾有道 unsplash 实习僧汽车之家英雄联盟盒子大众点评链家 LPL赛程台风梦幻西游、阴阳师藏宝阁天气牛客网百度文库睡前故事知乎 Wish

Parsel ⭐ 1,010

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Core Scrapy ⭐ 753

python-scrapy demo

Spider_python ⭐ 732

Python Spider ⭐ 680

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红

Webmonitor ⭐ 662

实时监控网页变化，并发送通知（Monitor web page changes in real time and send notifications）

高速uiautomator控件解析算法的Android Monkey, 每秒10-15个Action Event。实现快速DFS算法的Android Monkey , 每秒 5个Action Event。

Fbcrawl ⭐ 415

A Facebook crawler

dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators

Objectpath ⭐ 369

The agile query language for semi-structured data

XPath injection tool

Cssselect ⭐ 276

CSS Selectors for Python

Jsonpath Ng ⭐ 219

Finally, a JSONPath implementation for Python that aims to be standard compliant. That's all. Enjoy it.

Aispider ⭐ 208

爬虫轻型框架

基于python3+selenium+unittest的WebUI自动化测试框架，使用POM(页面对

Requests Xml ⭐ 189

Requests-XML: XML Parsing for Humans

Pythoncrawler ⭐ 175

python3网络爬虫笔记与实战源码。记录python爬虫学习全程笔记、参考资料和常见错误，约40个 pytesseract、PIL等常用库的使用。

Astpath ⭐ 172

A command-line search utility for Python ASTs using XPath syntax.

Crawlerproject ⭐ 147

爬虫项目：链家网（普通/scrapy）、虎扑、维基百科、百度地图api、房天下（分布式爬虫）、微信公

Easy way for HTML parsing and building XPath

a command-line web scraping tool

Wxapp Appium ⭐ 124

基于Appium的微信小程序自动化测试方案

A module for querying the DOM tree and writing XPath expressions using native Python syntax.

XPATH to CSS translator

adbui 是一个 uiautomator 的 python 库，adbui 的特色是可以通过属性， xpath，ocr 等获取 ui 元素。

A spider... ^.^

Python Notes ⭐ 103

Python related technologies used in work: crawler, data analysis, timing tasks, RPC, page parsing, decorator, built-in functions, Python objects, multi-threading, multi-process, asynchronous, redis, mongodb, mysql, openstack, etc.

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题；HTTP协议介绍； Requests使用；解析器Xpath介绍； MongoDB与MySQL；多线程爬虫； Scrapy介绍；Scrapy-redis介绍；使用docker部署；使用nomad管理docker集群；使用EFK查询docker日志

Svg Objects Export ⭐ 102

Export multiple SVG elements to other formats (png, pdf, ps, eps, svg), selecting them based on their ID with regular expressions, or XPath expression.

A python based cross-platform tool that automates the process of detecting and exploiting error-based injection security flaws.

Openscraper ⭐ 80

An open source webapp for scraping: towards a public service for webscraping

Ru Scrapy Python ⭐ 79

Scrapy: примеры и полезная информация собранная участниками telegram чата @scrapy_python

Mailwebsitechanges ⭐ 64

Python script to keep track of website updates; sends email notifications and provides RSS2 feed

Serverless Web Differ ⭐ 60

A serverless web browser which crawls websites and compares pages by schedule.

easy crawl web resource , extract web infomation/简单的爬虫框架

Pyastgrep ⭐ 59

Grep Python Abstract Syntax Trees (AST) using XPath

Telenium ⭐ 56

Automation for Kivy Application

Selectorlib ⭐ 55

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

Googleforms ⭐ 48

🎯 Simply Hack Google Forms.

spider framework and utils written by python

Crawler Chrome Extensions ⭐ 46

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

Fengspider ⭐ 45

自己学习爬虫有关的经验总结和在网上看到的一些好的爬虫例子

Python Xextract ⭐ 45

Extract structured data from HTML and XML documents like a boss.

Navigating around a grid of cells like XPath for spreadsheets; supports Python 3.5+

Itemloaders ⭐ 41

Library to populate items using XPath and CSS with a convenient API

Sublime Xpath ⭐ 41

Sublime Text plugin for easier cursor navigation of XML and HTML files using XPath 1.0.

Vim Xpath ⭐ 41

XPath search plugin for Vim

Like jq, but for XML and XPath.

XML for Humans in Python

Alto Tools ⭐ 36

Python tools for performing various operations on ALTO XML files

Tigerspider ⭐ 36

tigerspider: a fast high-level screen scraping and web crawling framework for Python.

Django Xml ⭐ 35

A python module which provides an abstraction to lxml's XPath and XSLT functionality in a manner resembling django database models.

Spparser ⭐ 34

an async ETL tool written in Python.

Web UI Automated Testing Framework, combining Selenium with Python. Testers don't need to know how to code; they just need to write configurations to achieve their goals. Additionally, the framework is designed to be easily extendable for testers who are proficient in coding.WEB UI自动化测试框架，selenium结合python，测试人员不需要会代码，只需要写配置即可实现，并

Utilities for using XPath to map XML data to Python objects and Django forms

JinjaFx - Jinja2 Templating Tool

Seleniumwrapper ⭐ 32

selenium webdriver wrapper to make manipulation easier.

Powerful command-line tool for slicing & dicing HTML

Jupyterhub Samlauthenticator ⭐ 31

jupyterhub-samlauthenticator

Configurable Python Web Scraper

Realtime Browser Element Verification Tool [Stable]

北京大学金融科技协会Python系列讲座，Lecture notes & Extended reading

A full text RSS generator which can hosted on google app engine

Data_extractor ⭐ 26

Combine XPath, CSS Selectors and JSONPath for Web data extracting.

Webcomix ⭐ 26

Webcomic downloader

Advanced XPath Injection Tool

Python36 ⭐ 25

These are python sample projects which are written in python

⚠️ THIS REPO IS DEPRECATED ⚠️ Python library to compare two XML trees and generate a set of actions that transform one into the other

Clixpath ⭐ 25

Command-line tool to easily extract data from HTML or XML documents. Produces machine readable output.

Temario y ejercicios de Desarrollo de Aplicaciones Multiplataforma (DAM)

Waybackscraper ⭐ 24

Scrapes a website archives using Python's asyncio and aiohttp.

Python Crawler ⭐ 23

爬虫学习仓库，适合零基础的人学习，对新手比较友好

Guanchazhe_spider ⭐ 23

观察者新闻网爬虫（新闻爬虫），基于python+Flask+Echarts，实现首页与更多新闻页面爬

Webscraping Selenium ⭐ 22

webscraping using selenium python

Codechef Rank Comparator ⭐ 21

Web application hosted on Heroku cloud platform based on web scraping in python using lxml library (XML Path Language).

Gui Form Brut ⭐ 21

Scrapyuniversal ⭐ 20

基于Scrapy的通用爬虫框架

Trackupdates ⭐ 20

A simple yaml-based xpath crawler framework for easy tracking site updates. https://zhupeng.github.io/

Simplespider ⭐ 20

A library of Spider which can simpify the code.

V2ex_spider ⭐ 19

Python Webscrapes ⭐ 19

This repo contains materials of my talk at PyData Seattle 2017

Amazon Mobile Sentiment Analysis ⭐ 18

Opinion mining of Mobile reviews on Amazon platform

Eulexistdb ⭐ 18

Utilities for accessing and searching objects in an eXist-db XML database using idiomatic Python, XPath, and XQuery

Xpath.py ⭐ 18

Python library for generating XPath expressions

Xianyu_spider ⭐ 17

闲鱼APP数据爬虫

Bitcointalkspider ⭐ 17

Using scrapy to crawl some dates from www.bitcointalk.org and store data in Mongodb，also can plot it by pylab.

Faucetcryptobot ⭐ 17

A bot for FaucetCrypto a cryptocurrency faucet. The bot can currently claim PTC ads, main reward and all the shortlinks except exe.io and fc.lc.

Dougroupbot ⭐ 17

Auto-Comment Bot for Douban | 豆瓣小组机器人，自动头排评论有趣内容

Parsel Cli ⭐ 17

cli for evaluating css and xpath selectors

jquery-based python-pure implementation of CSS Selectors, good for using with google app engine

Personal Wechatplus ⭐ 16

微信遇上爬虫（获取热点新闻，自动回复，爬虫控制，傲梦编程教师端数据的自动抓取和检索）

Python Client ⭐ 16

Babelfish Python client

Youtube Auto Likes And Subscribe ⭐ 15

Youtube Auto Likes And Subscribe & Community Post Like With Python

Lazyscraper ⭐ 15

Lazy helper tool to make easier scraping with simple tasks

Gis Metadata Parser ⭐ 15

Parser for GIS metadata standards including ArcGIS, FGDC and ISO-19115

Python-API for the OpenGeoSys (http://www.opengeosys.org) software.

Scrapyproject ⭐ 13

Scrapy项目（mysql+mongodb豆瓣top250电影）

Finally, a commandline xpath tool for linux that is easy to use.

Related Searches

Python Django (26,307)

Python Machine Learning (20,195)

Python Flask (17,643)

Python Dataset (14,792)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Command Line (13,351)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Network (11,495)

1-100 of 158 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.