python爬虫项目合集，从基础到js逆向，包含基础篇、自动化篇、进阶篇以及验证码篇。案例涵盖各大网站(xhs douyin weibo ins boss job，jd...)，你将会学到有关爬虫以及反爬虫、自动化和验证码的各方面知识

python3网络爬虫笔记与实战源码。记录python爬虫学习全程笔记、参考资料和常见错误，约40个爬取实例与思路解析，涵盖urllib、requests、bs4、jsonpath、re、 pytesseract、PIL等常用库的使用。

A simple distributed crawler for zhihu && data analysis

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

Processes XML sitemaps and extracts URLs. Includes features such as support for both plain XML and compressed XML files, multiple input sources, protection against anti-bot measures, multi-threading, and automatic processing of nested sitemaps.

Python Crawler

基于 Playwright 的自主 AI 搜索智能体。支持迭代式任务规划、深度网页爬取，以及带引用来源的多源知识整合。

It's designed to be a simple, tiny, pratical python crawler using json and sqlite instead of mysql or mongdb. The destination website is Zhihu.com.

🐍A collection of simple Python crawlers.

豆瓣电影爬虫: 电影信息 + 影评 + 短评

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

这是也一个爬虫教学的项目

This repo is mainly for dynamic web (Ajax Tech) crawling using Python, taking China's NSTL websites as an example.

just for python learning.

支持多种爬取方式，下载用户相册，爬取用户帖子，爬取实时搜索帖子等，欢迎下载使用和补充功能

🐍🗺️ This Python script empowers you to scrape data from Google Maps, enabling extraction of valuable information like addresses, reviews, and ratings. 📋🏢⭐

大三课设。本项目是一个基于Django框架的股票分红数据爬虫和展示系统。它可以从东方财富网站爬取股票分红数据，并将数据存储到Django数据库中，同时提供数据查询、导出和图表展示功能。

Python airline/flights data crawler

keep watching new bug bounty (vulnerability) postings.

a simple web of data visualization