备份豆瓣计划

These are python sample projects which are written in python

这是一个基于 asyncio、aiohttp 构建的高性能异步爬虫框架，支持分布式架构和插件化扩展。框架提供灵活的任务优先级队列（支持 RabbitMQ、Redis 和内存），适用于任意场景下的需求。无论是个人学习还是企业级应用，它都能助您高效完成爬取目标！

JScanner2：基于Playwright的递归扫描工具，动态抓取内容，JS深度解析，四重去重，识别敏感信息，AI代码分析...

基于scrapy的通用爬虫框架

LeetCode💪中文站的爬虫🐞，使用Java实现

Majora is a complete proxy IP construction cluster solution for proxy IP pool supply chain systems. If you have a large number of network devices (VPS servers, router devices, mobile devices, etc.) that can access the internet, you can use these network devices to easily build your proxy IP pool.

一款简易的小说爬取工具

CaptchaBypass

Web Link Crawler: A Python script to crawl websites and collect links based on a regex pattern. Efficient and customizable.

爬虫框架文件

go语言从零搭建分布式网络爬虫

おもちゃ

puppeteer抓取微博指数

Scraping web pages and convert to clean, readable Markdown files.

业余时间写的go小工具脚本

Distributed Management Framework Based on Scrapy and Scrapyd

An open source GPA query tool for Shanghai Ocean University - Node Backend

新浪账号批量刷新工具,phantomjs不支持官方npm包(需重新编译),因此以server/client模式实现,web模拟操作外的逻辑都在client中,新版以electron实现,简单清晰很多,这是过时的phantomjs版

(Sponsor ❤️) provide with calendar to observe international 🇺🇲🇪🇺🇯🇵🇨🇭🇨🇦🇬🇧🇦🇺🇳🇿 's economic event data trends so they can plan quarterly short-term swing trades