taoxic / python-tools Public

Notifications You must be signed in to change notification settings
Fork 1
Star 1

基于scrapy框架实现的爬虫

1 star 1 fork Branches Tags Activity

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
crawler		crawler
crawlerConfluence		crawlerConfluence
README.md		README.md
urlToPdf.py		urlToPdf.py

Repository files navigation

Python-tools

1.crawler

2.crawlerConfluence

该爬虫可以根据目录结构接口，抓取对应wiki文档的urls

3.urlToPdf.py

可以使用 urlToPdf.py 将 url 生成 pdf 文档

安装 wkhtmltopdf

[https://wkhtmltopdf.org/downloads.html]

$wkhtmltopdf -V

安装 pdfkit

$pip install pdfkit

Reference

[1]https://scrapy.org/
[2]https://github.com/scrapy/scrapy