Skip to content

Issues: rmax/scrapy-redis

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
29 Open 164 Closed
29 Open 164 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt click/return to exclude labels
or ⇧ click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

scrapy_redis.scheduler.Scheduler not compatible with scrapy.dupefilters.BaseDupeFilter
#293 by HairlessVillager was closed Jul 6, 2024
1
Scrapy-redis usage related issues
#291 by Hao1617 was closed May 10, 2024
7
[QUESTION] Is there a way to use response.meta ?
#290 by SteliosGiannatos was closed Mar 19, 2024
1
There is a compatibility issue with the latest scrapy-redis package of the new version of scrapy
#289 by georgeJzzz was closed Apr 15, 2024
13
Add Kafka Topic Integration to Scrapy Redis
#288 by hamed21q was closed Aug 5, 2024
1
Add metadata to URLs to retrieve from Redis question
#287 by tteguayco was closed Nov 30, 2023
2
[dev] Add Type annotations
#282 by LuckyPigeon was closed Jun 5, 2023
Is there a planned support for Python3.11?
#273 by lion137 was closed May 30, 2023
2
5
Scrapy 2.8.0 deprecated function scrapy.utils.request.request_fingerprint() warning help wanted
#272 by ThanatosDi was closed May 30, 2023
2
1
Cleanup requirements improvement
#268 by devfox-se was closed May 30, 2023
1
1
警告： Passing a 'spider' argument to ExecutionEngine.crawl is deprecated question
#266 by maintain99 was closed May 31, 2023
4
日志报警：String request is deprecated
#265 by maintain99 was closed Dec 10, 2022
How to use scrapy-redis if I'm using start_requests() instead of start_urls in my spider? question
#264 by ashwinbala99 was closed Jan 8, 2023
3
你好，大佬，请问一个问题，我用scrapy-redis执行爬虫的时候，设置最大并发是20，但是怎么感觉像创建20个队列一样，上一个20执行完之后，下一个20再执行，大佬，您能为我解答一下吗，感激不尽 question
#263 by zhanghongdou was closed May 31, 2023
2
why I can not see request record in redis question
#262 by minikiller was closed May 30, 2023
2
[spiders] remove duplicate check setting types
#260 by LuckyPigeon was closed Aug 9, 2022
1
error object has no attribute 'make_requests_from_url' question
#257 by zhajingwen was closed Sep 17, 2022
2
Scrapy 2.6.1 Unsupport function make_requests_from_url to use improvement pending question
#250 by ihandmine was closed Sep 17, 2022
5
[style] Fix pylint style improvement
#245 by LuckyPigeon was closed Apr 9, 2022
2 tasks done
1
@LuckyPigeon
ImportError: cannot import name 'Iterable' from 'collections' question
#241 by milkeasd was closed Apr 3, 2022
2
Push json will failed
#238 by songhao8080 was closed Apr 1, 2022
1
Update basic settings good first issue help wanted improvement pending
#226 by LuckyPigeon was closed Apr 1, 2022
15 of 16 tasks
6
[docs] Move docs to github Wiki documentation
#224 by LuckyPigeon was closed Oct 2, 2022
[BUG] MySpider' object has no attribute 'settings' bug question
#217 by LuckyPigeon was closed Jan 14, 2022
1 task done
@LuckyPigeon
[IMPROVEMENT] Update support for json data bug good first issue improvement
#216 by LuckyPigeon was closed Mar 25, 2022
2 tasks
1
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.