Skip to content

Pull requests: code4craft/webmagic

New pull request New
Clear current search query, filters, and sorts
30 Open 207 Closed
30 Open 207 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

主要增加下载功能
#430 by brucezee was closed Jan 21, 2017 Loading…
6
主要是修改请求间隔、错误状态码重试。按我的理解所做的小修改。
#1168 by niuxiaozu was closed Jun 17, 2024 Loading…
6
[Fix] #698 修复使用Redis,Request丢失附加信息问题
#702 by jianyun8023 was merged Nov 30, 2017 Loading…
5
多个代理的管理
#128 by yxssfxwzy was merged May 27, 2014 Loading…
4
update:PatternHandler
#94 by sebastien-ma was merged Apr 13, 2014 Loading…
4
perfect Spider.run to avoid some rare concurrent issue, change the Sp…
#1033 by carl-don-it was merged Aug 4, 2021 Loading…
1
4
stopWhenComplete，增加动态修改完成时停止方法。
#1169 by niuxiaozu was merged Jun 17, 2024 Loading…
4
Request支持设置header与cookie、新增POST请求时,XML、JSON参数支持、Page支持获取响应header
#513 by xbynet was merged Apr 2, 2017 Loading… WebMagic-0.7.0
4
简化POST参数设置. enhancement
#447 by xbynet was merged Mar 16, 2017 Loading… WebMagic-0.7.0
4
增加IP代理认证功能
#196 by jwlyn was closed May 8, 2016 Loading… WebMagic-0.6.0
4
增加无信任证书使用https，和添加无key的cookie
#358 by emaisi was closed Jan 21, 2017 Loading…
3
update the script
#93 by friddle was merged Apr 7, 2014 Loading…
3
Update FileCacheQueueScheduler.java
#157 by zhugw was merged Sep 11, 2014 Loading…
3
修复RedisScheduler时候Json转化出错
#202 by hzceo was closed Jun 3, 2017 Loading…
3
DatabaseScheduler for storing requests in Database and MultiSitesSpider
#391 by pascalheraud was closed Nov 18, 2016 Loading…
3
主要是对代理的功能进行了增加和修改
#976 by yaoqiangpersonal was merged Dec 29, 2020 Loading…
3
绕过安全证书
#444 by jimmy-zha was merged Jan 18, 2017 Loading… WebMagic-0.6.1
3
修正site.setHttpProxy()不起作用的bug enhancement
#198 by okuc was merged Mar 9, 2015 Loading… WebMagic-0.6.0
3
如果在开始爬取之前已经知道了所有要爬取的连接地址，可在Spider中通过addurl(list)来实现
#345 by starier was closed Nov 25, 2016 Loading…
2
new feature: PatternProcessor
#86 by sebastien-ma was merged Apr 4, 2014 Loading…
2
added support of groovy
#79 by linkerlin was closed Apr 13, 2014 Loading…
2
Upgrade Apache Commons Collections to v3.2.2
#269 by ProgramMax was closed Mar 6, 2017 Loading…
2
删除构造函数防止误用
#666 by w41ter was closed Dec 14, 2021 Loading…
2
groovy demo
#408 by jeffersonzhou was merged Dec 2, 2016 Loading…
2
[Fix] #698 修复使用Redis,Request丢失附加信息问题
#700 by jianyun8023 was closed Nov 29, 2017 Loading…
2
ProTip! Mix and match filters to narrow down what you’re looking for.