在线时间:8:00-16:00
132-9538-2358
迪恩网络APP
随时随地掌握行业动态
扫描二维码
关注迪恩网络微信公众号
##README爬取到的新闻数据:
当前的settings.py经过调试相对比较稳定,不要轻易修改!!!
settings.py
当前,所有爬虫增量抓取的开关已经打开,如果需要,可以手动关闭,/spiders/***.py文件的FLAG_INTERRUPT = True常量
/spiders/***.py
FLAG_INTERRUPT = True
证券日报 2007.09.17~ http://zqrb.ccstock.cn/ scrapy crawl zqrb
scrapy crawl zqrb
证券时报 2010.12.17~ http://epaper.stcn.com/paper/zqsb/html/2010-12/17/node_2.htm scrapy crawl zqsb
scrapy crawl zqsb
证券日报网http://www.ccstock.cn/finance/hongguanjingji/index.htmlhttp://www.ccstock.cn/finance/hangyedongtai/index.htmlhttp://www.ccstock.cn/gscy/gongsi/index.htmlhttp://www.ccstock.cn/gscy/qiyexinxi/index.htmlscrapy crawl zqrbw
scrapy crawl zqrbw
南华早报http://www.nanzao.com/sc/business/more-business-newshttp://www.nanzao.com/sc/national/more-national-news'scrapy crawl nhzb'
中国经营网http://www.cb.com.cn/deep/http://www.cb.com.cn/economy/http://www.cb.com.cn/companies/'scrapy crawl zgjyw'
经济观察报http://www.eeo.com.cn/politics/bjxx/http://www.eeo.com.cn/politics/shengyin/http://www.eeo.com.cn/politics/shuju/http://www.eeo.com.cn/nation/shiju/http://www.eeo.com.cn/comment/commentsygc/commentsygccjsd/http://www.eeo.com.cn/comment/commentsygc/commentsygczcxj/http://www.eeo.com.cn/comment/commentsygc/commentsygccyzs/'scrapy crawl jjgcb'
财经网http://economy.caijing.com.cn/economynews/http://economy.caijing.com.cn/observation/http://economy.caijing.com.cn/economics/http://economy.caijing.com.cn/region/http://economy.caijing.com.cn/policy/http://economy.caijing.com.cn/report/http://industry.caijing.com.cn/industrianews/http://industry.caijing.com.cn/steel/index.htmlhttp://industry.caijing.com.cn/energy/http://industry.caijing.com.cn/aviations/http://industry.caijing.com.cn/traffic/http://industry.caijing.com.cn/food/http://industry.caijing.com.cn/medicals/http://industry.caijing.com.cn/consumption/http://industry.caijing.com.cn/industrys/‘scrapy crawl cjw’
证券时报网http://news.stcn.com/xwyw/‘scrapy crawl zqsbw’
中证网http://www.cs.com.cn/xwzx/hg/http://www.cs.com.cn/xwzx/cj/http://www.cs.com.cn/ssgs/gsxw/三个分类必须分开运行‘scrapy crawl zzw’
华尔街见闻http://wallstreetcn.com/news?status=published&type=news&cid=17&order=-created_at&limit=100&page=1http://wallstreetcn.com/news?status=published&type=news&cid=22&order=-created_at&limit=100&page=1scrapy crawl hejjw深圳新闻网http://www.sznews.com/news/node_141128.htmhttp://www.sznews.com/news/node_150507.htmhttp://www.sznews.com/news/node_237320.htmhttp://www.sznews.com/news/node_109926.htm
scrapy crawl hejjw
##参与贡献Fork 本仓库
如果你觉得对你有用,打赏下作者吧:
评论
请发表评论