scrapy crawl test -s JOBDIR=data -0 items.csv
watch -n 1 -d 'wc -l items.csv;du -h items.csv'
附数据 items.csv
http://hackerxu.com/2014/09/07/scrapy-jd.html