Results not being saved after scraping notes
Posted: Wed Mar 27, 2019 3:38 pm
Hi, I'm scraping notes from posts and the results are not being saved most times. After the task tuns the saved file has 0 bytes. I'm using Version 1.9.5.6 and have tried 1.9.5.7 still having the same issue
The log ends like this
17:21:44: Total scrape: 6512/900000
17:21:44: Next page rel: /svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552942622
17:21:44: Next page: https://www.tumblr.com/svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552942622
17:21:44: Pull notes url: https://www.tumblr.com/svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552942622
17:21:45: Total scrape: 6542/900000
17:21:45: Next page rel: /svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552939496
17:21:45: Next page: https://www.tumblr.com/svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552939496
17:21:45: Pull notes url: https://www.tumblr.com/svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552939496
17:21:50: * FAILED pull notesSrc: https://xxxxx.tumblr.com/post/183116417483/dont-kill-yourself-please#notes
17:21:50: Scraped: 0 from: https://xxxxx.tumblr.com/post/183116417483/dont-kill-yourself-please#notes
17:21:50: Total scraped: 0
17:21:50: Results of search: Scrape Notes Of Post with: https://xxxxx.tumblr.com/post/183116417483/dont-kill-yourself-please#notes
17:21:51: Paused for 1secs
17:21:51: Handle results: 0 nextstep: 2/1
17:21:51: End of chain: Store results: 0
17:21:51: Finished search: results: 0
17:21:51: Save results: 0
17:21:51: Saved: 0 to C:\Users\MK\AppData\Roaming\rootjazz\Tumbling Jazz\saved\scraped_custom_user_httpsxxxxxtumblrcompost183116417483dontkillyourselfpleasenotes_2019-03-27.txt
17:21:51: Started: 27/03/2019 16:58 PM
Finished: 27/03/2019 17:21 PM
ID: 29892c61-12b1-4874-809c-3b4e2026c223
17:21:51: Action ran for: 0hr:23min:25s
17:21:51: finished processThread: scrapelists 29892c61-12b1-4874-809c-3b4e2026c223
The log ends like this
17:21:44: Total scrape: 6512/900000
17:21:44: Next page rel: /svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552942622
17:21:44: Next page: https://www.tumblr.com/svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552942622
17:21:44: Pull notes url: https://www.tumblr.com/svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552942622
17:21:45: Total scrape: 6542/900000
17:21:45: Next page rel: /svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552939496
17:21:45: Next page: https://www.tumblr.com/svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552939496
17:21:45: Pull notes url: https://www.tumblr.com/svc/tumblelog/xxxxx/183116417483/notes?mode=rollup&before_timestamp=1552939496
17:21:50: * FAILED pull notesSrc: https://xxxxx.tumblr.com/post/183116417483/dont-kill-yourself-please#notes
17:21:50: Scraped: 0 from: https://xxxxx.tumblr.com/post/183116417483/dont-kill-yourself-please#notes
17:21:50: Total scraped: 0
17:21:50: Results of search: Scrape Notes Of Post with: https://xxxxx.tumblr.com/post/183116417483/dont-kill-yourself-please#notes
17:21:51: Paused for 1secs
17:21:51: Handle results: 0 nextstep: 2/1
17:21:51: End of chain: Store results: 0
17:21:51: Finished search: results: 0
17:21:51: Save results: 0
17:21:51: Saved: 0 to C:\Users\MK\AppData\Roaming\rootjazz\Tumbling Jazz\saved\scraped_custom_user_httpsxxxxxtumblrcompost183116417483dontkillyourselfpleasenotes_2019-03-27.txt
17:21:51: Started: 27/03/2019 16:58 PM
Finished: 27/03/2019 17:21 PM
ID: 29892c61-12b1-4874-809c-3b4e2026c223
17:21:51: Action ran for: 0hr:23min:25s
17:21:51: finished processThread: scrapelists 29892c61-12b1-4874-809c-3b4e2026c223