Blog Image Scraper Failing

TumblingJazz Tumblr bot discussion
Post Reply
daithicvd
Posts: 11
Joined: Mon Aug 14, 2017 8:32 am

Blog Image Scraper Failing

Post by daithicvd » Sat Dec 23, 2017 4:08 am

Hi Martin

I've only used the blog image scraper once before a few months ago and had no issues with it but have tried to use it today on one of my blogs and I keep getting the following error:

* ERROR: Exception of type 'TumblingJazz.Scrapers.TumblrImageScraper.ExNoPostsOnPage' was thrown.

Is this isolated to me?

Happy Christmas!

support@rootjazz
Posts: 1528
Joined: Tue Feb 02, 2016 1:58 pm

Re: Blog Image Scraper Failing

Post by support@rootjazz » Sat Dec 23, 2017 4:48 am

daithicvd wrote:
Sat Dec 23, 2017 4:08 am
Hi Martin

I've only used the blog image scraper once before a few months ago and had no issues with it but have tried to use it today on one of my blogs and I keep getting the following error:

* ERROR: Exception of type 'TumblingJazz.Scrapers.TumblrImageScraper.ExNoPostsOnPage' was thrown.

Is this isolated to me?

Happy Christmas!
Hi,

This error says that the blog has no posts and i am not sure but perhaps your blog has some nsfw content which is causing this problem as tumblr preventing users / sometime visitors to view nsfw content. Or your blog has no content / posts.

But, i have replicated your issue by going to tumblingjazz scrape images tab
Clickedd on blog images downloader on the left side
Set the term url / blog url ( http://tumblrsfunniest.tumblr.com/ )
Selected save directory
Checked do not save meta file
Clicked scrape images.

I saw the image scraper is working fine. here is the log.
Have you done the same as i did? If not, can you please try with my steps and let me know?
If not working, can you please provide the blog url to me - thus is can check it for you?

Code: Select all

Processed: 7 images
Processed: 8 images
Processed: 9 images
Got pages: -1
Do page: http://tumblrsfunniest.tumblr.com/page/2
Found: 4 images on : http://tumblrsfunniest.tumblr.com/page/2
Looping: 4images with: 4 threads
Download: http://78.media.tumblr.com/211977354ea6c1cac8a362adfe7bdf4f/tumblr_inline_nmwgiwFNls1qfi9r0_250.png
Download: http://78.media.tumblr.com/32bb7b4f501f4be0368a70e34ccbe4ad/tumblr_mi8vo2z3Vv1rlq7g4o1_500.gif
Download: http://78.media.tumblr.com/232b6825bda5e7726c0c97454875a98d/tumblr_nmj2qoLsaF1r2alapo1_500.jpg
Download: http://78.media.tumblr.com/fcafb2c3140e235244f7b15b91601ab8/tumblr_nlkgmy5uer1qh57wao1_500.png
* SAVED: http://78.media.tumblr.com/211977354ea6c1cac8a362adfe7bdf4f/tumblr_inline_nmwgiwFNls1qfi9r0_250.png to C:\Users\USER\Desktop\test folder\tumblr_inline_nmwgiwFNls1qfi9r0_250.png
* SAVED: http://78.media.tumblr.com/32bb7b4f501f4be0368a70e34ccbe4ad/tumblr_mi8vo2z3Vv1rlq7g4o1_500.gif to C:\Users\USER\Desktop\test folder\tumblr_mi8vo2z3Vv1rlq7g4o1_500.gif
* SAVED: http://78.media.tumblr.com/232b6825bda5e7726c0c97454875a98d/tumblr_nmj2qoLsaF1r2alapo1_500.jpg to C:\Users\USER\Desktop\test folder\tumblr_nmj2qoLsaF1r2alapo1_500.jpg
* SAVED: http://78.media.tumblr.com/fcafb2c3140e235244f7b15b91601ab8/tumblr_nlkgmy5uer1qh57wao1_500.png to C:\Users\USER\Desktop\test folder\tumblr_nlkgmy5uer1qh57wao1_500.png
Processed: 10 images
Processed: 11 images
Processed: 12 images
Processed: 13 images
Do page: http://tumblrsfunniest.tumblr.com/page/3
Found: 12 images on : http://tumblrsfunniest.tumblr.com/page/3
Looping: 12images with: 4 threads
Download: http://78.media.tumblr.com/7c3af8b4b1749781a4c680a8984738bc/tumblr_inline_n3hdqv4dxh1s5rg4f.gif
Download: http://78.media.tumblr.com/dc83d3a1d8f6388a092ca8c5f7c00a61/tumblr_n1bgene74w1runaefo1_1280.jpg
Download: http://78.media.tumblr.com/tumblr_mdhne3FkBL1qcbh43o1_500.jpg
Download: http://78.media.tumblr.com/f21af9697a224b3c81ae6ee794b421a2/tumblr_inline_njl1giwE2P1r3la3n.jpg
* SAVED: http://78.media.tumblr.com/7c3af8b4b1749781a4c680a8984738bc/tumblr_inline_n3hdqv4dxh1s5rg4f.gif to C:\Users\USER\Desktop\test folder\tumblr_inline_n3hdqv4dxh1s5rg4f.gif
* SAVED: http://78.media.tumblr.com/dc83d3a1d8f6388a092ca8c5f7c00a61/tumblr_n1bgene74w1runaefo1_1280.jpg to C:\Users\USER\Desktop\test folder\tumblr_n1bgene74w1runaefo1_1280.jpg
* SAVED: http://78.media.tumblr.com/f21af9697a224b3c81ae6ee794b421a2/tumblr_inline_njl1giwE2P1r3la3n.jpg to C:\Users\USER\Desktop\test folder\tumblr_inline_njl1giwE2P1r3la3n.jpg
* SAVED: http://78.media.tumblr.com/tumblr_mdhne3FkBL1qcbh43o1_500.jpg to C:\Users\USER\Desktop\test folder\tumblr_mdhne3FkBL1qcbh43o1_500.jpg
Processed: 14 images
Download: http://78.media.tumblr.com/52a6ce004b72199a8878d50ef96f3599/tumblr_nhok6tKurw1sjap36o1_1280.jpg
Processed: 15 images
* SAVED: http://78.media.tumblr.com/52a6ce004b72199a8878d50ef96f3599/tumblr_nhok6tKurw1sjap36o1_1280.jpg to C:\Users\USER\Desktop\test folder\tumblr_nhok6tKurw1sjap36o1_1280.jpg
Download: http://78.media.tumblr.com/54cf537efd646ac6d3ce880e7250b9aa/tumblr_mfia8i1ts01r3vccgo1_250.gif
* SAVED: http://78.media.tumblr.com/54cf537efd646ac6d3ce880e7250b9aa/tumblr_mfia8i1ts01r3vccgo1_250.gif to C:\Users\USER\Desktop\test folder\tumblr_mfia8i1ts01r3vccgo1_250.gif
Processed: 16 images
Download: http://78.media.tumblr.com/be423ecc5a56569775e2ffa0a738642d/tumblr_n2jh9qiqzS1qcecwvo1_500.jpg
* SAVED: http://78.media.tumblr.com/be423ecc5a56569775e2ffa0a738642d/tumblr_n2jh9qiqzS1qcecwvo1_500.jpg to C:\Users\USER\Desktop\test folder\tumblr_n2jh9qiqzS1qcecwvo1_500.jpg
Processed: 17 images
Download: http://78.media.tumblr.com/f371ec35fd456257c6ca16e4fab9cb38/tumblr_inline_njl19t29y61r3la3n.jpg
* SAVED: http://78.media.tumblr.com/f371ec35fd456257c6ca16e4fab9cb38/tumblr_inline_njl19t29y61r3la3n.jpg to C:\Users\USER\Desktop\test folder\tumblr_inline_njl19t29y61r3la3n.jpg
Processed: 18 images
Download: http://78.media.tumblr.com/e1567b551e156332ca14d54119eade72/tumblr_njn6ifsUFH1qewacoo1_540.jpg
* SAVED: http://78.media.tumblr.com/e1567b551e156332ca14d54119eade72/tumblr_njn6ifsUFH1qewacoo1_540.jpg to C:\Users\USER\Desktop\test folder\tumblr_njn6ifsUFH1qewacoo1_540.jpg
Processed: 19 images
Download: http://78.media.tumblr.com/7612ddfdf154e4d2eef95850fd13a01b/tumblr_inline_njl1d5cxsL1r3la3n.jpg
* SAVED: http://78.media.tumblr.com/7612ddfdf154e4d2eef95850fd13a01b/tumblr_inline_njl1d5cxsL1r3la3n.jpg to C:\Users\USER\Desktop\test folder\tumblr_inline_njl1d5cxsL1r3la3n.jpg
Processed: 20 images
Download: http://78.media.tumblr.com/c9314e0d020fc09cac080feee830a808/tumblr_njavjv3XTC1se9pwmo1_500.jpg
* SAVED: http://78.media.tumblr.com/c9314e0d020fc09cac080feee830a808/tumblr_njavjv3XTC1se9pwmo1_500.jpg to C:\Users\USER\Desktop\test folder\tumblr_njavjv3XTC1se9pwmo1_500.jpg
Processed: 21 images
Processed: 22 images
Processed: 23 images
Processed: 24 images
Download: http://78.media.tumblr.com/1ca8bb0219fd4ddf801cb55daed62d64/tumblr_nj9mcuK0B21r2alapo1_1280.jpg
* SAVED: http://78.media.tumblr.com/1ca8bb0219fd4ddf801cb55daed62d64/tumblr_nj9mcuK0B21r2alapo1_1280.jpg to C:\Users\USER\Desktop\test folder\tumblr_nj9mcuK0B21r2alapo1_1280.jpg
Processed: 25 images
Do page: http://tumblrsfunniest.tumblr.com/page/4
Found: 7 images on : http://tumblrsfunniest.tumblr.com/page/4
Looping: 7images with: 4 threads
Download: http://78.media.tumblr.com/c2db97a263952c1efaf2e35ed05462da/tumblr_mxk7at3IIO1qjnhqgo1_500.jpg
Download: http://78.media.tumblr.com/5232fa52a09bffa4503fb33e2e7f593f/tumblr_nistz3SutD1u6tp65o1_400.gif
Download: http://78.media.tumblr.com/262b259f2d2e4fe930ffec4120ff67fc/tumblr_nj4eoowyAj1u43daio2_1280.jpg
Download: http://78.media.tumblr.com/de2cc3b9b6bf4035e79679f168de963b/tumblr_mycgb8uEK61r3gb3zo1_400.gif
* SAVED: http://78.media.tumblr.com/5232fa52a09bffa4503fb33e2e7f593f/tumblr_nistz3SutD1u6tp65o1_400.gif to C:\Users\USER\Desktop\test folder\tumblr_nistz3SutD1u6tp65o1_400.gif
* SAVED: http://78.media.tumblr.com/c2db97a263952c1efaf2e35ed05462da/tumblr_mxk7at3IIO1qjnhqgo1_500.jpg to C:\Users\USER\Desktop\test folder\tumblr_mxk7at3IIO1qjnhqgo1_500.jpg
* SAVED: http://78.media.tumblr.com/262b259f2d2e4fe930ffec4120ff67fc/tumblr_nj4eoowyAj1u43daio2_1280.jpg to C:\Users\USER\Desktop\test folder\tumblr_nj4eoowyAj1u43daio2_1280.jpg
* SAVED: http://78.media.tumblr.com/de2cc3b9b6bf4035e79679f168de963b/tumblr_mycgb8uEK61r3gb3zo1_400.gif to C:\Users\USER\Desktop\test folder\tumblr_mycgb8uEK61r3gb3zo1_400.gif
Processed: 26 images
Download: http://78.media.tumblr.com/e21692d08df5def4bbc650bea17b3a25/tumblr_niubnqMQAN1rjx9uao1_500.jpg
* SAVED: http://78.media.tumblr.com/e21692d08df5def4bbc650bea17b3a25/tumblr_niubnqMQAN1rjx9uao1_500.jpg to C:\Users\USER\Desktop\test folder\tumblr_niubnqMQAN1rjx9uao1_500.jpg
Processed: 27 images
Download: http://78.media.tumblr.com/1b05c086ec12cfce760db5f659519b18/tumblr_ne1638yHod1sab7fpo1_1280.jpg
* SAVED: http://78.media.tumblr.com/1b05c086ec12cfce760db5f659519b18/tumblr_ne1638yHod1sab7fpo1_1280.jpg to C:\Users\USER\Desktop\test folder\tumblr_ne1638yHod1sab7fpo1_1280.jpg
Processed: 28 images
Download: http://78.media.tumblr.com/3c699c1ce68ac699941db3ac4bd93884/tumblr_nfxk1a7rpq1qaogiro1_1280.jpg
* SAVED: http://78.media.tumblr.com/3c699c1ce68ac699941db3ac4bd93884/tumblr_nfxk1a7rpq1qaogiro1_1280.jpg to C:\Users\USER\Desktop\test folder\tumblr_nfxk1a7rpq1qaogiro1_1280.jpg
Processed: 29 images
Processed: 30 images
Processed: 31 images
Processed: 32 images
Started: 22/12/2017 20:43 PM
Finished: 22/12/2017 20:46 PM
ID: 1996b7bb-92b4-4c29-b45e-129fd185af9d
Action ran for: 0hr:3min:13s
Repeat every: 24
Run Next: 2017-12-23 8:46 PM
Scheduled to: 2017-12-23 8:46 PM



Happy christmas to you too! :)
Best Regards

User avatar
martin@rootjazz
Site Admin
Posts: 15967
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Blog Image Scraper Failing

Post by martin@rootjazz » Sat Dec 23, 2017 4:06 pm

if the RSS feed is NSFW, your account must be NSFW in order to view the images.

I imagine you must NOT be in safe mode either

(both can be set from the SETTINGS TAB)
https://rootjazz.com/tumblingjazz/updatetesting.html

If that doesn't fix it.



Please perform the following:

Open the program. Delete or pause all existing actions. If actions are already running due to autorun on startup, disable autorun at startup and restart the app. All actions must be waiting, then pause all (or delete)


Delete existing logs
HELP > LOGS > VIEW
delete all files in the folder that opens


Perform the action:
***

run your scrape action
submit logs
***

PLEASE NOTE: Do not perform other actions at the same time. Only use one thread. Do not run any actions after this action.


Then submit logs:
HELP > LOGS > SUBMIT

and let me know the LOGS ID (just the number part is sufficient)


With the holidays, it is going to be a few days until I get the change to look after the logs (after 27th), sorry for any inconvenience


Regards,
Martin

daithicvd
Posts: 11
Joined: Mon Aug 14, 2017 8:32 am

Re: Blog Image Scraper Failing

Post by daithicvd » Tue Dec 26, 2017 8:29 am

Logs ID - 93625

You are right - it is a NSFW blog but it is also the same blog that I successfully ran a scrape of the one other time I preformed this action.

The scraper worked with the SFW blog you posted

I also couldn't find the NSFW settings in the settings tab as you mentioned but the account is marked as NSFW in Tumblr and in TJ the Filter Out NSFW is unchecked.

Again - nothing urgent so no rush and no inconvenience caused. Appreciate the help as always

support@rootjazz
Posts: 1528
Joined: Tue Feb 02, 2016 1:58 pm

Re: Blog Image Scraper Failing

Post by support@rootjazz » Fri Dec 29, 2017 6:36 am

I have reported it to martin and he will check the log and reply here back as soon as possible. :)


Regards

User avatar
martin@rootjazz
Site Admin
Posts: 15967
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Blog Image Scraper Failing

Post by martin@rootjazz » Fri Dec 29, 2017 6:16 pm

daithicvd wrote:
Tue Dec 26, 2017 8:29 am
Logs ID - 93625

You are right - it is a NSFW blog but it is also the same blog that I successfully ran a scrape of the one other time I preformed this action.
this will be something to do with it. Let me look into it and get back to you

User avatar
martin@rootjazz
Site Admin
Posts: 15967
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Blog Image Scraper Failing

Post by martin@rootjazz » Fri Dec 29, 2017 6:28 pm

ok, yes that is the issue. Currently not possible to scrape images from BLOG SCRAPER module, as you will need to specify a tumblr blog which can log in before the scrape.


My apologies, I was confusing this with the RSS feed module where this issue was solved already. I'll fix it for the next update




Regards,
Martin


daithicvd
Posts: 11
Joined: Mon Aug 14, 2017 8:32 am

Re: Blog Image Scraper Failing

Post by daithicvd » Sun Dec 31, 2017 12:49 am

Thanks Martin. All working at this end again. Appreciate your help

support@rootjazz
Posts: 1528
Joined: Tue Feb 02, 2016 1:58 pm

Re: Blog Image Scraper Failing

Post by support@rootjazz » Mon Jan 01, 2018 4:38 am

:)

Post Reply