Pinterest scraping

Ask any support / help / issues / problem or question related to TumblingJazz
Post Reply
ajaxxx
Posts: 2
Joined: Wed Sep 20, 2017 12:43 am

Pinterest scraping

Post by ajaxxx » Thu Oct 12, 2017 2:21 am

Describe what is going wrong:

Pinterest scraper only downloads 10 images.

Describe what was expected:

Pinterest scraper would download `Max Num To Download Each Run`

Describe the steps to replicate your issue. A list of instruction steps.

Go to: Image Scraper> Pinterest Scraper:

Term: cyberpunk
Save directory: select a paste
Times to run: 1
Starting: 11/10/2017 22:44 PM
Pull src: http://www.pinterest.com/search/pins/?q=cyberpunk
Download: https://i.pinimg.com/736x/3c/a2/43/3ca2 ... pt-art.jpg
Scraped: https://i.pinimg.com/736x/3c/a2/43/3ca2 ... pt-art.jpg
* SAVED: https://i.pinimg.com/736x/3c/a2/43/3ca2 ... pt-art.jpg to C:\Users\user\Desktop\Vapor2\3ca243bd5269a463520cb4a051bb6dfc--cyberpunk-art-cyberpunk-concept-art_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\3ca243bd5269a463520cb4a051bb6dfc--cyberpunk-art-cyberpunk-concept-art_3.jpg
Processed: 1 images
Download: https://i.pinimg.com/736x/1d/8a/c9/1d8a ... nk-art.jpg
Scraped: https://i.pinimg.com/736x/1d/8a/c9/1d8a ... nk-art.jpg
* SAVED: https://i.pinimg.com/736x/1d/8a/c9/1d8a ... nk-art.jpg to C:\Users\user\Desktop\Vapor2\1d8ac94544d15af2934b9a32ca57ab79--cyberpunk-anime-cyberpunk-art_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\1d8ac94544d15af2934b9a32ca57ab79--cyberpunk-anime-cyberpunk-art_3.jpg
Processed: 2 images
Download: https://i.pinimg.com/736x/63/88/dc/6388 ... c-city.jpg
Scraped: https://i.pinimg.com/736x/63/88/dc/6388 ... c-city.jpg
* SAVED: https://i.pinimg.com/736x/63/88/dc/6388 ... c-city.jpg to C:\Users\user\Desktop\Vapor2\6388dcaf00afae809f72dde9d2d3c8d7--cyberpunk-city-futuristic-city_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\6388dcaf00afae809f72dde9d2d3c8d7--cyberpunk-city-futuristic-city_3.jpg
Processed: 3 images
Download: https://i.pinimg.com/736x/20/6e/3c/206e ... antasy.jpg
Scraped: https://i.pinimg.com/736x/20/6e/3c/206e ... antasy.jpg
* SAVED: https://i.pinimg.com/736x/20/6e/3c/206e ... antasy.jpg to C:\Users\user\Desktop\Vapor2\206e3c6ef170bec325e4203d5176ad96--macabre-art-sci-fi-fantasy_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\206e3c6ef170bec325e4203d5176ad96--macabre-art-sci-fi-fantasy_3.jpg
Processed: 4 images
Download: https://i.pinimg.com/736x/54/dd/29/54dd ... rrings.jpg
Scraped: https://i.pinimg.com/736x/54/dd/29/54dd ... rrings.jpg
* SAVED: https://i.pinimg.com/736x/54/dd/29/54dd ... rrings.jpg to C:\Users\user\Desktop\Vapor2\54dd296f547fdef8c794f278a17089cc--cyberpunk-girl-pearl-earrings_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\54dd296f547fdef8c794f278a17089cc--cyberpunk-girl-pearl-earrings_3.jpg
Processed: 5 images
Download: https://i.pinimg.com/736x/89/d3/a7/89d3 ... nk-art.jpg
Scraped: https://i.pinimg.com/736x/89/d3/a7/89d3 ... nk-art.jpg
* SAVED: https://i.pinimg.com/736x/89/d3/a7/89d3 ... nk-art.jpg to C:\Users\user\Desktop\Vapor2\89d3a7d5ef61e4ab36e243ecc7a5bf3f--cyberpunk-tattoo-cyberpunk-art_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\89d3a7d5ef61e4ab36e243ecc7a5bf3f--cyberpunk-tattoo-cyberpunk-art_3.jpg
Processed: 6 images
Download: https://i.pinimg.com/736x/f4/e7/bf/f4e7 ... c-city.jpg
Scraped: https://i.pinimg.com/736x/f4/e7/bf/f4e7 ... c-city.jpg
* SAVED: https://i.pinimg.com/736x/f4/e7/bf/f4e7 ... c-city.jpg to C:\Users\user\Desktop\Vapor2\f4e7bfabe70037e6aca3c8c80afb7e22--cyberpunk-city-futuristic-city_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\f4e7bfabe70037e6aca3c8c80afb7e22--cyberpunk-city-futuristic-city_3.jpg
Processed: 7 images
Download: https://i.pinimg.com/736x/9f/d1/28/9fd1 ... nk-art.jpg
Scraped: https://i.pinimg.com/736x/9f/d1/28/9fd1 ... nk-art.jpg
* SAVED: https://i.pinimg.com/736x/9f/d1/28/9fd1 ... nk-art.jpg to C:\Users\user\Desktop\Vapor2\9fd1285be60cb486a89c9d00fd710bc9--cyberpunk-character-cyberpunk-art_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\9fd1285be60cb486a89c9d00fd710bc9--cyberpunk-character-cyberpunk-art_3.jpg
Processed: 8 images
Download: https://i.pinimg.com/736x/24/54/ed/2454 ... acters.jpg
Scraped: https://i.pinimg.com/736x/24/54/ed/2454 ... acters.jpg
* SAVED: https://i.pinimg.com/736x/24/54/ed/2454 ... acters.jpg to C:\Users\user\Desktop\Vapor2\2454ed6c556df5d9b421e74f775fda71--goth-art-marvel-characters_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\2454ed6c556df5d9b421e74f775fda71--goth-art-marvel-characters_3.jpg
Processed: 9 images
Download: https://i.pinimg.com/736x/76/1d/3f/761d ... design.jpg
Scraped: https://i.pinimg.com/736x/76/1d/3f/761d ... design.jpg
* SAVED: https://i.pinimg.com/736x/76/1d/3f/761d ... design.jpg to C:\Users\user\Desktop\Vapor2\761d3f8d82c7d4cc0e313a1f54bbca7a--cyberpunk-art-cyberpunk-design_3.jpg
* SAVED: meta for C:\Users\user\Desktop\Vapor2\761d3f8d82c7d4cc0e313a1f54bbca7a--cyberpunk-art-cyberpunk-design_3.jpg
Processed: 10 images
Scraped: 10 from: http://www.pinterest.com/search/pins/?q=cyberpunk
Scraped: 10 from: https://www.pinterest.com/resource/Sear ... 7772688644
Total Scraped: 10
Scraped: 10 from: https://www.pinterest.com/resource/Sear ... 7776288644
Total Scraped: 10
Scraped: 10 from: https://www.pinterest.com/resource/Sear ... 7779888644
Total Scraped: 10
Scraped: 10 from: https://www.pinterest.com/resource/Sear ... 7783488644
Total Scraped: 10
Started: 11/10/2017 22:44 PM
Finished: 11/10/2017 22:44 PM
ID: c1ff9bba-6de8-46c9-8682-f35e2fe528f5
Action ran for: 0hr:0min:23s
Repeat every: 24
No more repeats wanted: processed: 1/1

User avatar
martin@rootjazz
Site Admin
Posts: 14654
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Pinterest scraping

Post by martin@rootjazz » Thu Oct 12, 2017 5:50 pm

I think pinterest changed their scrolling which would have broken this.

I'll take a look

ajaxxx
Posts: 2
Joined: Wed Sep 20, 2017 12:43 am

Re: Pinterest scraping

Post by ajaxxx » Fri Oct 13, 2017 3:29 am

Cool, thanks.

By the way, I am also having issues with duplicated images (some times even 7 copies of the same image) when scraping from tumblr.
Is this a known issue that I can bypass, or should I also do a reporting?

User avatar
martin@rootjazz
Site Admin
Posts: 14654
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Pinterest scraping

Post by martin@rootjazz » Fri Oct 13, 2017 10:50 pm

ajaxxx wrote:
Fri Oct 13, 2017 3:29 am
Cool, thanks.

By the way, I am also having issues with duplicated images (some times even 7 copies of the same image) when scraping from tumblr.
Is this a known issue that I can bypass, or should I also do a reporting?
depends why you are getting a duplicate.
If the file has a different name and a different CRC, then technically it isn't the same image and the program cannot tell it looks exactly the same (but the byte pattern is not the same)

Post Reply