scrape

[alexliff]

Hi Martin !

Could I scrape user reposted tracks owners?

Thanks !

[martin@rootjazz]

scraper tab

custom search

USER REPOSTED
ARTIST OF TRACK

then as the input, the artist whose reposts you want to scrape

[alexliff]

Thanks for the answer !
I've just tried it and didn't get results... Could you check it please?

Logs 95058

Code: Select all

* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
Page scraped
Current Results: 629
Results : 716 https://soundcloud.com/spinninrecords
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
Page scraped
Current Results: 716
Results : 805 https://soundcloud.com/spinninrecords
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
Page scraped
Current Results: 805
Results : 898 https://soundcloud.com/spinninrecords
Page scraped
Current Results: 898
Results : 993 https://soundcloud.com/spinninrecords
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
* ERROR: Value cannot be null.
Parameter name: source
Page scraped
Current Results: 993
Results : 1079 https://soundcloud.com/spinninrecords
* ERROR: Value cannot be null.
Parameter name: source
Page scraped
Current Results: 1079
Results : 1168 https://soundcloud.com/spinninrecords
* ERROR: Value cannot be null.
Parameter name: source
Page scraped
Current Results: 1168
Results : 1260 https://soundcloud.com/spinninrecords
Page scraped
Current Results: 1260
Results : 1337 https://soundcloud.com/spinninrecords
* ERROR: Value cannot be null.
Parameter name: source
Page scraped
Current Results: 1337
Results : 1366 https://soundcloud.com/spinninrecords
invalid nexturl - drop outnull?client_id=2t9loNQH90kzJcsFCODdigxfp325aq4z&app_version=1500563729
Results of search: User reposted with: https://soundcloud.com/spinninrecords
Handle results: 1366 nextstep: 1/2
Got results from chain: 1366 feed into next chained custom search item
Perform chained search: [1] https://soundcloud.com/spinnin-deep/olav-basoski-ft-spyder-waterman-2017-out-now
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/spinnin-deep/olav-basoski-ft-spyder-waterman-2017-out-now using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/spinnin-deep/olav-basoski-ft-spyder-waterman-2017-out-now Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/spinninsessions/spinnin-sessions-219-guestmix-yellow-claw
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/spinninsessions/spinnin-sessions-219-guestmix-yellow-claw using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/spinninsessions/spinnin-sessions-219-guestmix-yellow-claw Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/spinnincopyrightfreemusic/toak-feeling-me
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/spinnincopyrightfreemusic/toak-feeling-me using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/spinnincopyrightfreemusic/toak-feeling-me Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/catalin-iliescu-1/corey-james-back-in-time-preview-steve-angello-ultra-korea-2017
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/catalin-iliescu-1/corey-james-back-in-time-preview-steve-angello-ultra-korea-2017 using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/catalin-iliescu-1/corey-james-back-in-time-preview-steve-angello-ultra-korea-2017 Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/spinnincopyrightfreemusic/gianni-blu-all-i-wanna-do
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/spinnincopyrightfreemusic/gianni-blu-all-i-wanna-do using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/spinnincopyrightfreemusic/gianni-blu-all-i-wanna-do Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/edxmusic/edx-bloom-out-now-17-july-2017
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/edxmusic/edx-bloom-out-now-17-july-2017 using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/edxmusic/edx-bloom-out-now-17-july-2017 Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/cartelrecordings/tom-staar-gordon-edge-itsa-trumpet-thing-radio-edit
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/cartelrecordings/tom-staar-gordon-edge-itsa-trumpet-thing-radio-edit using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/cartelrecordings/tom-staar-gordon-edge-itsa-trumpet-thing-radio-edit Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/spinninrecords-talentpool/mr-raden-comeback-track-of-the-week-29
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/spinninrecords-talentpool/mr-raden-comeback-track-of-the-week-29 using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/spinninrecords-talentpool/mr-raden-comeback-track-of-the-week-29 Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/maxximizerecords/blasterjaxx-temple-radio-editout-now
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/maxximizerecords/blasterjaxx-temple-radio-editout-now using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/maxximizerecords/blasterjaxx-temple-radio-editout-now Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/doornrecords/purple-haze-contrast
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/doornrecords/purple-haze-contrast using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/doornrecords/purple-haze-contrast Object reference not set to an instance of an object.
Perform chained search: [1] https://soundcloud.com/source-recordings/tydi-summer-mix
Perform custom search: #chain/total: 2/2 using: 
Start search: Artist of track with: https://soundcloud.com/source-recordings/tydi-summer-mix using: No account
* ERROR: handleAResult: Term: https://soundcloud.com/source-recordings/tydi-summer-mix Object reference not set to an instance of an object.
* ERROR: Multiple consequtive fails, stopping action
Started: 22-07-2017 01:16 AM
Finished: 22-07-2017 01:16 AM
ID: dec12888-fe28-4ef9-bf63-c606ec24ea22
Action ran for: 0hr:0min:14s

[martin@rootjazz]

seems like SC changed something, checking now

[martin@rootjazz]

the fails are PLAYLIST REPOSTS, which technically aren't tracks, I think playlist were NOT repostable when this code was written but now are so were not handled.


Have added code to scrape track playlists now. Next update

[martin@rootjazz]

https://soundcloudmanager.com/updatetesting.html