How do i scrape users from the sc search bar

[Just A User]

Hi Martin, Hope all is well!

I want to blacklist some users, for example "David Guetta" If i type David Guetta in the search bar direct on soundcloud, I've found over 500 users.
How can i scrape a list with those users?

Regards

[martin@rootjazz]

When you perform a search on Soundcloud, in the top left you can see PEOPLE, TRACKS, PLAYLISTS.
The default view will show a selection of each. In SCM you need to pick one.

so PEOPLE would be USERNAME search - which is probably what you want as it will return profiles.

[Just A User]

Yes correct. So this would be the first search direct on sc - https://soundcloud.com/search?q=David%20Guetta
And this the second with user/people - https://soundcloud.com/search/people?q=David%20Guetta

I've tried the custom search, set on profile, and set custom search/ user search without any results
Also "scrape and search users" / search users without any results
(tried with both links)

Maybe this is the wrong starting point, but how can I do this?
I need a list of these https://soundcloud.com/search/people?q=David%20Guetta user.


Regards

[martin@rootjazz]

I've tried the custom search, set on profile, and set custom search/ user search without any results
Also "scrape and search users" / search users without any results
(tried with both links)

That should be correct. What did the search logs say? They should report an issue if nothing was found.

HELP > LOGS > SUBMIT

then send your logs ID - the first 4 numbers is sufficient (displayed after successful uploading of logs)

[Just A User]

real time logs, im getting this

Starting: 04.10.2019 20:22
Search: https://soundcloud.com/search/people?q=david%20guetta
Max: 20000
Processing search: https://soundcloud.com/search/people?q=david%20guetta custom_search
User Search
Max: 20000 globalmax: 10000
Max Results Wanted: 20000
Setup custom search controller
Custom search run: search: https://soundcloud.com/search/people?q=david%20guetta
Perform custom search: #chain/total: 1/1 User Search using:
One search stage detected, setting default per item per stage value to max: 20000
Start search: User Search with: https://soundcloud.com/search/people?q= ... tta(20000) using: No account
Page scraped
Current Results: 0
Results : 0 https://soundcloud.com/search/people?q=david%20guetta
drop out: no next url specified
Results of search: 0 User Search with: https://soundcloud.com/search/people?q=david%20guetta
Handle results: 0 nextstep: 2/1
End of chain: Store results: 0
Finished search: results: 0
Started: 04.10.2019 20:22
Finished: 04.10.2019 20:23
ID: e3fbbc48-12a1-4b3d-a396-df65a8da9f14
Action ran for: 0,00225642077777778hr:0min:8s

and ID: logs_64098

[martin@rootjazz]

Not sure what is going on. The response from Soundcloud does not contain any data. For me is working fine with latest version:

https://soundcloudmanager.com/updatetesting.html

Can you update and see if that version works better for you. If not, submit logs again as it will contain additional information about your issues

[Just A User]

sure, is updated since release 3.5.3.9
and i have to say, all the other scrape functions, e.g "scrape user reposted a track" or "followers of" etc working fine.

feels like scm can not working with these inputs\ starting point

https://soundcloud.com/search?q=david%20guetta
https://soundcloud.com/search/people?q=david%20guetta


Tried again with:

custom search, set on profile, build custom search - user search
(with both links)

and

search an scrape users
(with both links)


ID: logs_12166

[martin@rootjazz]

sure, is updated since release 3.5.3.9

that is not uptodate (latest branch). Please download the latest version from the link posted:

https://soundcloudmanager.com/updatetesting.html
3.543

feels like scm can not working with these inputs\ starting point

https://soundcloud.com/search?q=david%20guetta
https://soundcloud.com/search/people?q=david%20guetta

As I said, it is working fine here - which is what makes it strange. If it didn't work here then we can assume something has changed with the SC response which cannot be handled, but that is not the case.


So if you could update to latest version, then try again - it might be an issue with the older version you are on so we need to rule that out before investigating further



Regards,
Martin

[Just A User]

As I said, it is working fine here...

I believe that. v3.545 is installed and the same - no results.
what is your input/search link, and which settings?
maybe i have a mistake there.

Regards



P.S.:
i always update my scm in the software (help/update/stable)
when I was still on version 3.5.3.9, scm told me i'm up to date.

[martin@rootjazz]

i always update my scm in the software (help/update/stable)
when I was still on version 3.5.3.9, scm told me i'm up to date.

That isn't the latest version.

HELP > UPDATE > LATEST / TESTING

is the latest version. Stable is a few releases behind.


As to the issue. I have no idea why it isn't working. Will need to get you a new build to try and dump more info