Steps to scrap

Ask any support / help / issues / problem or question related to any of our other products
Post Reply
aquamax
Posts: 2
Joined: Sat Nov 14, 2020 11:37 am

Steps to scrap

Post by aquamax » Sat Nov 14, 2020 11:40 am

Hello everyone, I've just downloaded the soundcloud manager, and I wanna use it as email scraper.
Can someone please help me ? I cannot understand how to do it.
Thanks!!!

User avatar
martin@rootjazz
Site Admin
Posts: 26208
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Steps to scrap

Post by martin@rootjazz » Sat Nov 14, 2020 3:33 pm

Hi, there are two ways


1) you first scrape a list of profiles via any searches you wish.
Then at the top of the SCRAPE tab is the EMAIL SCRAPER function, specify the filepath of your SC profiles to check.
Click the PROXIES button if you want to use proxies (recommended for big scrapes)
Optional check SCRAPE PROFILE DETAILS if you want some basic details about the profile with the email, unchecked just get the emails and nothing else



2) Run a normal search and check the box SCRAPE EMAILS RETURNED BY SEARCHES.
Warning, SOME searches will return the profile and the bio details which are used to scrape the emails. However, not all searches do. Forexample, the
SCRAPE TRACKS: title / genre / date uploade / length search I know DOES include this information, so if you are performing a scrape of all HOUSE tracks uploaded last_day, you can get the emails in one go.

I have a feeling FOLLOWERS scrape does NOT include bio details so this would not return emails and you would need to run a separate EMAIL SCRAPE action on the results file.




Regards,
Martin

aquamax
Posts: 2
Joined: Sat Nov 14, 2020 11:37 am

Re: Steps to scrap

Post by aquamax » Sat Nov 14, 2020 4:40 pm

hi guys! can you please help me with a live help? like teamworks or similar? thanks a lot

User avatar
martin@rootjazz
Site Admin
Posts: 26208
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Steps to scrap

Post by martin@rootjazz » Sun Nov 15, 2020 2:54 pm

Sorry, 1 to 1 support is not provided. Please go through the instructions above. If you have any specific issues, please detail what is not working.

For future reference, please, read through this post and submit your issue accordingly. Not everything will be relevant to your issue, but have a read as it gives an idea of the information you can provide to help me help you as quickly as possible without delays in having to request additional information :)

https://rootjazz.com/forum/viewtopic.php?f=23&t=1634



Regards,
Martin

sam2020
Posts: 4
Joined: Fri Nov 20, 2020 7:55 pm

scrap likers

Post by sam2020 » Fri Nov 20, 2020 8:06 pm

hi martin
how to scrap likers of a hashtag in a specified location؟

for example :
likers hashtag "car" in london?

please help me .... thank you

User avatar
martin@rootjazz
Site Admin
Posts: 26208
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: scrap likers

Post by martin@rootjazz » Sat Nov 21, 2020 3:11 pm

sam2020 wrote:
Fri Nov 20, 2020 8:06 pm
hi martin
how to scrap likers of a hashtag in a specified location
Firstly, you can ONLY perform searches in SCM that you can perform within soundcloud.com.

Can you perform this search on the website? You can scrape tracks, then scrape the likers. But you cannot apply a location parameter to this search.

You can search for users (username search) with a location option. But then you don't get track genre information.

Soundcloud doesn't permit it. It's one of the other.


Now what you can try is to do the track genre > likers search. Then put a FILTER on the results to include users from a specific location. HOWEVER, this is not ideal as you could end up filtering 99% of results and then causes issues with performing too many requests.

ie if you want 1000 results and you are ignoring 99% of users, you need to scrape 100k results, pull the profile details for each and check the filter. SC won't like you make 100k results as no normal user will ever do this.

for example :
likers hashtag "car" in london?

please help me .... thank you
car? That well know genre :D


With the above caveat about location added, to perform your search, you need to learn how to use CUSTOM SEARCH / SEARCH BUILDER

Search STEPS:
TRACK SEARCH
LIKERS

Depending on track search (SC allows TAG SEARCH where it just returns the most popular tracks from the genre and the results hardly ever change, in which case you input:
car

Or you can use advanced track search where you can enter
title, genre, upload_date[o], length[o]

where [o] params are optional

input:
a, car, last_week

where 'a' is just a letter to appear in the title of the track as something must be entered.




SoundcloudManager is constantly updating, being improved, added to. Due to this some of the older tutorials may be a bit out of date in regard to the look of the application, however the sentiment will still apply. Firstly it is receommended you watch the Latest Tutorials for SoundcloudManagerv3, which are up to date and relate to the current application. Any module / function you do not find in the v3 tutorials will be covered in the older tutorials.
---------------------------------

Beginners Guide SoundcloudManager v3
https://www.youtube.com/watch?v=CtEqQSU ... mQ-y_37SdJ

SoundcloudManager v3 - All tutorials
https://www.youtube.com/watch?v=CtEqQSU ... 8Ok47r_keF

Soundcloud Manager v3 - Features
https://www.youtube.com/watch?v=iaJxz3M ... DfaQ5XjyLG

---------------------------------
Soundcloud Manager Beginners Quick Guide Series (older but still applicable)
https://www.youtube.com/playlist?list=P ... W4iV_v9G7Z

Soundcloud Manager All Beginners Tutorials (older but still applicable)
https://www.youtube.com/playlist?list=P ... ROFzp1nF08

All Video Tutorials
https://www.youtube.com/playlist?list=P ... ihFRBzMGYD

sam2020
Posts: 4
Joined: Fri Nov 20, 2020 7:55 pm

Re: Steps to scrap

Post by sam2020 » Sun Nov 22, 2020 7:03 pm

hi martin
Thank you for answering, but I meant the Instagram robot(instadub)

thank you very very much

User avatar
martin@rootjazz
Site Admin
Posts: 26208
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Steps to scrap

Post by martin@rootjazz » Mon Nov 23, 2020 2:52 pm

sam2020 wrote:
Sun Nov 22, 2020 7:03 pm
hi martin
Thank you for answering, but I meant the Instagram robot(instadub)

thank you very very much
ah my apologies, it's just that you mentioned Soundcloud manager in your first post. But the answer is still the same for instagram, they don't let you perform multiple searches on location and hashtag.


Location searching / filtering is hard. ISG does not make it easy or effective to do


The best way to search for locations is to use the explore location URLs. You can find specific places and cities here:

https://www.instagram.com/explore/locations/

However, there are many and to find all users in all, is not an easy task.

Equally, this will return pictures taken in these locations. If the location is touristy, you will find lots of tourists in the results not from the country.

To ensure a hashtag is present in the results, you can use a FILTER for INCLUDE TERM. But you need to be aware if the results are likely to contain your filter include term. If the % is 0.01 you are going to need to make so many requests to get some results you will get blocked at some point for over requests. But perhaps your results are more like 10% then perhaps it can work. For example if you use an EXPLORE location of a sports stadium and have a FILTER INCLUDE term of the local sports team.


Next option, is to use a location filter on the HASHTAG IMAGE results. However, not all images get tagged with the location, again there will be the tourist problems. Also, if you are not careful you will ignore too many results (90+% and maybe hit limits due to too many requests)

Unfortunately, users do NOT have a location, only businesses do, so that isn't really an option either, unless you only want businesses, but again, you cannot search this, only filter so all the problems of very restrictive filters (above) are present).

Post Reply