Page 1 of 1

Scraping users accordingly to a search term

Posted: Mon Jun 08, 2015 8:06 pm
by SoundForSoul
On the reverbnation website, I could search for "adele cover" and got this: " More than 500 Songs matching adele cover"
I really couldn't find such a feature in the Reverbnation bot. How could I grab the users that meet a certain keyword?

Re: Scraping users accordingly to a search term

Posted: Tue Jun 09, 2015 2:56 pm
by martin@rootjazz
BECOME A FAN tab
USER SEARCH box

Although it was broken, RVN had updated it and I wasn't aware. Fixed now, upload in a bit

Re: Scraping users accordingly to a search term

Posted: Tue Jun 09, 2015 3:02 pm
by martin@rootjazz

Re: Scraping users accordingly to a search term

Posted: Wed Jun 10, 2015 6:36 am
by SoundForSoul
Thanks for such a fast answer!

While trying for the first time, I got this error: "* Process failed: Exception of type 'LibProcessing.ExActionFailed' was thrown. - Bad login details / Account banned", then I realised that while importing the users, for some reason, the bot didn't respect the rule, so I have manually edit it and it was ok.

Then, while trying to become their fan, I got this error: " couldn't find success text after become fan: http://www.reverbnation.com/artist/beco ... _fan_reach
* Failed to fan: " Subbmitted logs with id 44028.

Anyway, I was thinking to first scrape some users, then scrape for their email, without becoming their fan. Is this possible ?

For those that didn't have an email to scrape, I could send a spintaxed question /comment, as it is possible in the browser, even without becoming their fan, but a captcha service is needed, (captcha is needed anyway, even when you are a fan of that person).

Thanks!

Re: Scraping users accordingly to a search term

Posted: Wed Jun 10, 2015 1:17 pm
by martin@rootjazz
then I realised that while importing the users, for some reason, the bot didn't respect the rule
Can you send me an example of the lines used to import users. Just a single line will do, to check exactly what you are passing in and what is happening

Then, while trying to become their fan, I got this error: " couldn't find success text after become fan: http://www.reverbnation.com/artist/beco ... _fan_reach
* Failed to fan: " Subbmitted logs with id 44028.
checking


Anyway, I was thinking to first scrape some users, then scrape for their email, without becoming their fan. Is this possible ?
No, not at the moment, scrape users isn' ton the scrape tab. Not sure why not, must have just forgot / missed it

For those that didn't have an email to scrape, I could send a spintaxed question /comment, as it is possible in the browser, even without becoming their fan, but a captcha service is needed, (captcha is needed anyway, even when you are a fan of that person).
This wouldn't be possible, there is no output of users which did not have an email in the bio

Re: Scraping users accordingly to a search term

Posted: Wed Jun 10, 2015 2:11 pm
by martin@rootjazz
become fan routine updated due to RVN changes, new version ready soon

Re: Scraping users accordingly to a search term

Posted: Wed Jun 10, 2015 2:12 pm
by SoundForSoul
martin@rootjazz wrote:
then I realised that while importing the users, for some reason, the bot didn't respect the rule
Can you send me an example of the lines used to import users. Just a single line will do, to check exactly what you are passing in and what is happening
Will send it via email asap
Then, while trying to become their fan, I got this error: " couldn't find success text after become fan: http://www.reverbnation.com/artist/beco ... _fan_reach
* Failed to fan: " Subbmitted logs with id 44028.
checking

ok, standing by for confirmation, thanks!
Anyway, I was thinking to first scrape some users, then scrape for their email, without becoming their fan. Is this possible ?
No, not at the moment, scrape users isn' ton the scrape tab. Not sure why not, must have just forgot / missed it

Any idea when this will be fixed ?

Re: Scraping users accordingly to a search term

Posted: Wed Jun 10, 2015 3:44 pm
by martin@rootjazz

Re: Scraping users accordingly to a search term

Posted: Thu Jun 11, 2015 6:18 am
by SoundForSoul
martin@rootjazz wrote:http://rootjazz.com/reverbnation/download.html
Regards,
Martin
Thanks! Now the fan process is working.

Any news about the possibility of scraping for user matching a certain keyword and then scraping for their email ?

Thank you!

Re: Scraping users accordingly to a search term

Posted: Thu Jun 11, 2015 1:37 pm
by martin@rootjazz
Is on the todo list. Remind me early next week. Have a bit of a backlog on, so new features on the backburner for the next few days