Scraping users accordingly to a search term
-
- Posts: 6
- Joined: Sun Jun 07, 2015 5:00 pm
Scraping users accordingly to a search term
On the reverbnation website, I could search for "adele cover" and got this: " More than 500 Songs matching adele cover"
I really couldn't find such a feature in the Reverbnation bot. How could I grab the users that meet a certain keyword?
I really couldn't find such a feature in the Reverbnation bot. How could I grab the users that meet a certain keyword?
- martin@rootjazz
- Site Admin
- Posts: 34712
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraping users accordingly to a search term
BECOME A FAN tab
USER SEARCH box
Although it was broken, RVN had updated it and I wasn't aware. Fixed now, upload in a bit
USER SEARCH box
Although it was broken, RVN had updated it and I wasn't aware. Fixed now, upload in a bit
- martin@rootjazz
- Site Admin
- Posts: 34712
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
-
- Posts: 6
- Joined: Sun Jun 07, 2015 5:00 pm
Re: Scraping users accordingly to a search term
Thanks for such a fast answer!
While trying for the first time, I got this error: "* Process failed: Exception of type 'LibProcessing.ExActionFailed' was thrown. - Bad login details / Account banned", then I realised that while importing the users, for some reason, the bot didn't respect the rule, so I have manually edit it and it was ok.
Then, while trying to become their fan, I got this error: " couldn't find success text after become fan: http://www.reverbnation.com/artist/beco ... _fan_reach
* Failed to fan: " Subbmitted logs with id 44028.
Anyway, I was thinking to first scrape some users, then scrape for their email, without becoming their fan. Is this possible ?
For those that didn't have an email to scrape, I could send a spintaxed question /comment, as it is possible in the browser, even without becoming their fan, but a captcha service is needed, (captcha is needed anyway, even when you are a fan of that person).
Thanks!
While trying for the first time, I got this error: "* Process failed: Exception of type 'LibProcessing.ExActionFailed' was thrown. - Bad login details / Account banned", then I realised that while importing the users, for some reason, the bot didn't respect the rule, so I have manually edit it and it was ok.
Then, while trying to become their fan, I got this error: " couldn't find success text after become fan: http://www.reverbnation.com/artist/beco ... _fan_reach
* Failed to fan: " Subbmitted logs with id 44028.
Anyway, I was thinking to first scrape some users, then scrape for their email, without becoming their fan. Is this possible ?
For those that didn't have an email to scrape, I could send a spintaxed question /comment, as it is possible in the browser, even without becoming their fan, but a captcha service is needed, (captcha is needed anyway, even when you are a fan of that person).
Thanks!
- martin@rootjazz
- Site Admin
- Posts: 34712
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraping users accordingly to a search term
Can you send me an example of the lines used to import users. Just a single line will do, to check exactly what you are passing in and what is happeningthen I realised that while importing the users, for some reason, the bot didn't respect the rule
checkingThen, while trying to become their fan, I got this error: " couldn't find success text after become fan: http://www.reverbnation.com/artist/beco ... _fan_reach
* Failed to fan: " Subbmitted logs with id 44028.
No, not at the moment, scrape users isn' ton the scrape tab. Not sure why not, must have just forgot / missed itAnyway, I was thinking to first scrape some users, then scrape for their email, without becoming their fan. Is this possible ?
This wouldn't be possible, there is no output of users which did not have an email in the bioFor those that didn't have an email to scrape, I could send a spintaxed question /comment, as it is possible in the browser, even without becoming their fan, but a captcha service is needed, (captcha is needed anyway, even when you are a fan of that person).
- martin@rootjazz
- Site Admin
- Posts: 34712
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraping users accordingly to a search term
become fan routine updated due to RVN changes, new version ready soon
-
- Posts: 6
- Joined: Sun Jun 07, 2015 5:00 pm
Re: Scraping users accordingly to a search term
No, not at the moment, scrape users isn' ton the scrape tab. Not sure why not, must have just forgot / missed itmartin@rootjazz wrote:Can you send me an example of the lines used to import users. Just a single line will do, to check exactly what you are passing in and what is happeningthen I realised that while importing the users, for some reason, the bot didn't respect the rule
Will send it via email asap
checkingThen, while trying to become their fan, I got this error: " couldn't find success text after become fan: http://www.reverbnation.com/artist/beco ... _fan_reach
* Failed to fan: " Subbmitted logs with id 44028.
ok, standing by for confirmation, thanks!
Anyway, I was thinking to first scrape some users, then scrape for their email, without becoming their fan. Is this possible ?
Any idea when this will be fixed ?
- martin@rootjazz
- Site Admin
- Posts: 34712
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
-
- Posts: 6
- Joined: Sun Jun 07, 2015 5:00 pm
Re: Scraping users accordingly to a search term
Thanks! Now the fan process is working.
Any news about the possibility of scraping for user matching a certain keyword and then scraping for their email ?
Thank you!
- martin@rootjazz
- Site Admin
- Posts: 34712
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraping users accordingly to a search term
Is on the todo list. Remind me early next week. Have a bit of a backlog on, so new features on the backburner for the next few days