Scraping profile deatils with instadub

Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Re: Scraping profile deatils with instadub

Post by Bartekef »

martin@rootjazz wrote: Tue Nov 29, 2022 8:08 pm next update will include:

category_name
overall_category_name
business_category_name
That would be great, when can I expect it? Thanks!
Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Re: Scraping profile deatils with instadub

Post by Bartekef »

martin@rootjazz wrote: Tue Nov 29, 2022 6:16 pm
Bartekef wrote: Wed Nov 23, 2022 7:40 pm
Btw. I used to put the email code to the account in accounts tab and click "server verify" (or something different) before; I don't see this option anymore.
Server Verified removed a while back
Also when I clicked "open in acc browser" it asked me for proxy, but I don't use it anymore (and there is no proxy attached to the account neither) so it won't open the instagram.com so I could verify it or do the challenge.
Check your OS network settings, that can also set the proxy

windows / start key
type: proxy settings

should show the option

Not this case; the browser works in Twitterdub for example, it's only a problem in Instadub
User avatar
martin@rootjazz
Site Admin
Posts: 37208
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping profile deatils with instadub

Post by martin@rootjazz »

Bartekef wrote: Mon Dec 05, 2022 10:01 am
martin@rootjazz wrote: Tue Nov 29, 2022 6:16 pm
Bartekef wrote: Wed Nov 23, 2022 7:40 pm
Btw. I used to put the email code to the account in accounts tab and click "server verify" (or something different) before; I don't see this option anymore.
Server Verified removed a while back
Also when I clicked "open in acc browser" it asked me for proxy, but I don't use it anymore (and there is no proxy attached to the account neither) so it won't open the instagram.com so I could verify it or do the challenge.
Check your OS network settings, that can also set the proxy

windows / start key
type: proxy settings

should show the option

Not this case; the browser works in Twitterdub for example, it's only a problem in Instadub
err that doesn't make any sense. If there is no default proxy. And if ID is not setting a proxy... when is it coming from.

clear logs HELP > LOGS > DELETE
try and open browser
when / if asks for proxy details
submit logs
HELP > LOGS > SUBMIT

then send your logs ID - the numbers are sufficient (displayed after successful uploading of logs)
Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Re: Scraping profile deatils with instadub

Post by Bartekef »

martin@rootjazz wrote: Mon Dec 05, 2022 9:43 pm
Bartekef wrote: Mon Dec 05, 2022 10:01 am
martin@rootjazz wrote: Tue Nov 29, 2022 6:16 pm
Server Verified removed a while back


Check your OS network settings, that can also set the proxy

windows / start key
type: proxy settings

should show the option

Not this case; the browser works in Twitterdub for example, it's only a problem in Instadub
err that doesn't make any sense. If there is no default proxy. And if ID is not setting a proxy... when is it coming from.

clear logs HELP > LOGS > DELETE
try and open browser
when / if asks for proxy details
submit logs
HELP > LOGS > SUBMIT

then send your logs ID - the numbers are sufficient (displayed after successful uploading of logs)
It won't open at all. That's what I'm getting:
Image
the chrome (i suppose chrome) blank window would open for a tenth of second and then it would close.

Logs: 39526
Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Re: Scraping profile deatils with instadub

Post by Bartekef »

Bartekef wrote: Mon Dec 05, 2022 10:00 am
martin@rootjazz wrote: Tue Nov 29, 2022 8:08 pm next update will include:

category_name
overall_category_name
business_category_name
That would be great, when can I expect it? Thanks!
Any news with the update? :)
User avatar
martin@rootjazz
Site Admin
Posts: 37208
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping profile deatils with instadub

Post by martin@rootjazz »

Bartekef wrote: Fri Dec 09, 2022 11:44 am
Bartekef wrote: Mon Dec 05, 2022 10:00 am
martin@rootjazz wrote: Tue Nov 29, 2022 8:08 pm next update will include:

category_name
overall_category_name
business_category_name
That would be great, when can I expect it? Thanks!
Any news with the update? :)
https://rootjazz.com/instadub/updatetesting.html
Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Re: Scraping profile deatils with instadub

Post by Bartekef »

martin@rootjazz wrote: Fri Dec 09, 2022 9:03 pm
Bartekef wrote: Fri Dec 09, 2022 11:44 am
Bartekef wrote: Mon Dec 05, 2022 10:00 am

That would be great, when can I expect it? Thanks!
Any news with the update? :)
https://rootjazz.com/instadub/updatetesting.html
Thanks

It now opens the Google chrome but it asks for proxy, even though I don't use no proxy anymore - look it's blank here:
Image
So that's why you thought I'm using the proxy, maybe that's wherethe bug is?

I don't use this proxy anymore:
Image


Logs: 93853


And another question - I couldn't pull more than 1000 results (followers URLS) using one account; any way to overcome that? I know the limits are strict now, but do I really have that many accounts to get like 100k followers?
Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Re: Scraping profile deatils with instadub

Post by Bartekef »

martin@rootjazz wrote: Fri Dec 09, 2022 9:03 pm
Bartekef wrote: Fri Dec 09, 2022 11:44 am
Bartekef wrote: Mon Dec 05, 2022 10:00 am

That would be great, when can I expect it? Thanks!
Any news with the update? :)
https://rootjazz.com/instadub/updatetesting.html
Also, I run web details scrape action, and yes, AWESOME, it gets categories, thank you for this! However many of profiles are missing the details. I can open them on Instagram and they are not blank, but in the text file they will have no details at all. Could you please check it?
Examples:

Image

I know some of those are private so they won't have details, but most are not (you can for example check the one the arrow points)

Logs: 88436


Anyway thanks for your quick replies, fixes and adding new features Martin, hopefully you can fix that one too.

Edit: I tried to run action for this one url alone and it still doesn't get the details.

I don't know if it helps anyhow, but from the text file it seems like it scrapped every account until 78. and then it would start having problems

Image

A lot of blank space, then one scraped, then again a lot of blank profiles, and some with details from time to time. I sent you the action results to your email.

Thank you!
User avatar
martin@rootjazz
Site Admin
Posts: 37208
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping profile deatils with instadub

Post by martin@rootjazz »

Bartekef wrote: Sun Dec 11, 2022 6:58 pm
I don't use this proxy anymore:
Image
But that proxy WAS yours? Ok it must be cached in chrome somewhere, in the sessions / cookie / something data. Can you test for me.

right click the account> DELETE BROWSER SESSION (or whatever the text is). If that resolves it, let me know, as the program won't be setting that proxy if it's not in the account details.


And another question - I couldn't pull more than 1000 results (followers URLS) using one account; any way to overcome that? I know the limits are strict now, but do I really have that many accounts to get like 100k followers?
IG cracking down, things much much tougher :-(
User avatar
martin@rootjazz
Site Admin
Posts: 37208
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping profile deatils with instadub

Post by martin@rootjazz »

Bartekef wrote: Sun Dec 11, 2022 7:53 pm
I know some of those are private so they won't have details, but most are not (you can for example check the one the arrow points)

Logs: 88436
gaps caused when the details page was not shown by IG and instead you were redirected to the login page
Post Reply