Daily Stats action takes long time

DanyWyzy
Posts: 78
Joined: Sat Nov 04, 2017 5:48 pm

Re: Daily Stats action takes long time

Post by DanyWyzy » Sun Jan 13, 2019 5:50 pm

martin@rootjazz wrote:
Sat Jan 12, 2019 3:07 pm
and closer to 10 minutes including network time to get the page from ISG
mine, however, is 25 minutes, almost three times. :roll:
I notice a very long pause even when the scrape is finished (view in the window double clicking on the action), the action continues in the processing state.

ajaa
Posts: 1592
Joined: Fri Jun 02, 2017 10:38 pm

Re: Daily Stats action takes long time

Post by ajaa » Sun Jan 13, 2019 9:28 pm

DanyWyzy wrote:
Sun Jan 13, 2019 5:50 pm
martin@rootjazz wrote:
Sat Jan 12, 2019 3:07 pm
and closer to 10 minutes including network time to get the page from ISG
mine, however, is 25 minutes, almost three times. :roll:
I notice a very long pause even when the scrape is finished (view in the window double clicking on the action), the action continues in the processing state.
Did uncheck scrape conversations help you?

DanyWyzy
Posts: 78
Joined: Sat Nov 04, 2017 5:48 pm

Re: Daily Stats action takes long time

Post by DanyWyzy » Mon Jan 14, 2019 8:04 am

ajaa wrote:
Sun Jan 13, 2019 9:28 pm
Did uncheck scrape conversations help you?
Yeap, unchecked Scrape Conversations it runs for 8 sec :D

ajaa
Posts: 1592
Joined: Fri Jun 02, 2017 10:38 pm

Re: Daily Stats action takes long time

Post by ajaa » Mon Jan 14, 2019 4:27 pm

DanyWyzy wrote:
Mon Jan 14, 2019 8:04 am
ajaa wrote:
Sun Jan 13, 2019 9:28 pm
Did uncheck scrape conversations help you?
Yeap, unchecked Scrape Conversations it runs for 8 sec :D
8 sec is better than 25 mins. :lol:

I still find doing it without scrape conversions will help in getting fast but not converted stats.

User avatar
martin@rootjazz
Site Admin
Posts: 18817
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Daily Stats action takes long time

Post by martin@rootjazz » Mon Jan 14, 2019 5:28 pm

ajaa wrote:
Mon Jan 14, 2019 4:27 pm
DanyWyzy wrote:
Mon Jan 14, 2019 8:04 am
ajaa wrote:
Sun Jan 13, 2019 9:28 pm
Did uncheck scrape conversations help you?
Yeap, unchecked Scrape Conversations it runs for 8 sec :D
8 sec is better than 25 mins. :lol:

I still find doing it without scrape conversions will help in getting fast but not converted stats.

optional. Run a conversions scrape once every 7 days.
Run a daily stats, every day without conversions for basic stats

rsbmanish
Posts: 369
Joined: Wed Jun 28, 2017 9:56 am

Re: Daily Stats action takes long time

Post by rsbmanish » Tue Jan 15, 2019 10:42 am

rsbmanish wrote:
Sat Jan 12, 2019 10:37 pm
Martin 99% of accounts have chronological order in followers. The 1% account that dont have it are new ones with less than 200-300 followers. I think the program should stop scraping when it finds a previously scraped account. This will save a lot of time and save accounts from getting flagged by instagram for scraping a lot of profiles. Also just as scrape tab we should have third party accounts scraping the followers so that we can keep our spam accounts to scrape daily stats for all the accounts.
Martin this suggestion got missed so i am writing again

User avatar
martin@rootjazz
Site Admin
Posts: 18817
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Daily Stats action takes long time

Post by martin@rootjazz » Tue Jan 15, 2019 3:06 pm

rsbmanish wrote:
Tue Jan 15, 2019 10:42 am
rsbmanish wrote:
Sat Jan 12, 2019 10:37 pm
Martin 99% of accounts have chronological order in followers. The 1% account that dont have it are new ones with less than 200-300 followers. I think the program should stop scraping when it finds a previously scraped account. This will save a lot of time and save accounts from getting flagged by instagram for scraping a lot of profiles. Also just as scrape tab we should have third party accounts scraping the followers so that we can keep our spam accounts to scrape daily stats for all the accounts.
Martin this suggestion got missed so i am writing again
really? I will check. When it changed it was effecting every account, hence the change. If confirmed, I will make it optional

User avatar
martin@rootjazz
Site Admin
Posts: 18817
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Daily Stats action takes long time

Post by martin@rootjazz » Tue Jan 15, 2019 5:01 pm

option added to specify to scrape all or stop on finding existing

The next update will include this feature. I shall let you know when it is ready.



Regards,
Martin

User avatar
martin@rootjazz
Site Admin
Posts: 18817
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Daily Stats action takes long time

Post by martin@rootjazz » Tue Jan 15, 2019 5:12 pm

https://rootjazz.com/instadub/updatetesting.html


note it will need to scrape all your followers the first time, then subsequent runs it will stop when found previously scraped

rsbmanish
Posts: 369
Joined: Wed Jun 28, 2017 9:56 am

Re: Daily Stats action takes long time

Post by rsbmanish » Tue Jan 15, 2019 5:16 pm

Thanks a lot martin. This conversion was actually requested originally by me last year but stopped using it for this very reason. the accounts with 10k and over followers took 30-40 minutes and couldnt be used. I might start using it once this feature is available. I also second the suggestion by Martin that we should work on daily stats without conversion on daily basis and work the conversions once every 7 days

Post Reply