I hope you're well.
This is not a bug/problem but maybe there is something we can do about it
If I follow using "followers of" (twitter.com/user) it works perfectly (unique is on). I run 6 - 8 accounts and the program use 5% - 60% CPU.
If I follow using "from list" (list of user profiles "twitter.com/user" not user IDs), and "unique" is on the program eats 100% CPU.
I can't run any process or use the PC.
If unique is off it works just fine.
List consists of ~18000 users. I follow ~200 per 24 hours.
When the CPU is overloaded the program does this:
Code: Select all
Starting: 28.02.2017 08:00
Search: c:\BestNewMusician_NEW.txt
Num: 200
SearchType: -1
Unique: True
Processing: c:\BestNewMusician_NEW.txt max: 200
Loaded from list: 18467 items to process
Items loaded to process: 18467
Remove already processed items
account: ******************** load previously processed items
Removing already process items of: ********************
Loading previous db logs: 979c0a9f-8edf-4993-aa13-38b091070afa_Follow
Loaded previous db logs: 35390 within 24hrs: 0
Checking results: 18467 against already processed list: 35390 of: ********************
Remaining logs to check: 18400
Remaining logs to check: 18300
Remaining logs to check: 18200
Remaining logs to check: 18100
Remaining logs to check: 18000
Remaining logs to check: 17900
Remaining logs to check: 17800
Remaining logs to check: 17700
Remaining logs to check: 17600
Remaining logs to check: 17500
Remaining logs to check: 17400
Remaining logs to check: 17300
Remaining logs to check: 17200
Remaining logs to check: 17100
Remaining logs to check: 17000
Remaining logs to check: 16900
Remaining logs to check: 16800
Remaining logs to check: 16700
Remaining logs to check: 16600
Remaining logs to check: 16500
Remaining logs to check: 16400
Remaining logs to check: 16300
Remaining logs to check: 16200
Remaining logs to check: 16100
Remaining logs to check: 16000
Remaining logs to check: 15900
Remaining logs to check: 15800
Remaining logs to check: 15700
Remaining logs to check: 15600
Remaining logs to check: 15500
Remaining logs to check: 15400
Remaining logs to check: 15300
Remaining logs to check: 15200
Remaining logs to check: 15100
Remaining logs to check: 15000
Remaining logs to check: 14900
Remaining logs to check: 14800
Remaining logs to check: 14700
Remaining logs to check: 14600
Remaining logs to check: 14500
Remaining logs to check: 14400
Remaining logs to check: 14300
Remaining logs to check: 14200
Remaining logs to check: 14100
Remaining logs to check: 14000
Remaining logs to check: 13900
Remaining logs to check: 13800
Remaining logs to check: 13700
Remaining logs to check: 13600
Remaining logs to check: 13500
Remaining logs to check: 13400
Remaining logs to check: 13300
Remaining logs to check: 13200
Remaining logs to check: 13100
Remaining logs to check: 13000
Remaining logs to check: 12900
Remaining logs to check: 12800
Remaining logs to check: 12700
Remaining logs to check: 12600
Remaining logs to check: 12500
Remaining logs to check: 12400
Remaining logs to check: 12300
Remaining logs to check: 12200
Remaining logs to check: 12100
Remaining logs to check: 12000
Remaining logs to check: 11900
Remaining logs to check: 11800
Remaining logs to check: 11700
Remaining logs to check: 11600
Remaining logs to check: 11500
Remaining logs to check: 11400
Remaining logs to check: 11300
Remaining logs to check: 11200
Remaining logs to check: 11100
Remaining logs to check: 11000
Remaining logs to check: 10900
and so on :)))
I can't even run another account, because if I try to navigate the program it falls to "not responding".
I tested it on VPS and my home PC.
VPS (windows server 2008 R2 Enterprise, QEMU Virtual CPU (64) 3.5 GHz, 2GB RAM)
falls to "not responding" immediately after I start process and after a hour being not responding, keeps working (I think when the checking process is finished).
On my home PC (win 7, i7, 16GB ram). I can see processing log (I posted it previously), program doesn't fall to not responding, but the CPU is 100% too and I can't use PC or run another process because the program becomes really unstable.
I'm sorry for huge post hope you will understand me
All the best!