100% CPU load

Support / help / discussion forum for twitter bot
axisar
Posts: 136
Joined: Fri Oct 11, 2019 2:42 pm

100% CPU load

Post by axisar »

Hello there.
Faced issue today.
Video Upload actions just stay quiet with logs like

****************
Starting: 06.08.2023 22:28
Watching folder: E:\tmp\twtvids

and TD consume all cpu while doing nothing

logs are empty just 3 lines as i mentioned. whats wrong with it
i cleaned %tmp%
also rebooted, nothing changed

i cant cancel these actions. they just keep consuming CPU in status Canceled

PS:
here is a raw log

22:47:01: IsAllowedToProcessNow base
22:47:01: IsWithinDailyTimes
22:47:01:
****************
Starting: 06.08.2023 22:47
22:47:02: Action id: de7ca505-1424-4960-ae34-fb001e971f2e C:\Users\Some\AppData\Roaming\rootjazz\Twitterdubnpost\logs\log.20230806.postvideouploads_de7ca505-1424-4960-ae34-fb001e971f2e.log
22:47:02: Watch folder: E:\tmp\twtvids Posting 0(1) Video Uploads to 1 accounts
22:47:02: Watching folder: E:\tmp\twtvids
User avatar
martin@rootjazz
Site Admin
Posts: 34712
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: 100% CPU load

Post by martin@rootjazz »

that doesn't sound right.

what machine are you using? Home computer? laptop? VPS?

Normally if high CPU is a problem, changing to HELP > CONFIG > IN MEMORY PROCESSED ITEMS > ON will resolve it

but I cannot see how that is related to this function, but you can try
axisar
Posts: 136
Joined: Fri Oct 11, 2019 2:42 pm

Re: 100% CPU load

Post by axisar »

using VPS win7 2cpus 4Gb ram. and everything was just fine for a moment i cant get

it just started one day. and i made an update from 469 to 478 just though what twitter changed something but its not help.
is where any files per folder limit? something bigger that 2048? because i`d added about 2500 files to watched folder
maybe processed items overload?
axisar
Posts: 136
Joined: Fri Oct 11, 2019 2:42 pm

Re: 100% CPU load

Post by axisar »

martin@rootjazz wrote: Tue Aug 08, 2023 1:18 pm Normally if high CPU is a problem, changing to HELP > CONFIG > IN MEMORY PROCESSED ITEMS > ON will resolve it
btw high cpu load only happens when watch folder post video actions processing. when it paused, everything is okay

nothing changed
logs looks the same
i also reduced number of files in watched folder. also doesnt help
axisar
Posts: 136
Joined: Fri Oct 11, 2019 2:42 pm

Re: 100% CPU load

Post by axisar »

Starting Video Post Watch folder actions one by one seems resolve the problem, after some time of high cpu consume it start uploading video,
not sure what will happen in next run of this actions. But i suspect same behavior
axisar
Posts: 136
Joined: Fri Oct 11, 2019 2:42 pm

Re: 100% CPU load

Post by axisar »

axisar wrote: Tue Aug 08, 2023 9:58 pm Starting Video Post Watch folder actions one by one seems resolve the problem, after some time of high cpu consume it start uploading video,
not sure what will happen in next run of this actions. But i suspect same behavior
Same behavior confirmed. It consume 100% of one core per action in each start. and start takes lot of time.

just opened Resource monitor... its not a cpu consume actually, its a disk consumption.
TD reads all video files in watched folder for some reason at full disk speed, opened huge amount of files looks like almost all files in folder. and btw its 14Gb
thats why its happened. not sure why i didnt faced it before
User avatar
martin@rootjazz
Site Admin
Posts: 34712
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: 100% CPU load

Post by martin@rootjazz »

axisar wrote: Tue Aug 08, 2023 7:19 pm using VPS win7 2cpus 4Gb ram. and everything was just fine for a moment i cant get
Unrelated, but windows7 not supported by Microsoft so we don't support it either

Is it a proper VPS? Or a service like AWS / AZURE / GOOGLE, as they heavy throttle the CPU on their cheaper tiers.
it just started one day. and i made an update from 469 to 478 just though what twitter changed something but its not help.
is where any files per folder limit? something bigger that 2048? because i`d added about 2500 files to watched folder
maybe processed items overload?
How many threads? If you have 100 threads trying to process media, then yes it will use high CPU as the program is trying to do things using all available resources.
User avatar
martin@rootjazz
Site Admin
Posts: 34712
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: 100% CPU load

Post by martin@rootjazz »

axisar wrote: Tue Aug 08, 2023 7:29 pm
martin@rootjazz wrote: Tue Aug 08, 2023 1:18 pm Normally if high CPU is a problem, changing to HELP > CONFIG > IN MEMORY PROCESSED ITEMS > ON will resolve it
btw high cpu load only happens when watch folder post video actions processing. when it paused, everything is okay

nothing changed
logs looks the same
i also reduced number of files in watched folder. also doesnt help
right click the action > select RAW LOGS
send me the contents of the file

Code: Select all

support[at]rootjazz[dot]com
What options did you set for video posting? Any video editing, will use high CPU, video editing / pre processing is very CPU intensive
User avatar
martin@rootjazz
Site Admin
Posts: 34712
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: 100% CPU load

Post by martin@rootjazz »

axisar wrote: Tue Aug 08, 2023 9:58 pm Starting Video Post Watch folder actions one by one seems resolve the problem, after some time of high cpu consume it start uploading video,
not sure what will happen in next run of this actions. But i suspect same behavior
this sounds like it's the pre-processing stage.
Modify the video file = high CPU
then post video , low CPU.

As above, get back to me with your settings and logs and we can review

In addition to RAW logs, submit full logs
HELP > LOGS > SUBMIT

then send your logs ID - the numbers are sufficient (displayed after successful uploading of logs)

viewtopic.php?f=32&t=12078
User avatar
martin@rootjazz
Site Admin
Posts: 34712
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: 100% CPU load

Post by martin@rootjazz »

axisar wrote: Wed Aug 09, 2023 5:01 am
axisar wrote: Tue Aug 08, 2023 9:58 pm Starting Video Post Watch folder actions one by one seems resolve the problem, after some time of high cpu consume it start uploading video,
not sure what will happen in next run of this actions. But i suspect same behavior
Same behavior confirmed. It consume 100% of one core per action in each start. and start takes lot of time.

just opened Resource monitor... its not a cpu consume actually, its a disk consumption.
TD reads all video files in watched folder for some reason at full disk speed, opened huge amount of files looks like almost all files in folder. and btw its 14Gb
thats why its happened. not sure why i didnt faced it before
I cannot actually remember how TD handles detected watch files, let me check
Post Reply