Suggestions / feature requests / improvements

Support / help / discussion forum for twitter bot
faxnet
Posts: 49
Joined: Tue Jul 11, 2017 5:44 am

Re: Suggestions / feature requests / improvements

Post by faxnet »

Or maybe a workaround is to treat the file just like some of the other modules meaning that when we add a new "scrap tweets from a file"
just add one action and then when the action start, then process the tweet ids one by one.
THe annoying part is the waiting when I add the action, for each account. So for example if I split my file in 10 parts with each 2500 tweets,
it will take at least 5minutes to add each actions, and I have to wait that before adding the other accounts' action. I am just looking for a way to do it fast. What is taking time here is the addition of the actions in the processor because even with the actions stopped, it takes time to add them.
I did try with different pc/server, not a hardware issue.
faxnet wrote:Hi Martin,
I was talking about first scenario because I have a file of tweet ids, could be urls too but I dont think it will change something. I don't necessary need to spread them equally (if it is random, it will be almost equal anyway).
What I would like is just to select multiple accounts, and choose only one file and the actions will be created in the processor. It doesn't need to be one big action (like the shared feature), I just want to avoid doitn it one by one which takes some time and I cant use all my accounts because it is so annoying I just use 5-10 and then just wait lol
martin@rootjazz wrote:That is easier said than done - if what you mean is pull one page of results with acc1, page2 results with acc2.

But if you want to load in a text file of search terms to add multiple scrape actions, those can be distributed across accounts easily enough. If can confirm this is adequate would be a quick 2 minute update
faxnet wrote:Hi Martin,

In twitterDub can you please add the ability the scrape profiles from tweets using multiple accounts? I have dozens of accoutns but when I want to scrape users that interacted with some tweets, I first need to split the file in the number of accounts I want to use to scrap and then add actions one per account I have. This is taking me too much time and it will really help if in the account selector it was possible to choose multiple accounts and and "share" the scraping among those, just like it is done right now for the follow action for example.

screenshot of the fields I am talking about: http://imgur.com/ES8XfFh

Thanks
omegasolutions
Posts: 370
Joined: Tue Aug 08, 2017 11:21 am

Re: Suggestions / feature requests / improvements

Post by omegasolutions »

martin@rootjazz wrote:twitter dub
custom search
GEO SEARCH

I just checked, it is definitely there

OK, I go to the follow tab, select custom search and select Geo Search.

It then states

"Your custom search will return: Tweet
However the action you are building this search for requires an output of User"

So, even then, if I go one step further and select creator of Tweet It tries to search for the location like it's a user.

Code: Select all

Get TwitterUser: Las Vegas using: xxxxxxxxxxxx
* ERROR: Not Found - The URI requested is invalid or the resource requested, such as a user, does not exists. Also returned when the requested format is not supported by the requested method.
404
https://api.twitter.com/1.1/users/show.json?screen_name=Las%20Vegas
User avatar
martin@rootjazz
Site Admin
Posts: 34345
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Suggestions / feature requests / improvements

Post by martin@rootjazz »

scrape tab
scrape tweets
input: manchester UK
max results 10
CUSTOM SEARCH:
geo
Starting: 03/09/2017 08:54 AM
Perform custom search
Max Results Wanted: 10
Setup custom search controller
One search stage detected, setting default per item per stage value to max: 10
Custom search run: search: manchester UK
Perform custom search: #chain/total: 1/1 using: <user>
Start search: Geo search with: manchester UK using: <user>
ProcessGeo: manchester UK geo coords: 53.48076:-2.24263 with radius: 17
Searching: type: mixed
Found: 15
Results of search: Geo search with: manchester UK
Handle results: 10 nextstep: 1/1
End of chain: Store results: 10
Results: 10
Saving to: C:\Users\martin\AppData\Roaming\rootjazz\Twitterdub\saved_data\search_manchesteruk_2017-09-03.txt
Started: 03/09/2017 08:54 AM
Finished: 03/09/2017 08:54 AM
ID: 2e150374-aa21-4198-8516-46ff5b9bebbb
Action ran for: 0hr:0min:14s
User avatar
martin@rootjazz
Site Admin
Posts: 34345
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Suggestions / feature requests / improvements

Post by martin@rootjazz »

so you wanted profiles

SCRAPE TAB
input: manchester UK
SCRAPE PROFILES
results 10
CUSTOM SEARCH
GEO
CREATOR OF TWEET
Starting: 03/09/2017 08:55 AM
Perform custom search
Max Results Wanted: 10
Setup custom search controller
Two search stages detected that can be completed in one stage, setting default per item per stage value to max: 10
Custom search run: search: manchester UK
Perform custom search: #chain/total: 1/2 using: <user>
Next search step returns single item, can return from this step
Start search: Geo search with: manchester UK using: <user>
ProcessGeo: manchester UK geo coords: 53.48076:-2.24263 with radius: 17
Searching: type: mixed
Found: 11
Results of search: Geo search with: manchester UK
Handle results: 10 nextstep: 1/2
Got results from chain: 10 feed into next chained custom search item
Perform chained search: [1] https://twitter.com/DanBeaty3/statuses/ ... 2936861696
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/DanBeaty3/statuses/ ... 2936861696 using: <user>
Extract ID from URL: 904342072936861696 : https://twitter.com/DanBeaty3/statuses/ ... 2936861696
Results of search: CreatorOfTweet with: https://twitter.com/DanBeaty3/statuses/ ... 2936861696
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/foster_coralie/stat ... 1201970179
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/foster_coralie/stat ... 1201970179 using: <user>
Extract ID from URL: 904342051201970179 : https://twitter.com/foster_coralie/stat ... 1201970179
Results of search: CreatorOfTweet with: https://twitter.com/foster_coralie/stat ... 1201970179
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/missynjb/statuses/9 ... 1768886272
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/missynjb/statuses/9 ... 1768886272 using: <user>
Extract ID from URL: 904342041768886272 : https://twitter.com/missynjb/statuses/9 ... 1768886272
Results of search: CreatorOfTweet with: https://twitter.com/missynjb/statuses/9 ... 1768886272
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/Longleyyy15/statuse ... 2735237120
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/Longleyyy15/statuse ... 2735237120 using: <user>
Extract ID from URL: 904342022735237120 : https://twitter.com/Longleyyy15/statuse ... 2735237120
Results of search: CreatorOfTweet with: https://twitter.com/Longleyyy15/statuse ... 2735237120
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/wrxmanpaul/statuses ... 2956114944
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/wrxmanpaul/statuses ... 2956114944 using: <user>
Extract ID from URL: 904341932956114944 : https://twitter.com/wrxmanpaul/statuses ... 2956114944
Results of search: CreatorOfTweet with: https://twitter.com/wrxmanpaul/statuses ... 2956114944
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/CalKABOOM/statuses/ ... 9032331265
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/CalKABOOM/statuses/ ... 9032331265 using: <user>
Extract ID from URL: 904341849032331265 : https://twitter.com/CalKABOOM/statuses/ ... 9032331265
Results of search: CreatorOfTweet with: https://twitter.com/CalKABOOM/statuses/ ... 9032331265
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/GarryBridges/status ... 5072891904
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/GarryBridges/status ... 5072891904 using: <user>
Extract ID from URL: 904341845072891904 : https://twitter.com/GarryBridges/status ... 5072891904
Results of search: CreatorOfTweet with: https://twitter.com/GarryBridges/status ... 5072891904
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/mancsbound/statuses ... 5379471360
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/mancsbound/statuses ... 5379471360 using: <user>
Extract ID from URL: 904341785379471360 : https://twitter.com/mancsbound/statuses ... 5379471360
Results of search: CreatorOfTweet with: https://twitter.com/mancsbound/statuses ... 5379471360
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/Tunnelbreeze/status ... 9316160512
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/Tunnelbreeze/status ... 9316160512 using: <user>
Extract ID from URL: 904341759316160512 : https://twitter.com/Tunnelbreeze/status ... 9316160512
Results of search: CreatorOfTweet with: https://twitter.com/Tunnelbreeze/status ... 9316160512
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/annieobrien94/statu ... 6111663105
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/annieobrien94/statu ... 6111663105 using: <user>
Extract ID from URL: 904341756111663105 : https://twitter.com/annieobrien94/statu ... 6111663105
Results of search: CreatorOfTweet with: https://twitter.com/annieobrien94/statu ... 6111663105
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Results: 10
Saving to: C:\Users\martin\AppData\Roaming\rootjazz\Twitterdub\saved_data\search_manchesteruk_2017-09-03_2.txt
Started: 03/09/2017 08:55 AM
Finished: 03/09/2017 08:56 AM
ID: 7898a6b6-1d0c-429e-ae1e-1bdfd1b23057
Action ran for: 0hr:0min:45s
User avatar
martin@rootjazz
Site Admin
Posts: 34345
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Suggestions / feature requests / improvements

Post by martin@rootjazz »

not sure if the version I am using is the latest version, but I will build and push as is definitely working here
omegasolutions
Posts: 370
Joined: Tue Aug 08, 2017 11:21 am

Re: Suggestions / feature requests / improvements

Post by omegasolutions »

Some of the most basic stuff is missing from TwitterDub, that you take for granted in Instadub.

You can't select a file in TwitterDub from the Follow Tab.
User avatar
martin@rootjazz
Site Admin
Posts: 34345
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Suggestions / feature requests / improvements

Post by martin@rootjazz »

Just type it in :roll:

But will add the file selector if you really want.
bitcoin
Posts: 924
Joined: Tue Jul 04, 2017 1:25 am

Re: Suggestions / feature requests / improvements

Post by bitcoin »

martin@rootjazz wrote:Just type it in :roll:

But will add the file selector if you really want.
You guys over there have that?? Tssss :evil:
User avatar
martin@rootjazz
Site Admin
Posts: 34345
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Suggestions / feature requests / improvements

Post by martin@rootjazz »

bitcoin wrote:
martin@rootjazz wrote:Just type it in :roll:

But will add the file selector if you really want.
You guys over there have that?? Tssss :evil:
instadub makes at least 5x more sales, so it gets 5x more time on it. Infact probably more that 5x. I really should check sales stats really, don't think have checked them this year
Post Reply