Page 26 of 76

Re: Suggestions / feature requests / improvements

Posted: Fri Sep 01, 2017 9:37 pm
by faxnet
Or maybe a workaround is to treat the file just like some of the other modules meaning that when we add a new "scrap tweets from a file"
just add one action and then when the action start, then process the tweet ids one by one.
THe annoying part is the waiting when I add the action, for each account. So for example if I split my file in 10 parts with each 2500 tweets,
it will take at least 5minutes to add each actions, and I have to wait that before adding the other accounts' action. I am just looking for a way to do it fast. What is taking time here is the addition of the actions in the processor because even with the actions stopped, it takes time to add them.
I did try with different pc/server, not a hardware issue.
faxnet wrote:Hi Martin,
I was talking about first scenario because I have a file of tweet ids, could be urls too but I dont think it will change something. I don't necessary need to spread them equally (if it is random, it will be almost equal anyway).
What I would like is just to select multiple accounts, and choose only one file and the actions will be created in the processor. It doesn't need to be one big action (like the shared feature), I just want to avoid doitn it one by one which takes some time and I cant use all my accounts because it is so annoying I just use 5-10 and then just wait lol
martin@rootjazz wrote:That is easier said than done - if what you mean is pull one page of results with acc1, page2 results with acc2.

But if you want to load in a text file of search terms to add multiple scrape actions, those can be distributed across accounts easily enough. If can confirm this is adequate would be a quick 2 minute update
faxnet wrote:Hi Martin,

In twitterDub can you please add the ability the scrape profiles from tweets using multiple accounts? I have dozens of accoutns but when I want to scrape users that interacted with some tweets, I first need to split the file in the number of accounts I want to use to scrap and then add actions one per account I have. This is taking me too much time and it will really help if in the account selector it was possible to choose multiple accounts and and "share" the scraping among those, just like it is done right now for the follow action for example.

screenshot of the fields I am talking about: http://imgur.com/ES8XfFh

Thanks

Re: Suggestions / feature requests / improvements

Posted: Sat Sep 02, 2017 11:53 pm
by omegasolutions
martin@rootjazz wrote:twitter dub
custom search
GEO SEARCH

I just checked, it is definitely there

OK, I go to the follow tab, select custom search and select Geo Search.

It then states

"Your custom search will return: Tweet
However the action you are building this search for requires an output of User"

So, even then, if I go one step further and select creator of Tweet It tries to search for the location like it's a user.

Code: Select all

Get TwitterUser: Las Vegas using: xxxxxxxxxxxx
* ERROR: Not Found - The URI requested is invalid or the resource requested, such as a user, does not exists. Also returned when the requested format is not supported by the requested method.
404
https://api.twitter.com/1.1/users/show.json?screen_name=Las%20Vegas

Re: Suggestions / feature requests / improvements

Posted: Sun Sep 03, 2017 1:55 pm
by martin@rootjazz
scrape tab
scrape tweets
input: manchester UK
max results 10
CUSTOM SEARCH:
geo
Starting: 03/09/2017 08:54 AM
Perform custom search
Max Results Wanted: 10
Setup custom search controller
One search stage detected, setting default per item per stage value to max: 10
Custom search run: search: manchester UK
Perform custom search: #chain/total: 1/1 using: <user>
Start search: Geo search with: manchester UK using: <user>
ProcessGeo: manchester UK geo coords: 53.48076:-2.24263 with radius: 17
Searching: type: mixed
Found: 15
Results of search: Geo search with: manchester UK
Handle results: 10 nextstep: 1/1
End of chain: Store results: 10
Results: 10
Saving to: C:\Users\martin\AppData\Roaming\rootjazz\Twitterdub\saved_data\search_manchesteruk_2017-09-03.txt
Started: 03/09/2017 08:54 AM
Finished: 03/09/2017 08:54 AM
ID: 2e150374-aa21-4198-8516-46ff5b9bebbb
Action ran for: 0hr:0min:14s

Re: Suggestions / feature requests / improvements

Posted: Sun Sep 03, 2017 1:57 pm
by martin@rootjazz
so you wanted profiles

SCRAPE TAB
input: manchester UK
SCRAPE PROFILES
results 10
CUSTOM SEARCH
GEO
CREATOR OF TWEET
Starting: 03/09/2017 08:55 AM
Perform custom search
Max Results Wanted: 10
Setup custom search controller
Two search stages detected that can be completed in one stage, setting default per item per stage value to max: 10
Custom search run: search: manchester UK
Perform custom search: #chain/total: 1/2 using: <user>
Next search step returns single item, can return from this step
Start search: Geo search with: manchester UK using: <user>
ProcessGeo: manchester UK geo coords: 53.48076:-2.24263 with radius: 17
Searching: type: mixed
Found: 11
Results of search: Geo search with: manchester UK
Handle results: 10 nextstep: 1/2
Got results from chain: 10 feed into next chained custom search item
Perform chained search: [1] https://twitter.com/DanBeaty3/statuses/ ... 2936861696
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/DanBeaty3/statuses/ ... 2936861696 using: <user>
Extract ID from URL: 904342072936861696 : https://twitter.com/DanBeaty3/statuses/ ... 2936861696
Results of search: CreatorOfTweet with: https://twitter.com/DanBeaty3/statuses/ ... 2936861696
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/foster_coralie/stat ... 1201970179
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/foster_coralie/stat ... 1201970179 using: <user>
Extract ID from URL: 904342051201970179 : https://twitter.com/foster_coralie/stat ... 1201970179
Results of search: CreatorOfTweet with: https://twitter.com/foster_coralie/stat ... 1201970179
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/missynjb/statuses/9 ... 1768886272
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/missynjb/statuses/9 ... 1768886272 using: <user>
Extract ID from URL: 904342041768886272 : https://twitter.com/missynjb/statuses/9 ... 1768886272
Results of search: CreatorOfTweet with: https://twitter.com/missynjb/statuses/9 ... 1768886272
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/Longleyyy15/statuse ... 2735237120
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/Longleyyy15/statuse ... 2735237120 using: <user>
Extract ID from URL: 904342022735237120 : https://twitter.com/Longleyyy15/statuse ... 2735237120
Results of search: CreatorOfTweet with: https://twitter.com/Longleyyy15/statuse ... 2735237120
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/wrxmanpaul/statuses ... 2956114944
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/wrxmanpaul/statuses ... 2956114944 using: <user>
Extract ID from URL: 904341932956114944 : https://twitter.com/wrxmanpaul/statuses ... 2956114944
Results of search: CreatorOfTweet with: https://twitter.com/wrxmanpaul/statuses ... 2956114944
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/CalKABOOM/statuses/ ... 9032331265
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/CalKABOOM/statuses/ ... 9032331265 using: <user>
Extract ID from URL: 904341849032331265 : https://twitter.com/CalKABOOM/statuses/ ... 9032331265
Results of search: CreatorOfTweet with: https://twitter.com/CalKABOOM/statuses/ ... 9032331265
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/GarryBridges/status ... 5072891904
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/GarryBridges/status ... 5072891904 using: <user>
Extract ID from URL: 904341845072891904 : https://twitter.com/GarryBridges/status ... 5072891904
Results of search: CreatorOfTweet with: https://twitter.com/GarryBridges/status ... 5072891904
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/mancsbound/statuses ... 5379471360
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/mancsbound/statuses ... 5379471360 using: <user>
Extract ID from URL: 904341785379471360 : https://twitter.com/mancsbound/statuses ... 5379471360
Results of search: CreatorOfTweet with: https://twitter.com/mancsbound/statuses ... 5379471360
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/Tunnelbreeze/status ... 9316160512
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/Tunnelbreeze/status ... 9316160512 using: <user>
Extract ID from URL: 904341759316160512 : https://twitter.com/Tunnelbreeze/status ... 9316160512
Results of search: CreatorOfTweet with: https://twitter.com/Tunnelbreeze/status ... 9316160512
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Perform chained search: [1] https://twitter.com/annieobrien94/statu ... 6111663105
Perform custom search: #chain/total: 2/2 using: <user>
Start search: CreatorOfTweet with: https://twitter.com/annieobrien94/statu ... 6111663105 using: <user>
Extract ID from URL: 904341756111663105 : https://twitter.com/annieobrien94/statu ... 6111663105
Results of search: CreatorOfTweet with: https://twitter.com/annieobrien94/statu ... 6111663105
Handle results: 1 nextstep: 2/2
End of chain: Store results: 1
Results: 10
Saving to: C:\Users\martin\AppData\Roaming\rootjazz\Twitterdub\saved_data\search_manchesteruk_2017-09-03_2.txt
Started: 03/09/2017 08:55 AM
Finished: 03/09/2017 08:56 AM
ID: 7898a6b6-1d0c-429e-ae1e-1bdfd1b23057
Action ran for: 0hr:0min:45s

Re: Suggestions / feature requests / improvements

Posted: Sun Sep 03, 2017 1:58 pm
by martin@rootjazz
not sure if the version I am using is the latest version, but I will build and push as is definitely working here

Re: Suggestions / feature requests / improvements

Posted: Sun Sep 03, 2017 2:14 pm
by martin@rootjazz

Re: Suggestions / feature requests / improvements

Posted: Sun Sep 03, 2017 3:51 pm
by omegasolutions
Some of the most basic stuff is missing from TwitterDub, that you take for granted in Instadub.

You can't select a file in TwitterDub from the Follow Tab.

Re: Suggestions / feature requests / improvements

Posted: Mon Sep 04, 2017 11:15 pm
by martin@rootjazz
Just type it in :roll:

But will add the file selector if you really want.

Re: Suggestions / feature requests / improvements

Posted: Tue Sep 05, 2017 9:57 am
by bitcoin
martin@rootjazz wrote:Just type it in :roll:

But will add the file selector if you really want.
You guys over there have that?? Tssss :evil:

Re: Suggestions / feature requests / improvements

Posted: Wed Sep 06, 2017 1:37 am
by martin@rootjazz
bitcoin wrote:
martin@rootjazz wrote:Just type it in :roll:

But will add the file selector if you really want.
You guys over there have that?? Tssss :evil:
instadub makes at least 5x more sales, so it gets 5x more time on it. Infact probably more that 5x. I really should check sales stats really, don't think have checked them this year