Scrape Twitter - suggestion
- martin@rootjazz
- Site Admin
- Posts: 34674
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Twitter - suggestion
Great, thank you! Gonna check it soon and let you know.martin@rootjazz wrote:https://soundcloudmanager.com/updatetesting.html
Anyways SCM run slow again. I mean it doesnt eat my memory like it used to before, but it perform follow action for almost 3 hours now and followed 18 profiles from .txt already to this moment...not so many as for 3 hours (I didn't update SCM to the link I quoted yet)
- martin@rootjazz
- Site Admin
- Posts: 34674
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Twitter - suggestion
Soundcloud broke something in the bot, just updated, might be your issue
https://soundcloudmanager.com/updatetesting.html:
https://soundcloudmanager.com/updatetesting.html:
Re: Scrape Twitter - suggestion
Hey everything works well. Scrapper works fine, too.martin@rootjazz wrote:Soundcloud broke something in the bot, just updated, might be your issue
https://soundcloudmanager.com/updatetesting.html:
Could you please give me a tip how to set-up this 'regex' you mentioned to extract twitter URLs? The easiest way?
Cheers,
Bartekef
- martin@rootjazz
- Site Admin
- Posts: 34674
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Twitter - suggestion
I think the quickest and easiest way would be to use a URL extractor, then take all extracted URLs, put them in a file, order the file alphabetically, then just extract the twitter ones manually
Search google: extract urls from text
first result:
https://pgl.yoyo.org/urlex/
will extract your URLs
then you can use notepad++ with textfx plugin to order lines alphabetically
Search google: extract urls from text
first result:
https://pgl.yoyo.org/urlex/
will extract your URLs
then you can use notepad++ with textfx plugin to order lines alphabetically
Re: Scrape Twitter - suggestion
Wonderful! Thank you
Now I have txt full of URLs, but I have another obstacle in my way...
it returns me sometimes 3-4 different urls in one line, e.g. youtube.com/xxx; twitter.com/xxx; instagram.com/xxx
in spite of:
youtube.com/xxx
twitter.com/xxx
instagram.com/xxx
so even If I sorted em alphabetically, I still dont have text document with twitter URLs all in different lines, and only twitter URLs in that lines (but also youtube, etc.)
do you know what I mean?
I know that isn't related with soundcloud manager actually, but as you see im not an expert, and I would be really grateful if you helped me with that!
Cheers,
Bartekef
Now I have txt full of URLs, but I have another obstacle in my way...
it returns me sometimes 3-4 different urls in one line, e.g. youtube.com/xxx; twitter.com/xxx; instagram.com/xxx
in spite of:
youtube.com/xxx
twitter.com/xxx
instagram.com/xxx
so even If I sorted em alphabetically, I still dont have text document with twitter URLs all in different lines, and only twitter URLs in that lines (but also youtube, etc.)
do you know what I mean?
I know that isn't related with soundcloud manager actually, but as you see im not an expert, and I would be really grateful if you helped me with that!
Cheers,
Bartekef
Re: Scrape Twitter - suggestion
Wonderful! Thank youmartin@rootjazz wrote:I think the quickest and easiest way would be to use a URL extractor, then take all extracted URLs, put them in a file, order the file alphabetically, then just extract the twitter ones manually
Search google: extract urls from text
first result:
https://pgl.yoyo.org/urlex/
will extract your URLs
then you can use notepad++ with textfx plugin to order lines alphabetically
Now I have txt full of URLs, but I have another obstacle in my way...
it returns me sometimes 3-4 different urls in one line, e.g. youtube.com/xxx; twitter.com/xxx; instagram.com/xxx
in spite of:
youtube.com/xxx
twitter.com/xxx
instagram.com/xxx
so even If I sorted em alphabetically, I still dont have text document with twitter URLs all in different lines, and only twitter URLs in that lines (but also youtube, etc.)
do you know what I mean?
I know that isn't related with soundcloud manager actually, but as you see im not an expert, and I would be really grateful if you helped me with that!
Cheers,
Bartekef
Re: Scrape Twitter - suggestion
This is what it gives me:martin@rootjazz wrote:I think the quickest and easiest way would be to use a URL extractor, then take all extracted URLs, put them in a file, order the file alphabetically, then just extract the twitter ones manually
Search google: extract urls from text
first result:
https://pgl.yoyo.org/urlex/
will extract your URLs
then you can use notepad++ with textfx plugin to order lines alphabetically
[img]http://fotowrzut.pl/tmp/upload/QQLK6EKOZH/1.jpg
[/img]
I used other extractors but none met my expectations, every result has different links in one line
- martin@rootjazz
- Site Admin
- Posts: 34674
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Twitter - suggestion
lol, that is terrible.
Let me see what I can, don't forget to remind / hassle me until I sort it though
Let me see what I can, don't forget to remind / hassle me until I sort it though
- martin@rootjazz
- Site Admin
- Posts: 34674
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact: