Scraping profile deatils with instadub

Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Scraping profile deatils with instadub

Post by Bartekef »

Hey,
I remember back in the day I could scrape up to 40k profile details with one ip, I just got back to Instadub and I got only 19 results before email verification :shock:

What is the realistic number of profiles you could scrape profile details of nowadays?

I would need to scrape like 500k total....

edit: or "challenge required" im not sure, I closed the instadub, opened it up and tried "verify account" and it only got me 'challenge required'

Btw. I used to put the email code to the account in accounts tab and click "server verify" (or something different) before; I don't see this option anymore.

Also when I clicked "open in acc browser" it asked me for proxy, but I don't use it anymore (and there is no proxy attached to the account neither) so it won't open the instagram.com so I could verify it or do the challenge.

Logs for this last aciton: 92562

Thanks!
jacton
Posts: 56
Joined: Thu Dec 24, 2020 7:25 pm

Re: Scraping profile deatils with instadub

Post by jacton »

yall still can use this bot? For me its dead :(
Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Re: Scraping profile deatils with instadub

Post by Bartekef »

Waiting for Martin :roll:
Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Re: Scraping profile deatils with instadub

Post by Bartekef »

Bartekef wrote: Wed Nov 23, 2022 7:40 pm Hey,
I remember back in the day I could scrape up to 40k profile details with one ip, I just got back to Instadub and I got only 19 results before email verification :shock:

What is the realistic number of profiles you could scrape profile details of nowadays?

I would need to scrape like 500k total....

edit: or "challenge required" im not sure, I closed the instadub, opened it up and tried "verify account" and it only got me 'challenge required'

Btw. I used to put the email code to the account in accounts tab and click "server verify" (or something different) before; I don't see this option anymore.

Also when I clicked "open in acc browser" it asked me for proxy, but I don't use it anymore (and there is no proxy attached to the account neither) so it won't open the instagram.com so I could verify it or do the challenge.

Logs for this last aciton: 92562

Thanks!
Oh, I see there is option to scrape CSV details without using accounts, just on the web browser. Any chance for "CSV Details FULL" option anytime soon?! That's what I really need now:!:

Especially what I need is not only bio (as it scrapes it! wow!) but also account category - the thing you can choose using your profile - for example: musician, artist, band, graphic designer etc. just like it's done when you use Scrape CSV Details function:

Image

Can we have it? :)

And the checkpoint again when trying to scrape CSV Details. I've sent the new logs: 77777 ( lol ! )

But if we can have it in web scraper then it would fix everything !
Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Re: Scraping profile deatils with instadub

Post by Bartekef »

@martin@rootjazz
User avatar
martin@rootjazz
Site Admin
Posts: 33604
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping profile deatils with instadub

Post by martin@rootjazz »

Bartekef wrote: Wed Nov 23, 2022 7:40 pm
Btw. I used to put the email code to the account in accounts tab and click "server verify" (or something different) before; I don't see this option anymore.
Server Verified removed a while back
Also when I clicked "open in acc browser" it asked me for proxy, but I don't use it anymore (and there is no proxy attached to the account neither) so it won't open the instagram.com so I could verify it or do the challenge.
Check your OS network settings, that can also set the proxy

windows / start key
type: proxy settings

should show the option
User avatar
martin@rootjazz
Site Admin
Posts: 33604
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping profile deatils with instadub

Post by martin@rootjazz »

don't see anything in logs showing ID setting proxy
User avatar
martin@rootjazz
Site Admin
Posts: 33604
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping profile deatils with instadub

Post by martin@rootjazz »

Bartekef wrote: Sun Nov 27, 2022 4:18 pm
Oh, I see there is option to scrape CSV details without using accounts, just on the web browser. Any chance for "CSV Details FULL" option anytime soon?! That's what I really need now:!:

Especially what I need is not only bio (as it scrapes it! wow!) but also account category - the thing you can choose using your profile - for example: musician, artist, band, graphic designer etc. just like it's done when you use Scrape CSV Details function:

Can we have it? :)

And the checkpoint again when trying to scrape CSV Details. I've sent the new logs: 77777 ( lol ! )

But if we can have it in web scraper then it would fix everything !
let me look
User avatar
martin@rootjazz
Site Admin
Posts: 33604
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping profile deatils with instadub

Post by martin@rootjazz »

possible data:

Code: Select all

{
	"data": {
		"user": {
			"biography": "ʕ•ᴥ•ʔ   \n                                                   ✞︎\n                                                          𝒊  ♥︎ ♫︎",
			"bio_links": [],
			"biography_with_entities": {
				"raw_text": "ʕ•ᴥ•ʔ   \n                                                   ✞︎\n                                                          𝒊  ♥︎ ♫︎",
				"entities": []
			},
			"blocked_by_viewer": false,
			"restricted_by_viewer": null,
			"country_block": false,
			"external_url": "http://www.xxxvlde0s.com/",
			"external_url_linkshimmed": "https://l.instagram.com/?u=http%3A%2F%2Fwww.xxxvlde0s.com%2F\u0026e=ATOQm7gTzqzjV5QePTqKwj7IpoFV5qnpKgYRLWd8MKSpTD3Hvp_j_-rK4Nex-YcZ0PRe6z655flSOCrj\u0026s=1",
			"edge_followed_by": {
				"count": 59
			},
			"fbid": "17841431734125447",
			"followed_by_viewer": false,
			"edge_follow": {
				"count": 50
			},
			"follows_viewer": false,
			"full_name": "𝓈ℯ𝓍𝓏 𝒷𝒾𝓉𝒸𝒽💫",
			"group_metadata": null,
			"has_ar_effects": false,
			"has_clips": false,
			"has_guides": false,
			"has_channel": false,
			"has_blocked_viewer": false,
			"highlight_reel_count": 0,
			"has_requested_viewer": false,
			"hide_like_and_view_counts": true,
			"id": "31723577804",
			"is_business_account": false,
			"is_eligible_to_view_account_transparency": false,
			"is_professional_account": false,
			"is_supervision_enabled": false,
			"is_guardian_of_viewer": false,
			"is_supervised_by_viewer": false,
			"is_supervised_user": false,
			"is_embeds_disabled": false,
			"is_joined_recently": false,
			"guardian_id": null,
			"business_address_json": null,
			"business_contact_method": "UNKNOWN",
			"business_email": null,
			"business_phone_number": null,
			"business_category_name": null,
			"overall_category_name": null,
			"category_enum": null,
			"category_name": null,
			"is_private": true,
			"is_verified": false,
			"edge_mutual_followed_by": {
				"count": 0,
				"edges": []
			},
			"profile_pic_url": "https://instagram.fgye3-1.fna.fbcdn.net/v/t51.2885-19/312925134_381182664149160_6313260631613982983_n.jpg?stp=dst-jpg_s150x150\u0026_nc_ht=instagram.fgye3-1.fna.fbcdn.net\u0026_nc_cat=100\u0026_nc_ohc=HWRsAiUaN1sAX94RqP2\u0026edm=AOQ1c0wBAAAA\u0026ccb=7-5\u0026oh=00_AfCbW8-WlWWB0qKx_Xj-G1ecjOkw_qZMMgmtYFvwd6oDsw\u0026oe=638BDB5E\u0026_nc_sid=8fd12b",
			"profile_pic_url_hd": "https://instagram.fgye3-1.fna.fbcdn.net/v/t51.2885-19/312925134_381182664149160_6313260631613982983_n.jpg?stp=dst-jpg_s320x320\u0026_nc_ht=instagram.fgye3-1.fna.fbcdn.net\u0026_nc_cat=100\u0026_nc_ohc=HWRsAiUaN1sAX94RqP2\u0026edm=AOQ1c0wBAAAA\u0026ccb=7-5\u0026oh=00_AfBNwApUCLcSd1cjj6CfTPjp_umDwynSDVuXSMncroezbA\u0026oe=638BDB5E\u0026_nc_sid=8fd12b",
			"requested_by_viewer": false,
			"should_show_category": false,
			"should_show_public_contacts": false,
			"transparency_label": null,
			"transparency_product": "STATE_CONTROLLED_MEDIA",
			"username": "acidcentral",
			"connected_fb_page": null,
			"pronouns": [],
			"edge_felix_video_timeline": {
				"count": 0,
				"page_info": {
					"has_next_page": false,
					"end_cursor": null
				},
				"edges": []
			},
			"edge_owner_to_timeline_media": {
				"count": 2,
				"page_info": {
					"has_next_page": false,
					"end_cursor": ""
				},
				"edges": []
			},
			"edge_saved_media": {
				"count": 0,
				"page_info": {
					"has_next_page": false,
					"end_cursor": null
				},
				"edges": []
			},
			"edge_media_collections": {
				"count": 0,
				"page_info": {
					"has_next_page": false,
					"end_cursor": null
				},
				"edges": []
			},
			"edge_related_profiles": {
				"edges": []
			}
		}
	},
	"status": "ok"
}
User avatar
martin@rootjazz
Site Admin
Posts: 33604
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping profile deatils with instadub

Post by martin@rootjazz »

next update will include:

category_name
overall_category_name
business_category_name
Post Reply