Socid-Extractor - Extract Accounts Info From Personal Pages On Various Sites For OSINT Purpose

Extract information about a user from profile webpages / API responses and save it in machine-readable format.

Usage

As a command-line tool:

Without installing:

As a Python library:

Installation

The latest development version can be installed directly from GitHub:

Sites and methods

More than 100 methods for different sites and platforms are supported!

Google (all documents pages, maps contributions), cookies required Yandex (disk, albums, znatoki, music, realty, collections), cookies required to prevent captcha blocks Mail.ru (my.mail.ru user mainpage, photo, video, games, communities) Facebook (user & group pages) VK.com (user page) OK.ru (user page) Instagram Reddit Medium Flickr Tumblr TikTok GitHub

...and many others.

You can also check tests file for data examples, schemes file to expore all the methods.

When it may be useful

Getting all available info by the username or/and account UID. Examples: Week in OSINT, OSINTCurious Users tracking, checking that the account was previously known (by ID) even if all public info has changed. Examples: Aware Online Searching by commonly used cross-service UIDs (GAIA ID, Facebook UID, Yandex Public ID, etc.) DB leaks of forums and platforms in SQL format Indexed links that contain target profile ID Searching for tracking data by comparison with other IDs - how it works, how can it be used. Law enforcement online requests

Tools using socid_extractor

Maigret - powerful namechecker, generate a report with all available info from accounts found.

TheScrapper - scrape emails, phone numbers and social media accounts from a website.

YaSeeker - tool to gather all available information about Yandex account by login/email.

Marple - scrape search engines results for a given username.

Testing

Contributing

Check separate page if you want to add a new methods of fix anything.