DOE AGORA Qualquer valor

Marcadores

OSINT TOOLS A List of Open Source Verification and Investigation Tools and Methods

 Bellingcat’s Digital Forensics Tools
A List of Open Source Verification and Investigation Tools and Methods
Hello, welcome to Bellingcat’s openly and freely available digital list of tools and methods we use during our open source investigations. You can follow our work on our website, Twitter and Facebook. Feel free to suggest tools not yet listed here! This is version 2.5 (December 1, 2017).
The list includes satellite and mapping services, tools for verifying photos and videos, websites to archive hyperlinks, and much more. The list is long, and may seem dauntingw. There are guides at the end of the document, highlighting the methods and use of these tools in further detail. We also provide tailored digital forensics workshops.
Currently, I’m trying to find a better way to thematically structure this list and I’m working on a more extensive guide with simple case-studies to the tools we use most. This will be an openly available and digital guide in English and hopefully Arabic too. I will share a link here once it is published. Feel free to contact me with questions or suggestions via e-mail (christiaantriebert@bellingcat.com) or Twitter (@trbrtc).

Maps, Satellites & Streetview

Name
Description
Pros
Cons
Link
Bing Maps
Microsoft satellite and mapping service.
More recent and higher resolution imagery than Google, e.g. in Iraq.
Difficult to check the date of the imagery (this tool doesn’t work anymore)
converting coordinates
Convert geographic coordinates between different notation styles.
DigitalGlobe
Satellite imagery vendor.
Preview available via the catalogus, search tool very easy to use.
$
DualMaps
Combines Google’s road maps, aerial view, and street view in one embeddable tool.
EarthExplorer
Geograph
Georeferenced images.
GeoNames
Database of location names.
Wide variety of different spellings in various languages.
Google Earth Pro
Historical imagery.
Google Maps

StreetView, many large cities in U.S., Europe, modelled in 3D.
No historical satellite imagery, but historic streetview images available in many places.
Google Photos
(former Panoramio)




HERE WeGo

More recent satellite imagery than Google in e.g. Iraq.
Mapillary
Crowdsourced street level photos.
OpenStreetCam
OpenStreetMap
Radiant Earth
Sentinel Playground

Updated every 5-10 days with new imagery, dependent on cloud cover.
Ability to explore a variety of GIS variables eg NDVI or NDWO.
Generally low resolution of 10m/px.
TerraServer
Satellite imagery vendor.
Highest resolution available (0.3m).
$ to preview high-resolution satellite imagery.
Wikimapia
Crowdsourced information related to geographic locations.
Possibility to switch between Google/Bing/OSM. Massive amount of UCG information.
Yandex Maps

Geobased Searches

Name
Description
Pros
Cons
Link
Echosec
Geobased searches.
Instagram, Twitter, VKontakte, Foursquare
$
Livemap
Interactive live map of conflict news.
Variety of countries available: Afghanistan, Iraq, Syria, U.S., Ukraine, Venezuela, etc.
Photo-Map.RU
Geotagged4 VKontakte posts.
Twitter
Insert in search box: geocode:[coordinates],[radius-km], for example: geocode:36.222285,43.998233,2km (only works with km, so 500m = 0.5km)
There’s a tool for it too.
Easy to fake.

WarWire
Geobased searches.

$
YouTube

Images, Videos and Metadata

Name
Description
Pros
Cons
Link
Guides
Amnesty YouTube Dataviewer
Reverse image (video still) search and exact uploading time.

Searches for a number of still, not each frame is included (thus results may be left out).
Exiftool
Read and manipulate metadata for a vast number of file types. Note: no GUI
Floss, Cross platform and very easy to integrate in scripts.
Yet to encounter any (Have only used on GNU/Linux).
See forum and FAQ on linked page
Foca
Extract metadata.
Windows based, open sourced 2017.
No native linux support.
FotoForensics
Image forensics tool.
Simple, web based.
Public access, information not private.
GooFile
Extract metadata.
Simple to use.
Doesn't work well outside Kali
Image Forensics
Web based image forensics tool.
Can easily identify fake or doctored images
Public access, information not private.
InVID
Verification plugin to help journalists verify images and videos. Contextual data, Metadata, reverse search (Google, Yandex, Baidu), image forensic, Magnifie)r


invid-project.eu (plugins for Chrome, Firefox (Windows, Mac OS X, Linux)
https://www.youtube.com/watch?v=nmgbFODPiBY
Irfanview
Extract metadata.
Jeffrey's Image Metadata Viewer
Extract metadata, online.
Only requires web browser.
Public access, information not private.
Reveal Image Verification Assistant
Forensic providing eight filters to detect still images alterations.
Web-based image tool.
Also available within InVID verification plugin.
Documented with examples and explanations of the different filters. Developed in Reveal project.
reverse image search
e

Recommended plugin: RevEye, which searches Google, Yandex, Baidu and Bing.


SpiderPig
Extract metadata.
Command line interface and scriptable.
Requires dependencies and knowledge of web technologies.
Splunk
Extract metadata.
Report grade analysis and presentation.
Not simple to setup and deploy.

Social Media

Facebook

Name
Description
Pros
Cons
Link
Guides
Graph.tips
Automatically advanced searches for Facebook profiles.
IntelTechniques
Various tools for analyzing Facebook profiles and pages.
Livemap
Live broadcasts around the world.
peoplefindThor
Search Tool
Find accounts by name, email, screen name, and phone.
StalkScan
Automatic advanced searches per Facebook profile.
Video Downloader Online
Download Facebook videos.

Instagram

Name
Description
Pros
Cons
Link
Guides
Websta
Find other locations in Instagram’s database near a particular location.
Use direct URL with a location ID, e.g. websta.me/location/116231

LinkedIn

Name
Description
Pros
Cons
Link
Guides
Socilab
Visualise and analyse your own LinkedIn network.

Snapchat

Name
Description
Pros
Cons
Link
Guides
Snap Map
Searchable map of geotagged snaps.

Tumblr

Name
Description
Pros
Cons
Link
Guides
Tumblr Originals
Find original posts per Tumblr, thus excluding reblogs.

Twitter

Name
Description
Pros
Cons
Link
Guides
InVID verification plugin
InVID plugin provides a Twitter advanced search by time interval up to the minute.
Allows to document use cases from the past without APIs and time limit. Allows to search for content within a user-defined time range after a breaking news.
Automates the conversion between calendar date and Unix timestamp in Twitter advanced search: https://youtu.be/nmgbFODPiBY?t=4m21s
Onemilliontweetmap
Tweets map per locations up to 6 hours old, keyword search option.
Treeverse
Chrome extension to visualise Twitter  conversations.
Tweetreach
Find reach of tweets.

Advanced search operators available, same as Google advanced search.
Twitter advanced search
Search by date, keywords, etc.
Twitter geobased search
geocode:[coordinates],[radius-km], for example: geocode:36.222285,43.998233,2km
There’s a tool for it too.



Twlets
Download anyone’s tweets, followers and likes in an Excel sheet.
Easy and quick to use, there’s a Chrome extension too.
Goes up to 3,200 tweets, followers and likes.
quarter tweets
Geobased Twitter search.

(YouTube

Name
Description
Pros
Cons
Link
Guides
Amnesty YouTube Dataviewer
Reverse image (video still) search and exact uploading time.

Searches for a number of still, not each frame is included (thus results may be left out).
Geo Search Tool
Search for YouTube videos based on location.

Transport

Air

Name
Description
Pros
Cons
Link
Guides
AirNav RadarBox
Tracking flights, including private and military jets.
ADS-B Exchange Global Radar
Tracking flights.
Includes a number of military aircraft.
FlightAware
FlightRadar24
Tracking (civilian) flights.

$ to go back in 12 month archive.

Marine

MarineTraffic
VesselFinder

Railway

Trains
Full interactive maps of various railway networks in European countries.

Misc

WikiRoutes
Public transport database.

Date & Time

Name
Description
Pros
Cons
Link
Guides
SunCalc
Make approximation of time of the day using shadow direction.
Wolfram|Alpha
Does a load of things, including weather forecasts per day and location.

Individuals, WhoIs, IPs, Website Analysis

Name
Description
Pros
Cons
Link
Guides
Passive DNS
Collects, stores and analyses data from thousands of passive DNS collection sensors.
Complete unadulterated historical and current DNS information.
15 API calls day, 15 web based searches a day.
Censys.io
Censys continually monitors every reachable server and device on the Internet.
Complete wealth of knowledge of internet connected devices.
None
Domain Tools



domaintools.com

DNS History
Collection of historical DNS information.
Free, simple and easy to use.
Sometimes limited in availability.
Geo IP Tool
Check your own IP, handy to check if your VPN is working,



Shodan
Internet of things search engine.
Can find heaps of misconfigured network connected devices.
Lives in the grayzone...


Archiving, Downloading & Internet Storage

Name
Description
Pros
Cons
Link
Guides
Archive.is
Let’s you archive any webpage.




CachedView
Google Cached Pages for any web site. It is the ultimate internet cache.


http://cachedview.com/

DMCA
Search takedown notices


lumendatabase.org

Gruber
Slideshare downloader


http://grub.cballenar.me/

Historic Breach Database List



https://publicdbhost.dmca.gripe/random/

Wayback Machine
Archives websites. Download an entire website from the Wayback Machine.


github.com/hartator/wayback-machine-downloader


Miscellaneous

Name
Description
Pros
Cons
Link
Guides
BlockExplorer
Following a bitcoin trail or following a bitcoin account ?



Check
Collaborative fact-checking.
User guide, Bellingcat’s Check team
Document Redaction
Useful for removing potentially harmful content in Pdfs before viewing, like traceback.
Google Search Operators
Such as searching for a specific filetype (e.g. PDF) or on a specific website.
Hunch.ly
Research sidekick.
Insecam
Network live IP video cameras directory.
LittleSis
Database of who-knows-who at the heights of business and government.
Lumen
Collects and analyses legal complaints and requests for removal of online materials, helping Internet users to know their rights and understand the law. These data enables us to study the prevalence of legal threats and let Internet users see the source of content removals.
Maltego




Montage
For collaborative working.
OpenCorporates
Database of companies in the world.




People tracer
Snopes2
Suspect a story may be fake or an urban legend.
TimelineJS by Knight Lab
Make an interactive timeline of events.
Unknown Hash ID
On investigation if you come across a hash but don’t know what it is (and warrants further investigation) this will identify the type.
Visual Investigative Scenarios (VIS)
Zoopla
Search for property with the UK's leading resource. Browse houses and flats for sale and to rent, and find estate agents in any area.

Guides & Handbooks
WEAPONS
  • Open guide called “Itrace” by Conflict Armament Research, lots of information on different kinds of munitions and weapons presented graphically on a map format, itrace.conflictarm.com

Data Visualisation

Name
Description
Pros
Cons
Link
Guides
DataBasic.io
Web tools for beginners that introduce concepts of working with data
DataWrapper
Easy to use chart and mapping tool
Google Fusion Tables
Maptia
Visual investigative scenarios
RAWGraphs
Free webtool to quickly visualize your data
Open Desktop Semantic Search

Searches unstructured data well

Online Security & Privacy

SEARCH ENGINES WHICH PROTECT PRIVACY
  • DuckDuckGo, Internet search engine, protecting privacy, duckduckgo.com
  • StartPage, Internet search engine, protecting privacy, startpage.com
  • Qwant, Internet search engine, protecting privacy, qwant.com

Sources per Country

Iraq

Name
Description
Pros
Cons
Links
Provinces of the so-called Islamic State

Syria

Name
Description
Pros
Cons
Links
Maps
Opposition media
See this excellent list compiled by Noor Nahas of multimedia sources from Syrian opposition groups,


Provinces of the so-called Islamic State,





Companies

Expert/Source Tools

Name
Description
Pros
Cons
Link
Guides
Expertise Finder
Search engine for journalists to find experts (currently only academics in USA and Canada), contact information on page, no login, 30k experts listed
Expert Guide
Academics open to media in Australia:

Australia only.
Help a Reporter Out
Post a query and experts reply, mainly USA and Canada, quality of replies is hit or miss
She Source
Female experts, mainly USA.
Speakezee
Academics and those with PhDs, mainly UK:
Expert File
Mix of experts, mainly USA and Canada:

Enviar esta postagem
Marcadores:

Comentários

Postar um comentário

Ebook

Postagens mais visitadas