logo svg
logo

November 4, 2026

Updated: November 4, 2026

What Is OSINT (Open-Source Intelligence)? A Security Guide

How open-source intelligence works, where the data comes from, how attackers and red teams use it, where the legal lines are and how to shrink your exposure.

Mohammed Khalil

Mohammed Khalil

Featured Image

What is OSINT? Open-source intelligence (OSINT) is intelligence produced by collecting and analyzing publicly or commercially available information to answer a specific question. In cybersecurity, that information includes DNS records, certificate logs, code repositories, job postings, social media and breach notices. Attackers use OSINT for reconnaissance, which MITRE ATT&CK tracks as tactic TA0043, to find exposed systems and plausible phishing pretexts. Defenders and red teams use the same sources to see their organization the way an attacker does, then remove or monitor what they find, within legal and privacy limits such as GDPR.

What Is OSINT?

The U.S. Intelligence Community's IC OSINT Strategy 2024–2026, released by ODNI and the CIA on March 8, 2024, defines OSINT as "intelligence derived exclusively from publicly or commercially available information" that addresses specific intelligence priorities, requirements or gaps. Two parts of that definition matter for security teams.

First, the source must be open: anything a member of the public could lawfully see, request or buy. That includes websites, public records, DNS, certificate logs, internet scan data, social media, news and commercial data sets. It excludes anything that requires breaking into a system, using someone else's credentials or deceiving a person into handing data over.

Second, OSINT is intelligence, not information. A list of 400 subdomains is raw data. "Three of those subdomains run an unpatched VPN appliance, and the IT admin who manages them lists the product on a public profile" is intelligence, because it answers a question someone actually needs answered.

OSINT is one of several intelligence disciplines. ODNI lists it alongside human intelligence (HUMINT), signals intelligence (SIGINT), geospatial intelligence (GEOINT) and measurement and signature intelligence (MASINT). In cybersecurity, it is the discipline most teams can practice without special access.

OSINT vs related terms

TermWhat it meansHow it relates to OSINT
OSINTIntelligence produced from publicly or commercially available information to answer a defined questionThe discipline itself
ReconnaissanceThe attacker phase of gathering information to plan an operation (MITRE ATT&CK TA0043)Uses OSINT heavily, plus active steps such as scanning and phishing for information
Threat intelligenceAnalysis of adversaries, their tools and campaignsOften built partly from OSINT, combined with private telemetry and vendor data
Attack surface managementContinuous discovery and monitoring of an organization's internet-facing assetsAn operational program that applies OSINT techniques to your own assets
DoxxingPublishing private information about a person to harass or expose themAn abuse of open sources; not OSINT practice and out of scope for security work

Passive vs active OSINT

Passive collection reads sources without touching the target: search engines, certificate logs, archived pages, published filings. The target cannot tell it is happening. Active collection interacts with the target, for example scanning its IP ranges or messaging an employee. ATT&CK keeps these apart: Active Scanning (T1595) and Phishing for Information (T1598) are reconnaissance techniques, but they are not passive OSINT, and in a security test they need explicit written authorization.

The OSINT Intelligence Cycle

OSINT follows the same intelligence cycle that ODNI describes for every intelligence discipline. Its overview of U.S. national intelligence lists six steps: planning and direction, collection, processing and exploitation, analysis and production, dissemination, and evaluation. The table below shows how each step looks in a security exposure assessment.

The six-step OSINT intelligence cycle applied to a security exposure assessment, from planning to evaluation
StepWhat happensExample in a security exposure assessment
1. Planning and directionDefine the question, the scope and what is off limits"What could an outside attacker learn about our finance team and payment systems?" Scope: company domains and brands; no personal accounts or family members
2. CollectionGather raw data from open sourcesCertificate logs, DNS, scan databases, code repositories, job postings, filings, public breach notifications
3. Processing and exploitationTurn raw data into usable, comparable recordsDeduplicate hostnames, resolve them to owners, tag each item with source and date
4. Analysis and productionJudge what the data means and produce findings"Legacy login portal still resolves and is not in the asset inventory; five finance staff are named in job ads that list the payment platform"
5. DisseminationDeliver findings to people who can actExposure report to IT, security and the business owner, with fixes ranked by risk
6. EvaluationCheck every step and the outcomeWere sources reliable and current? Did owners fix the findings? What should the next cycle ask?

The planning step does most of the ethical work. A clear question and a written scope stop an assessment from drifting into collecting personal details nobody needs.

OSINT Sources: Where Open-Source Intelligence Comes From

Most security-relevant OSINT comes from a short list of source types. Each one maps to a MITRE ATT&CK reconnaissance technique, which is useful because it tells defenders which of their own exposures an attacker is likely to look at first.

Six OSINT sources mapped to what they reveal, the MITRE ATT&CK reconnaissance technique and the defender action

Public records and corporate filings

Company registrations, regulatory filings, court records, procurement notices and press releases show legal entities, subsidiaries, executives, locations and suppliers. Attackers use them to understand business relationships and timing (ATT&CK T1591, Gather Victim Org Information). Acquisitions matter most: an acquired company's domains and systems often stay outside the parent's inventory for months.

DNS, WHOIS and certificate transparency

Domain registrations, DNS records and passive DNS history reveal hostnames, mail providers and hosting choices. Certificate Transparency, specified in RFC 6962 and updated by RFC 9162, requires publicly trusted TLS certificates to be logged in public append-only logs. That is good for security, because domain owners can spot certificates issued for their names, but it also means every hostname on a public certificate is searchable. MITRE describes this as Search Open Technical Databases: Digital Certificates (T1596.003), part of T1596, alongside DNS, WHOIS, CDN and scan data.

Internet scan databases

Search engines for internet-connected devices continuously scan the IPv4 space and index open ports, service banners and certificates. Anyone can query them for an organization's IP ranges. CISA's advisory AA24-038A cites industry reporting that Volt Typhoon used FOFA, Shodan and Censys to search for exposed infrastructure.

Code repositories

Public repositories expose more than code: internal hostnames, employee names, technology choices and, too often, secrets. ATT&CK tracks this as Search Open Websites/Domains: Code Repositories (T1593.003), and its procedure examples include LAPSUS$ searching public repositories for exposed credentials and HAFNIUM finding leaked corporate credentials on GitHub. GitHub reported more than 39 million leaked secrets across its platform in 2024.

A well-documented example: in its September 18, 2023 write-up, Microsoft's Security Response Center explained that an employee had shared a storage URL in a public GitHub repository while contributing open-source AI models. The URL contained an overly permissive SAS token for an internal storage account. Researchers reported it on June 22, 2023, and Microsoft revoked access on June 24. Microsoft said the exposed data included two former employees' workstation backups and internal Teams messages, and that no customer data was exposed. The lesson is that one public link can open a private store.

Social media, job postings and company websites

Professional networks show names, roles, reporting lines and the tools people use. Job postings often name exact products and versions. Company websites, conference talks and press pages add email formats and executive names. These map to T1593 (social media and search engines), T1594 (victim-owned websites) and T1589 (employee names and email addresses). For attackers, this is raw material for pretexts; our guide to what social engineering is explains how those pretexts become phishing, vishing and impersonation attacks.

Breach data, handled ethically

Breach data is the most sensitive OSINT source. ATT&CK notes in T1589.001 that credentials can leak through search engines, breach dumps and code repositories, and that adversaries buy them on criminal markets and Telegram channels that trade infostealer logs. Defenders need to know when their domains appear in a breach, but that does not justify downloading dumps or testing leaked passwords. The ethical standard is in the legal section below. For how investigators and monitoring services find this material, see our overview of dark web search engines.

Public AI services

MITRE added Query Public AI Services (T1682) to the Reconnaissance tactic in 2026. It covers adversaries using public large language models to aggregate and analyze open information, such as researching staff and business relationships to build pretexts. ATT&CK's procedure examples include Kimsuky using LLMs to identify think tanks and experts for spearphishing and APT42 using them to find official email addresses. AI does not create new sources; it makes aggregation faster and cheaper, which raises the value of reducing what is public in the first place.

SourceWhat it can revealATT&CK techniqueDefender action
Public records and filingsSubsidiaries, executives, suppliers, acquisitionsT1591Bring acquired domains into the asset inventory
DNS, WHOIS, certificate logsHostnames, forgotten subdomains, mail providersT1590, T1596.001–.003Monitor CT logs; retire unused DNS records
Internet scan databasesOpen ports, banners, exposed admin panelsT1596.005Close or restrict exposed services
Code repositoriesSecrets, internal hostnames, staff namesT1593.003Secret scanning with push protection; rotate leaked keys
Social media, job posts, websitesRoles, email formats, tech stack, pretextsT1593.001, T1594, T1589.002–.003Staff awareness; trim job post detail
Breach dataReused credentials, email formatsT1589.001Breach notification services, MFA, forced resets
Public AI servicesFast aggregation of all of the aboveT1682Assume aggregation is cheap; reduce source exposure

How Attackers Use OSINT: MITRE ATT&CK Reconnaissance (TA0043)

MITRE ATT&CK defines the Reconnaissance tactic (TA0043) in one line: the adversary is trying to gather information to plan future operations. In Enterprise v20 it contains twelve techniques. Most are passive OSINT; two involve direct interaction with the target.

IDTechniquePassive or activeWhat attackers look for
T1595Active ScanningActiveLive hosts, open ports, vulnerable services
T1592Gather Victim Host InformationMostly passiveHardware, software, firmware and client configurations
T1589Gather Victim Identity InformationPassiveCredentials, email addresses, employee names
T1590Gather Victim Network InformationPassiveDomain properties, DNS, trust relationships, topology, IP ranges, security appliances
T1591Gather Victim Org InformationPassiveLocations, business relationships, business tempo, roles
T1598Phishing for InformationActiveCredentials or details elicited through messages, attachments, links or calls
T1682Query Public AI ServicesPassiveAggregated research on people, organizations and technologies
T1597Search Closed SourcesPassive (paid or private)Threat intel vendor data and purchased technical data
T1596Search Open Technical DatabasesPassiveDNS and passive DNS, WHOIS, certificates, CDNs, scan databases
T1593Search Open Websites/DomainsPassiveSocial media, search engines, code repositories
T1681Search Threat Vendor DataPassivePublic reporting on the attacker's own campaigns
T1594Search Victim-Owned WebsitesPassiveStaff names, contacts, products, technologies on the target's own sites

Each technique ID links to its MITRE page from the list of Reconnaissance techniques. For the framework as a whole, see our MITRE ATT&CK framework explainer.

A real case: Volt Typhoon

CISA, NSA, FBI and partner agencies published advisory AA24-038A on February 7, 2024, about the PRC state-sponsored group Volt Typhoon. Its reconnaissance section maps the group's behavior directly to TA0043. According to the advisory, the actors conducted extensive pre-compromise reconnaissance to learn about the target organization (T1591), its network (T1590) and its staff (T1589), including web searches (T1593) and victim-owned sites (T1594), with a focus on key network and IT administrators. In some intrusions, the agencies observed the actors targeting the personal email of key network and IT staff after compromise.

The advisory adds that the reconnaissance likely helped the actors blend in; in some cases they avoided using compromised credentials outside normal working hours. That is the defender's lesson: what is public about your administrators and your network shapes how quietly an attacker can operate later.

Why reconnaissance is hard to detect

MITRE's own detection notes for these techniques say the activity has a very high false positive rate and often happens outside the target's visibility. You cannot log someone reading your job postings. That is why ATT&CK's mitigation for the whole tactic, Pre-compromise (M1056), focuses on limiting information exposure, monitoring your external attack surface and lookalike domains, and training staff, rather than on detection.

How Defenders Use OSINT: Exposure Assessment and Attack Surface

Defenders use OSINT to answer one question before an attacker does: what can someone outside learn about us, and what could they do with it? In practice, that work splits into three programs.

Exposure assessment. A point-in-time OSINT review run through the intelligence cycle above. It produces a report of exposed assets, leaked secrets, sensitive documents and people-related risk, each with an owner and a fix.

Attack surface management. The continuous version for technical assets: discovering domains, subdomains, IP ranges, cloud resources and services, and flagging changes. Our guide to attack surface management explains how to run it as a program. For U.S. critical infrastructure and state, local, tribal and territorial organizations, CISA's no-cost Cyber Hygiene services scan internet-facing systems for weak configurations and known vulnerabilities.

Brand and identity monitoring. Watching certificate logs and new domain registrations for lookalikes of your brand, plus breach notifications for your domains. Lookalike domains are the setup for phishing and impersonation; our explainer on homoglyph attacks shows how attackers build them from visually similar characters.

A defender's OSINT self-review

  1. Write the question and scope. List owned domains, brands, subsidiaries and IP ranges. Exclude employees' personal accounts and family members.
  2. Map technical exposure. Pull hostnames from certificate logs and DNS, compare them with the asset inventory, and flag anything unknown or unowned.
  3. Check what scan databases show. Look up your own IP ranges and note exposed management interfaces, remote access services and outdated software versions.
  4. Search for secrets. Turn on secret scanning with push protection for your organization's repositories and review public repositories that mention your domains.
  5. Review people-related exposure. Read your own job postings, staff pages and press material the way an attacker would: which roles, tools and email formats are visible?
  6. Check breach exposure safely. Use breach notification services that alert on your domains without handing you the passwords.
  7. Report and fix. Give each finding an owner, a fix and a date, then repeat the review each quarter and after acquisitions or major launches.

How Red Teams and Pentesters Use OSINT in Reconnaissance

Red teams and penetration testers use OSINT for the same reason attackers do: it shows where the realistic entry points are. The difference is authorization and purpose. A red team engagement starts with reconnaissance so that the scenario reflects what a real adversary could learn, and its findings go back to the organization so it can remove the exposure.

OSINT feeds three parts of a test:

Rules of engagement for OSINT in a test

Good testers write OSINT limits into the rules of engagement before collection starts:

The report should show what was found, where it was found, why it matters and how to remove or monitor it, without republishing more personal data than the finding needs.

Legal and Ethical Boundaries of OSINT

"Publicly available" does not mean "free to use for any purpose." The legal limits depend on where you are, whose data you collect and what you do with it. This section is general information, not legal advice; check with counsel before running OSINT programs that involve personal data.

GDPR and personal data

Under the EU General Data Protection Regulation (Regulation (EU) 2016/679), personal data is any information relating to an identified or identifiable person, whether or not it is public. Collecting staff names, roles and email addresses for a security assessment is processing personal data, so it needs a lawful basis under Article 6 (security assessments commonly rely on legitimate interests in Article 6(1)(f), which requires a balancing test), must respect the principles in Article 5 such as purpose limitation and data minimization, and triggers transparency duties under Article 14 when data is not collected from the person directly. Article 9 adds stricter rules for special categories such as biometric data.

Enforcement shows that scraping public sources is not a defense on its own. The Dutch Supervisory Authority fined Clearview AI EUR 30.5 million for building a facial recognition database from photos scraped from public websites without a legal basis, processing biometric data and failing transparency duties. The European Data Protection Board's summary lists violations of Articles 5, 6, 9, 12, 14, 15 and 27.

U.S. law

In the United States, the main line is unauthorized access. The Computer Fraud and Abuse Act (18 U.S.C. 1030) prohibits accessing computers without authorization or exceeding authorized access, and the Supreme Court narrowed the meaning of "exceeds authorized access" in Van Buren v. United States (June 3, 2021). Reading a public web page is not hacking; using a leaked password, bypassing a login or scraping against technical blocks can cross the line. State privacy laws also apply to how personal data is collected and used.

The ethical line

SituationAcceptable for security OSINTCrosses the line
Organization's domains, certificates, IP rangesYes, within scopeScanning ranges you do not own without permission
Employees in their professional roleNames, roles and work email formats, minimizedHome addresses, family, personal accounts, private photos
Code repositoriesReporting exposed secrets to the ownerUsing a found key to access a system
Breach dataDomain-level notifications; counts of affected accountsDownloading dumps, cracking hashes, testing passwords
Engaging peopleOnly when social engineering is authorized in writingFake profiles or messages outside an agreed test
Publishing findingsRemediation report to the clientPosting personal data or doxxing anyone

For investigators who need a formal standard, the Berkeley Protocol on Digital Open Source Investigations, published by the UN Human Rights Office and UC Berkeley's Human Rights Center, sets out legal and ethical methods for gathering, analyzing and preserving open-source information, including the safety of people who appear in it.

OSINT Tools: Categories, Not a Shopping List

OSINT tools change constantly, so it is more useful to know the categories than to memorize a list. Use any tool only against assets you own or are authorized to assess.

CategoryWhat it doesExamples (plain text)
Asset discovery frameworksEnumerate domains, subdomains and related infrastructure from many sourcesOWASP Amass, theHarvester
Automated OSINT collectorsRun modular lookups and correlate results about domains, emails and hostsSpiderFoot, Recon-ng
Internet scan search enginesQuery indexed ports, banners and certificates by IP range or domainShodan, Censys, FOFA
Certificate Transparency searchFind certificates issued for your domains, including lookalikescrt.sh and CT monitoring services
Link analysis and graphingVisualize relationships between people, domains and infrastructureMaltego
Secret scanningDetect keys and tokens in code before or after they are pushedGitHub secret scanning and push protection; open-source secret scanners
Directories of resourcesCatalogs of free OSINT sources by categoryOSINT Framework

OWASP Amass is an OWASP Foundation project for attack surface mapping and external asset discovery using OSINT and reconnaissance techniques. MITRE's Pre-compromise mitigation (M1056) names SpiderFoot and Recon-ng for finding leaked information and Shodan and Censys for monitoring the external attack surface. GitHub's secret scanning documentation explains how to enable detection and push protection.

How to Reduce Your OSINT Footprint

You cannot delete the internet, but you can remove the details that make an attack cheap and add monitoring for what must stay public.

OSINT footprint reduction checklist with five controls for the organization and five for its people

For the organization

For the people

Re-run the same review each quarter and after mergers, product launches and reorganizations, because each one changes what is public.

Frequently Asked Questions

What is OSINT in simple terms?

OSINT is intelligence built from information anyone can lawfully access, such as websites, public records, DNS and certificate logs, code repositories and social media. It becomes intelligence when it is collected and analyzed to answer a specific question, such as what an attacker could learn about your organization.

Is OSINT legal?

Collecting genuinely public information is generally legal, but how you collect and use it still matters. Accessing systems without authorization, using leaked credentials or ignoring privacy law can make it illegal. In the EU, publicly available personal data is still personal data under GDPR, so it needs a lawful basis and data minimization.

What are examples of OSINT?

Examples include finding an organization's subdomains in certificate logs, spotting an exposed service in an internet scan database, discovering a leaked API key in a public repository, mapping roles from job postings and staff pages, and receiving a breach notification for company email addresses.

What is the difference between OSINT and threat intelligence?

OSINT describes where information comes from: open, public or commercially available sources. Threat intelligence describes what it is about: adversaries, their tools and their campaigns. Threat intelligence often uses OSINT, but it also draws on private telemetry, incident data and vendor feeds.

Is OSINT passive?

Most OSINT is passive, meaning it reads sources without contacting the target. Active steps such as scanning the target's systems or messaging its employees are reconnaissance but not passive OSINT, and in security testing they require explicit written authorization.

What tools are used for OSINT?

Common categories are asset discovery frameworks such as OWASP Amass, automated collectors such as SpiderFoot and Recon-ng, internet scan search engines such as Shodan and Censys, certificate transparency search, link analysis tools such as Maltego, and secret scanners. Use them only on assets you own or are authorized to assess.

Next Step: See What an Attacker Can Learn About You

OSINT is where most attacks start and where many can be stopped. Run the self-review and footprint checklist in this guide, fix the exposures you find, and put monitoring on what has to stay public.

To test whether what is public about your organization is enough for a real adversary to get in, DeepStrike's red teaming services begin with reconnaissance and scoping, model entry through phishing, social engineering and leaked credential reuse, and deliver attacker pathways, evidence and remediation priorities. For the continuous technical side, start with our guide to attack surface management.

About The Author

Mohammed Khalil is a Cybersecurity Architect at DeepStrike, specializing in advanced penetration testing and offensive security operations. With certifications including CISSP, OSCP, and OSWE, he has led numerous red team engagements for Fortune 500 companies, focusing on cloud security, application vulnerabilities, and adversary emulation. His work involves dissecting complex attack chains and developing resilient defense strategies for clients in the finance, healthcare, and technology sectors.

Sources and References

background
Let's hack you before real hackers do

Stay secure with DeepStrike penetration testing services. Reach out for a quote or customized technical proposal today

Contact Us