November 4, 2026
Updated: November 4, 2026
How open-source intelligence works, where the data comes from, how attackers and red teams use it, where the legal lines are and how to shrink your exposure.
Mohammed Khalil

What is OSINT? Open-source intelligence (OSINT) is intelligence produced by collecting and analyzing publicly or commercially available information to answer a specific question. In cybersecurity, that information includes DNS records, certificate logs, code repositories, job postings, social media and breach notices. Attackers use OSINT for reconnaissance, which MITRE ATT&CK tracks as tactic TA0043, to find exposed systems and plausible phishing pretexts. Defenders and red teams use the same sources to see their organization the way an attacker does, then remove or monitor what they find, within legal and privacy limits such as GDPR.
The U.S. Intelligence Community's IC OSINT Strategy 2024–2026, released by ODNI and the CIA on March 8, 2024, defines OSINT as "intelligence derived exclusively from publicly or commercially available information" that addresses specific intelligence priorities, requirements or gaps. Two parts of that definition matter for security teams.
First, the source must be open: anything a member of the public could lawfully see, request or buy. That includes websites, public records, DNS, certificate logs, internet scan data, social media, news and commercial data sets. It excludes anything that requires breaking into a system, using someone else's credentials or deceiving a person into handing data over.
Second, OSINT is intelligence, not information. A list of 400 subdomains is raw data. "Three of those subdomains run an unpatched VPN appliance, and the IT admin who manages them lists the product on a public profile" is intelligence, because it answers a question someone actually needs answered.
OSINT is one of several intelligence disciplines. ODNI lists it alongside human intelligence (HUMINT), signals intelligence (SIGINT), geospatial intelligence (GEOINT) and measurement and signature intelligence (MASINT). In cybersecurity, it is the discipline most teams can practice without special access.
| Term | What it means | How it relates to OSINT |
|---|---|---|
| OSINT | Intelligence produced from publicly or commercially available information to answer a defined question | The discipline itself |
| Reconnaissance | The attacker phase of gathering information to plan an operation (MITRE ATT&CK TA0043) | Uses OSINT heavily, plus active steps such as scanning and phishing for information |
| Threat intelligence | Analysis of adversaries, their tools and campaigns | Often built partly from OSINT, combined with private telemetry and vendor data |
| Attack surface management | Continuous discovery and monitoring of an organization's internet-facing assets | An operational program that applies OSINT techniques to your own assets |
| Doxxing | Publishing private information about a person to harass or expose them | An abuse of open sources; not OSINT practice and out of scope for security work |
Passive collection reads sources without touching the target: search engines, certificate logs, archived pages, published filings. The target cannot tell it is happening. Active collection interacts with the target, for example scanning its IP ranges or messaging an employee. ATT&CK keeps these apart: Active Scanning (T1595) and Phishing for Information (T1598) are reconnaissance techniques, but they are not passive OSINT, and in a security test they need explicit written authorization.
OSINT follows the same intelligence cycle that ODNI describes for every intelligence discipline. Its overview of U.S. national intelligence lists six steps: planning and direction, collection, processing and exploitation, analysis and production, dissemination, and evaluation. The table below shows how each step looks in a security exposure assessment.

| Step | What happens | Example in a security exposure assessment |
|---|---|---|
| 1. Planning and direction | Define the question, the scope and what is off limits | "What could an outside attacker learn about our finance team and payment systems?" Scope: company domains and brands; no personal accounts or family members |
| 2. Collection | Gather raw data from open sources | Certificate logs, DNS, scan databases, code repositories, job postings, filings, public breach notifications |
| 3. Processing and exploitation | Turn raw data into usable, comparable records | Deduplicate hostnames, resolve them to owners, tag each item with source and date |
| 4. Analysis and production | Judge what the data means and produce findings | "Legacy login portal still resolves and is not in the asset inventory; five finance staff are named in job ads that list the payment platform" |
| 5. Dissemination | Deliver findings to people who can act | Exposure report to IT, security and the business owner, with fixes ranked by risk |
| 6. Evaluation | Check every step and the outcome | Were sources reliable and current? Did owners fix the findings? What should the next cycle ask? |
The planning step does most of the ethical work. A clear question and a written scope stop an assessment from drifting into collecting personal details nobody needs.
Most security-relevant OSINT comes from a short list of source types. Each one maps to a MITRE ATT&CK reconnaissance technique, which is useful because it tells defenders which of their own exposures an attacker is likely to look at first.

Company registrations, regulatory filings, court records, procurement notices and press releases show legal entities, subsidiaries, executives, locations and suppliers. Attackers use them to understand business relationships and timing (ATT&CK T1591, Gather Victim Org Information). Acquisitions matter most: an acquired company's domains and systems often stay outside the parent's inventory for months.
Domain registrations, DNS records and passive DNS history reveal hostnames, mail providers and hosting choices. Certificate Transparency, specified in RFC 6962 and updated by RFC 9162, requires publicly trusted TLS certificates to be logged in public append-only logs. That is good for security, because domain owners can spot certificates issued for their names, but it also means every hostname on a public certificate is searchable. MITRE describes this as Search Open Technical Databases: Digital Certificates (T1596.003), part of T1596, alongside DNS, WHOIS, CDN and scan data.
Search engines for internet-connected devices continuously scan the IPv4 space and index open ports, service banners and certificates. Anyone can query them for an organization's IP ranges. CISA's advisory AA24-038A cites industry reporting that Volt Typhoon used FOFA, Shodan and Censys to search for exposed infrastructure.
Public repositories expose more than code: internal hostnames, employee names, technology choices and, too often, secrets. ATT&CK tracks this as Search Open Websites/Domains: Code Repositories (T1593.003), and its procedure examples include LAPSUS$ searching public repositories for exposed credentials and HAFNIUM finding leaked corporate credentials on GitHub. GitHub reported more than 39 million leaked secrets across its platform in 2024.
A well-documented example: in its September 18, 2023 write-up, Microsoft's Security Response Center explained that an employee had shared a storage URL in a public GitHub repository while contributing open-source AI models. The URL contained an overly permissive SAS token for an internal storage account. Researchers reported it on June 22, 2023, and Microsoft revoked access on June 24. Microsoft said the exposed data included two former employees' workstation backups and internal Teams messages, and that no customer data was exposed. The lesson is that one public link can open a private store.
Professional networks show names, roles, reporting lines and the tools people use. Job postings often name exact products and versions. Company websites, conference talks and press pages add email formats and executive names. These map to T1593 (social media and search engines), T1594 (victim-owned websites) and T1589 (employee names and email addresses). For attackers, this is raw material for pretexts; our guide to what social engineering is explains how those pretexts become phishing, vishing and impersonation attacks.
Breach data is the most sensitive OSINT source. ATT&CK notes in T1589.001 that credentials can leak through search engines, breach dumps and code repositories, and that adversaries buy them on criminal markets and Telegram channels that trade infostealer logs. Defenders need to know when their domains appear in a breach, but that does not justify downloading dumps or testing leaked passwords. The ethical standard is in the legal section below. For how investigators and monitoring services find this material, see our overview of dark web search engines.
MITRE added Query Public AI Services (T1682) to the Reconnaissance tactic in 2026. It covers adversaries using public large language models to aggregate and analyze open information, such as researching staff and business relationships to build pretexts. ATT&CK's procedure examples include Kimsuky using LLMs to identify think tanks and experts for spearphishing and APT42 using them to find official email addresses. AI does not create new sources; it makes aggregation faster and cheaper, which raises the value of reducing what is public in the first place.
| Source | What it can reveal | ATT&CK technique | Defender action |
|---|---|---|---|
| Public records and filings | Subsidiaries, executives, suppliers, acquisitions | T1591 | Bring acquired domains into the asset inventory |
| DNS, WHOIS, certificate logs | Hostnames, forgotten subdomains, mail providers | T1590, T1596.001–.003 | Monitor CT logs; retire unused DNS records |
| Internet scan databases | Open ports, banners, exposed admin panels | T1596.005 | Close or restrict exposed services |
| Code repositories | Secrets, internal hostnames, staff names | T1593.003 | Secret scanning with push protection; rotate leaked keys |
| Social media, job posts, websites | Roles, email formats, tech stack, pretexts | T1593.001, T1594, T1589.002–.003 | Staff awareness; trim job post detail |
| Breach data | Reused credentials, email formats | T1589.001 | Breach notification services, MFA, forced resets |
| Public AI services | Fast aggregation of all of the above | T1682 | Assume aggregation is cheap; reduce source exposure |
MITRE ATT&CK defines the Reconnaissance tactic (TA0043) in one line: the adversary is trying to gather information to plan future operations. In Enterprise v20 it contains twelve techniques. Most are passive OSINT; two involve direct interaction with the target.
| ID | Technique | Passive or active | What attackers look for |
|---|---|---|---|
| T1595 | Active Scanning | Active | Live hosts, open ports, vulnerable services |
| T1592 | Gather Victim Host Information | Mostly passive | Hardware, software, firmware and client configurations |
| T1589 | Gather Victim Identity Information | Passive | Credentials, email addresses, employee names |
| T1590 | Gather Victim Network Information | Passive | Domain properties, DNS, trust relationships, topology, IP ranges, security appliances |
| T1591 | Gather Victim Org Information | Passive | Locations, business relationships, business tempo, roles |
| T1598 | Phishing for Information | Active | Credentials or details elicited through messages, attachments, links or calls |
| T1682 | Query Public AI Services | Passive | Aggregated research on people, organizations and technologies |
| T1597 | Search Closed Sources | Passive (paid or private) | Threat intel vendor data and purchased technical data |
| T1596 | Search Open Technical Databases | Passive | DNS and passive DNS, WHOIS, certificates, CDNs, scan databases |
| T1593 | Search Open Websites/Domains | Passive | Social media, search engines, code repositories |
| T1681 | Search Threat Vendor Data | Passive | Public reporting on the attacker's own campaigns |
| T1594 | Search Victim-Owned Websites | Passive | Staff names, contacts, products, technologies on the target's own sites |
Each technique ID links to its MITRE page from the list of Reconnaissance techniques. For the framework as a whole, see our MITRE ATT&CK framework explainer.
CISA, NSA, FBI and partner agencies published advisory AA24-038A on February 7, 2024, about the PRC state-sponsored group Volt Typhoon. Its reconnaissance section maps the group's behavior directly to TA0043. According to the advisory, the actors conducted extensive pre-compromise reconnaissance to learn about the target organization (T1591), its network (T1590) and its staff (T1589), including web searches (T1593) and victim-owned sites (T1594), with a focus on key network and IT administrators. In some intrusions, the agencies observed the actors targeting the personal email of key network and IT staff after compromise.
The advisory adds that the reconnaissance likely helped the actors blend in; in some cases they avoided using compromised credentials outside normal working hours. That is the defender's lesson: what is public about your administrators and your network shapes how quietly an attacker can operate later.
MITRE's own detection notes for these techniques say the activity has a very high false positive rate and often happens outside the target's visibility. You cannot log someone reading your job postings. That is why ATT&CK's mitigation for the whole tactic, Pre-compromise (M1056), focuses on limiting information exposure, monitoring your external attack surface and lookalike domains, and training staff, rather than on detection.
Defenders use OSINT to answer one question before an attacker does: what can someone outside learn about us, and what could they do with it? In practice, that work splits into three programs.
Exposure assessment. A point-in-time OSINT review run through the intelligence cycle above. It produces a report of exposed assets, leaked secrets, sensitive documents and people-related risk, each with an owner and a fix.
Attack surface management. The continuous version for technical assets: discovering domains, subdomains, IP ranges, cloud resources and services, and flagging changes. Our guide to attack surface management explains how to run it as a program. For U.S. critical infrastructure and state, local, tribal and territorial organizations, CISA's no-cost Cyber Hygiene services scan internet-facing systems for weak configurations and known vulnerabilities.
Brand and identity monitoring. Watching certificate logs and new domain registrations for lookalikes of your brand, plus breach notifications for your domains. Lookalike domains are the setup for phishing and impersonation; our explainer on homoglyph attacks shows how attackers build them from visually similar characters.
Red teams and penetration testers use OSINT for the same reason attackers do: it shows where the realistic entry points are. The difference is authorization and purpose. A red team engagement starts with reconnaissance so that the scenario reflects what a real adversary could learn, and its findings go back to the organization so it can remove the exposure.
OSINT feeds three parts of a test:
Good testers write OSINT limits into the rules of engagement before collection starts:
The report should show what was found, where it was found, why it matters and how to remove or monitor it, without republishing more personal data than the finding needs.
"Publicly available" does not mean "free to use for any purpose." The legal limits depend on where you are, whose data you collect and what you do with it. This section is general information, not legal advice; check with counsel before running OSINT programs that involve personal data.
Under the EU General Data Protection Regulation (Regulation (EU) 2016/679), personal data is any information relating to an identified or identifiable person, whether or not it is public. Collecting staff names, roles and email addresses for a security assessment is processing personal data, so it needs a lawful basis under Article 6 (security assessments commonly rely on legitimate interests in Article 6(1)(f), which requires a balancing test), must respect the principles in Article 5 such as purpose limitation and data minimization, and triggers transparency duties under Article 14 when data is not collected from the person directly. Article 9 adds stricter rules for special categories such as biometric data.
Enforcement shows that scraping public sources is not a defense on its own. The Dutch Supervisory Authority fined Clearview AI EUR 30.5 million for building a facial recognition database from photos scraped from public websites without a legal basis, processing biometric data and failing transparency duties. The European Data Protection Board's summary lists violations of Articles 5, 6, 9, 12, 14, 15 and 27.
In the United States, the main line is unauthorized access. The Computer Fraud and Abuse Act (18 U.S.C. 1030) prohibits accessing computers without authorization or exceeding authorized access, and the Supreme Court narrowed the meaning of "exceeds authorized access" in Van Buren v. United States (June 3, 2021). Reading a public web page is not hacking; using a leaked password, bypassing a login or scraping against technical blocks can cross the line. State privacy laws also apply to how personal data is collected and used.
| Situation | Acceptable for security OSINT | Crosses the line |
|---|---|---|
| Organization's domains, certificates, IP ranges | Yes, within scope | Scanning ranges you do not own without permission |
| Employees in their professional role | Names, roles and work email formats, minimized | Home addresses, family, personal accounts, private photos |
| Code repositories | Reporting exposed secrets to the owner | Using a found key to access a system |
| Breach data | Domain-level notifications; counts of affected accounts | Downloading dumps, cracking hashes, testing passwords |
| Engaging people | Only when social engineering is authorized in writing | Fake profiles or messages outside an agreed test |
| Publishing findings | Remediation report to the client | Posting personal data or doxxing anyone |
For investigators who need a formal standard, the Berkeley Protocol on Digital Open Source Investigations, published by the UN Human Rights Office and UC Berkeley's Human Rights Center, sets out legal and ethical methods for gathering, analyzing and preserving open-source information, including the safety of people who appear in it.
OSINT tools change constantly, so it is more useful to know the categories than to memorize a list. Use any tool only against assets you own or are authorized to assess.
| Category | What it does | Examples (plain text) |
|---|---|---|
| Asset discovery frameworks | Enumerate domains, subdomains and related infrastructure from many sources | OWASP Amass, theHarvester |
| Automated OSINT collectors | Run modular lookups and correlate results about domains, emails and hosts | SpiderFoot, Recon-ng |
| Internet scan search engines | Query indexed ports, banners and certificates by IP range or domain | Shodan, Censys, FOFA |
| Certificate Transparency search | Find certificates issued for your domains, including lookalikes | crt.sh and CT monitoring services |
| Link analysis and graphing | Visualize relationships between people, domains and infrastructure | Maltego |
| Secret scanning | Detect keys and tokens in code before or after they are pushed | GitHub secret scanning and push protection; open-source secret scanners |
| Directories of resources | Catalogs of free OSINT sources by category | OSINT Framework |
OWASP Amass is an OWASP Foundation project for attack surface mapping and external asset discovery using OSINT and reconnaissance techniques. MITRE's Pre-compromise mitigation (M1056) names SpiderFoot and Recon-ng for finding leaked information and Shodan and Censys for monitoring the external attack surface. GitHub's secret scanning documentation explains how to enable detection and push protection.
You cannot delete the internet, but you can remove the details that make an attack cheap and add monitoring for what must stay public.

Re-run the same review each quarter and after mergers, product launches and reorganizations, because each one changes what is public.
OSINT is intelligence built from information anyone can lawfully access, such as websites, public records, DNS and certificate logs, code repositories and social media. It becomes intelligence when it is collected and analyzed to answer a specific question, such as what an attacker could learn about your organization.
Collecting genuinely public information is generally legal, but how you collect and use it still matters. Accessing systems without authorization, using leaked credentials or ignoring privacy law can make it illegal. In the EU, publicly available personal data is still personal data under GDPR, so it needs a lawful basis and data minimization.
Examples include finding an organization's subdomains in certificate logs, spotting an exposed service in an internet scan database, discovering a leaked API key in a public repository, mapping roles from job postings and staff pages, and receiving a breach notification for company email addresses.
OSINT describes where information comes from: open, public or commercially available sources. Threat intelligence describes what it is about: adversaries, their tools and their campaigns. Threat intelligence often uses OSINT, but it also draws on private telemetry, incident data and vendor feeds.
Most OSINT is passive, meaning it reads sources without contacting the target. Active steps such as scanning the target's systems or messaging its employees are reconnaissance but not passive OSINT, and in security testing they require explicit written authorization.
Common categories are asset discovery frameworks such as OWASP Amass, automated collectors such as SpiderFoot and Recon-ng, internet scan search engines such as Shodan and Censys, certificate transparency search, link analysis tools such as Maltego, and secret scanners. Use them only on assets you own or are authorized to assess.
OSINT is where most attacks start and where many can be stopped. Run the self-review and footprint checklist in this guide, fix the exposures you find, and put monitoring on what has to stay public.
To test whether what is public about your organization is enough for a real adversary to get in, DeepStrike's red teaming services begin with reconnaissance and scoping, model entry through phishing, social engineering and leaked credential reuse, and deliver attacker pathways, evidence and remediation priorities. For the continuous technical side, start with our guide to attack surface management.
Mohammed Khalil is a Cybersecurity Architect at DeepStrike, specializing in advanced penetration testing and offensive security operations. With certifications including CISSP, OSCP, and OSWE, he has led numerous red team engagements for Fortune 500 companies, focusing on cloud security, application vulnerabilities, and adversary emulation. His work involves dissecting complex attack chains and developing resilient defense strategies for clients in the finance, healthcare, and technology sectors.

Stay secure with DeepStrike penetration testing services. Reach out for a quote or customized technical proposal today
Contact Us