Foreign Policy Research & Analysis, Intelligence Collection, Analysis & Estimates, Terrorism Information

What are the best open source global intelligence databases?

Let me share some tips with you that I’ve picked-up along the way that helps me do what I do, and am sought after for Global Intelligence Research & Analysis (GIRA). I’ll apologize in advance if I share something you already know, or are aware of. Since I do not know you, nor your current level of knowledge, I am not going to make any assumptions.

One of the things I have determined over the years about GIRA is simply this: There are two types of people doing GIRA…the professionals who are really good at it, and then everybody else. How can you tell if someone has the intrinsic “stuff” to be really good at GIRA? I like illustrating things using metaphors and examples; so, here’s one on being a GIRA expert. Have you ever heard of the social science concept called “Abraham Maslow’s Hierarchy of Needs?” Maslow theorized that human behavior can be categorized based on one of five need levels, and the level someone is on currently, can go up or down on a real-time basis in the blink-of-an-eye. The five levels are:

  1. Physiological Needs. These are the things to sustain human life. Breathing oxygen is as basic as it can get.
  2. Security Needs. Shelter, clothing, avoiding immediate danger.
  3. Socialization Needs. The human trait to interact with other humans.
  4. Recognition, Achievement Needs. Human desire to advance, self-worth, be seen by others as adding value.
  5. Self-Actualization Needs. Ever wonder why someone will voluntarily jump out of a perfectly good airplane to use a parachute? Why does a NASCAR racing driver want to drive a 3,000+ lb car at 200 mph while he’s literally bumper-to-bumper and door-to-door – only inches apart – from three or four other cars? Why did Air Force pilot, Chuck Yeager, want to fly an airplane to break the sound barrier in 1947? These are examples of people self-actualizing; doing something because there is a burning desire inside them that is so important, it defies understanding by most people…except for the few others with the same unfulfilled need.

If you want to be a really good GIRA expert, your desire must derive from Maslow’s 5th level. A good example of a self-actualizing GIRA expert is me…how important is it to me to self-actualize GIRA? Well, I am writing about it right now on Christmas Day. Not too many people will see this as being a burning need, so much so, I need to do it on Christmas. The GIRA tips and techniques I will describe are only useful if you put them to work…you gotta, wanna know.

Tips on Open Source Intelligence Research & Analysis

  1. Establish your personal knowledge baseline. My four kids are all grown and on their own. When they were in grade school they frequently asked me, “Dad, what do we have to do to be smart?” My answer was: “Read anything and everything you can get your hands on.” When I said anything and everything, I told the kids that meant if they were just waiting in the grocery store checkout line, read the ingredients on the box of cookies in your basket! You have to be a voracious reader. The reason it is so critical to have an ultra-high level personal knowledge baseline is simply because when you start to get serious about GIRA, you are not going to have the time to focus on a topic to produce a GIRA product of integrity quick enough to do someone any good if you have to go school yourself, first. Sometimes you have that luxury; but, if someone is paying you money for your intellectual product, you can’t take too much time to produce it. People and/or companies requesting GIRA from you, view time & money in the same context. This being said, having an evolving, expanding knowledge baseline in general, and a certain topic, in specific, allows you to monitor global happenings within the topic area and quickly spot something that’s not part of your baseline knowledge and determine whether it’s something significant enough to dig further.
  2. Determining if your generic personal knowledge baseline is adequate. About 15 years ago when I decided to start dabbling in GIRA for-hire, I knew already that my ability to find, absorb & analyze data for myself, or for the seminars & college classes I taught, or the magazine articles I wrote, or my management duties, was adequate. But, I wondered what I could do to compare my knowledge against a recognized base of global knowledge? I don’t know if you’ve ever sat for any type of professionally recognized credentialing exam, like the CPA (certified public accountant), or the Bar exam to be an attorney, or the exam to become a licensed U.S. Customs Broker, etc. These are some of the toughest exams anywhere. For the level of knowledge needed on a global scale, I decided to apply for candidacy to become a Foreign Service Officer in the U.S. Diplomatic Corps. Before the State Dept will even interview, you have to pass the FSO exam. These days the FSO jobs are highly sought after, which makes the candidacy process very competitive. For anyone without 10-15 yrs of experience that’s useful in the Diplomatic Corps, the younger, entry-level candidates won’t get too far in the application process unless they at least have a Masters Degree. So, when you sit for the FSO exam, if you are not extremely well versed in a broad range of global topics, you won’t pass. I’ve taken numerous professional credential exams before; the FSO exam is/was the toughest I’ve ever taken…but, I passed. That was good enough for me, and I didn’t pursue FSO idea further. It intrigued me, but at 50 back then, I decided I’d to let the idea go. You don’t need to go this far to see if your knowledge measures up; but, you get my drift…you have to really know your stuff.
  3. Where to find GIRA primary source material. There’s two types of GIRA, Static Data R&A, and Dynamic, Emergent Data R&A. SDRA is generally the history-based side of GIRA. SDRA can be at either a macro or micro level. Sources for this type of analysis are not difficult to find because the SDRA report you generate is not meant to give actively changing, ongoing emergent R&A. Don’t get me wrong; SDRA reports are not supposed to contain just stale (i.e.; mostly past tense that’s not changing anymore) information, unless the requester has asked specifically for a mostly historical report. SDRAs I’ve done for corporations, like an inquiry about a country’s climate for a new business venture, need a mix of historical data, and anything relevant to the current business climate. If you were writing an SDRA report on Indonesia and during your R&A an airliner crashes on takeoff from Jakarta’s international airport, it’s not likely to impact report, and it would be too early to include it until the impact to your report, if any is understood. On the flip side, reporting intelligence information that’s in the DEDRA category requires primary source material that is extremely time sensitive. This is when your ability to identify information sources beyond the typical is really important. There are many sources that can cover static (historical) and dynamic (emergent) information. Remember: regardless what kind of data a source has available on the internet, it didn’t get there for free…it’s being paid for somehow. Some of the primary sources I list below are those you cannot access for free. One thing about GIRA…are you looking to prepare a macro report or a micro one? What I’ve listed below is not everything I use, just the ones I’ve used reliably from time-to-time (some a lot more than others). I have other sources I’ll use to fine tune my info and double check my facts. I pick-up new sources all of the time.

Lastly, GIRA is not an expertise you can just learn out of a textbook. My methods, sources and thoughts expressed here, work for me, and there may be 100 people out there that disagrees. So be it. Everyone can choose their own path that makes them happy and/or financially successful. What you do with all of this info I’ve provided is now up to you! Note: Due to the dozens and dozens of sources I listed, I did not take the time to add-in all of the hyperlinks…gotta leave ya with something to do!

Best of luck!

Air Force E-publishing

USAF Air University

Air Power Australia

American Special Operations

AVIALOGS

Aviation Week & Space Technology

Baseops.net Flight Planning, Aviation Weather & Military Discounts

Bibliography of the Vietnam War

Black Vault

Boeing Acronyms And Definitions

Currency Converter

Defense Department

Defense One

Defense Technical Information Center

Demand Media Studios

Designation-Systems.Net

Federal Aviation Administration

Federation of American Scientists –

Global Digital Media Network

Guide to Military Equipment and Civil Aviation

International Rescue Committee (IRC)

Joe Baugher's Military Aircraft Index

Joint Electronic Library, Joint Concepts

Mach One Manuals

Mine Action Group

MIT Security Studies Program (SSP)

Myinforms World News

National Security Archive

National Security Council

National Security Internet Archive

NATO

OECD

Pacific War Online Encyclopedia

RadioReference.com

SearchMil.com

SIPRI

Spyflight

The Library of Congress.

Time Zone Map

U.S. Military – CNN.com

World Health Organization

United Nations International Childrens’ Fund (UNICEF)

United Nations High Commission for Refugees

United Nations Educational, Scientific and Cultural Organization

United Nations Development Programme

United Nations Peacekeeping Operations

The World Bank

International Labor Organization

World Food Programme

Center for Intelligence and Security Studies

Center for Strategic and International Studies

RAND Corp Research Services and Public Policy Analysis

SmartBrief | Industry E-mail Newsletters for Professionals

Sanctions Programs and Country Information

American History [ushistory.org]

DoDBuzz

Global Security

Department of Homeland Security

Heritage Foundation

National Security Network

Military.com

U.S. State Dept.

Stratfor

Office of the Director of National Intelligence

The National Counterintelligence Executive

The National Counterterrorism Center

Bureau of Intelligence and Research

National Technical Information Service

Office of Terrorism and Financial Intelligence

ProQuest

Federal Research Division of Library of Congress

U.S. Army Foreign Military Studies Office

Defense Intelligence Agency

NATO Open Source Intelligence Handbook

OSINT Deep Web Search for user names and e-mail addresses

NATO OSINT Reader

Open Source Solutions

Janes.com

Digital Globe – High Resolution Global Imagery

Foreign Policy.com

U.S. Dept of Commerce

Steve Miller, Copyright (c) 2006, 2012, 2015, 2018

Standard