Professional Documents
Culture Documents
Human Processes in Intelligence Analysis: Phase 1 Overview
Human Processes in Intelligence Analysis: Phase 1 Overview
HUMAN PROCESSES IN
INTELLIGENCE
PHASE I OVERVIEW
JUL 18
T
9S:
"Robert V. Katter
2Christine A. Natgonmery
John R. Thompson
S~80 7 10 02 2
U, S. ARMY RESEARCH INSTITUTE
FOR THE BEHAVIORAL AND SOCIAL SCIENCES
A Field Operating Agercy under the Jurisdiction of the
Deputy Chief of St3ff for Personnel
FRANKLIN A. HART
JOSEPH ZEIDNER Colonel, US Army
Technical Director Commander
NO"TICES
DISTRIBUTION: Fromrrey distribution v! this report has bwNh maleo by ARI|. Plem edrs €oreseSnldenc
JonCIRV•in distribution of reports to: U. , At"
Army e&M" Institute #Of theIiell
fthsioad w~d
So"
ATTN: PERI.'rP, 5001 Eiverho.mf Avenue, Aklexadris, Viro~nle 22333.
SThe
findirip in this report we not to be €ownodtm~ aI on oflfoW Deo• of the Amw pftmi,
unlessl so desipwm by other' authorized doculments.
UncIlasaif Led
SECURITY CLASSIFICATION Of THIS PAGE CMwn Date A;"..*
REPORT DOCUME14TATION PAGE BEFOE RCMPLTINFORK
1. RIEPORT NUMBER 7 jVACslow No 3. FRECIPIENT'S CATALOG UMumma
(~UMN £O9SSS
RAE IM RVSISPW
IN INELGNE#ALYSIS: /1~ia ,i§
J_
S. PERFORMING oRe. ReponT MUMMER
*?. DIST IP4UTION ST AT 914 NT (of A.o "street a~t~rd In EI.E04",f Offm sit 600 R*pmt
k ~
direction; Dr. Stanley M. Halpin (ARI), MAJ William Franklin (INSCOM) and
~~Dr-.
Ruth H_. Phgt a (AT mntnx.
19. Key WORDS (Canthwe !" reV
Analysis
I-achn 4in
61* If flaewy awl fd.mtI 5. S' bi
Intelligence
Imagery
Analytical Procedures
USQAfrMACr(bW?t -mmw
W,.. - 4P6U"0 FDW b' This report provides an
overview of the results of %. study entitled h'Investigation of Method~ologies
and Techniques for Intelligence Analysis.4 The goal of this study was to
develop a framework for understanding human processes in intelligence analysis.
An understanding of thaese processes will be useful during the development or
evaluation of training procedures, doctrine, and system requiremants for
automated support to analyets._
DO S 3 uro o s EOEECLASSIFIED UN
SKTLU AMPIPCATION Olt THIS PASE (10 Dael 1iii.weE)
UNCUV4TY CLAWsIPCA'riovs OF THIS PAGR(Whm Date m0*
JUnclassified
on ~ CASFC1SNO HI A~W~ aaEtad
B .
Research Report 1237
Robert V. Itatter
Christine A. Montgomery
John R. Thompson
SibmIttWd by:
Edger M. Johnson, Chief
HUMAN FACTORS TECHNICAL AREA
Appovad By:
Jaime D. Baker, Acting Directo"
ORGANIZATIONS AND SYSTEMS
RESEARCH LABORATORY
U.S. ARMY RESEARCH ,NSTITUTE FOR THE BEHAVIORAL AND SOCIAL SCIENCES
5001 Eisenhower Avenue. Alixandria, Virginia 22333,
Decemb:er 1979
A%
SII
ARI Research Reports and Technioral Reports are intended for sponsors of
R&D tasks and for other research and military agencies. Any findings ready
for implementation at the tire of publication are presented in the lost part
of the Brief. Upon completion of a major phase of the task, formal recorn-
rnendatlons for official acttor, normally are conveyed to appropriate military
agencies kv briefing or Disposition Form.
It
I
U
:iv
A
FOREWORD
The approach taken in this project was to examine the role and activitieti
of various types of intelligence anplysts, and to develop a descriptive model
of the cognitive processes involved in analysis. This model derives in large
part from current psychological literature and does not provide a new statement
of psychological principles. However, these principles are put in a new context,
intelligence analysis. This report describes the generalized intelligence produc-
tion model and the cognitive model. Separate reports describe in detail a model
of the production of imagery intelligence (ARI Research Report 1210)-and-O• 'A . I I
psychological literature underlying the cognitive model (ARI Technical Report 445)_/ .#
The research was accomplished by a government-contractor team under contract
MDA 903-78-C-2044 and was monitored jointly by INSCOM and AI. Continuous inter-
action and collaboration of personnel from Operating Systems, Inc., INSCOM, and
ARI insured a multidisciplinary approach to this research.
This report and the others from this project provide a framework for detailed
examination of training support and system support requirements in intelligence
analysis. These reports should be very useful during the development or evalua-
tion of training procedures or materials, aralytic procedures, doctrine, and
system requirements for automated support to analysts.
This study was conducted with the assistance and advice of a Study Advi-
sory Group (SAG). The contribution of the individual SAG participants and
the cooperation and support of the agencies represented by these individuals
greatly benefited the accomplishment of study objectives. In addition to
those named below, several INSCOM personnel participanted in the four SAG
meetings, several other intelligence activities provided access to analyst
personnel, and 117 individuals contributed as much as 6 to 8 hours of their
time during interviews and discussions. This high level of participation and
support across the intelligence community is gratefully acknowledged.
SAG Prrticipants
Vi i
A
Human Processea in Intelligence Analysis: Phase I Overview
BRIEF
Requirement:
Approach:
Product:
tx
CONTENTS
xi
4
8. IMPLICATIO!"S OF FINDINGS ...................................
8.1 Analytic Accuracy ..................... .......... .........
...................
..................... ....
8.2 Management of Analytic Work .............................................................
8.3 System Supports for Analytic Functions .........................
8.4 Performance Feedback Arrangements ....
............
8-1
8-2
8-2
8-3
I-
8.8 Selection and career management ................................... ....... s........ 8-3
9. DISTRIBUTION ............................................................ 9.19.
2:A
xti
HUMAN PROCEASSES IN INTELULGECE ANALYSISs PHASE I OVERVIEW
Robbwt V. Katter
Christine A. Montgomery
John A. Thompson
Operating Systems, Inc.
ABSTRACT
- 1-1 ~
at filling this void in tho overall under- Intelligence analysis and the formulation
standlnj of intelligence processing and of operating policies and procedures;
production. The basic objective of the Providing criteria for the development
stody was to develop a oognitive model and evaluation of advanzed system
that would provide a framework for the designs In support of Intelligence
description of the mental processes analysts; Providing criteria for improving
used In intelligence ana,/sls. system arrangements for performance
1.2 Overview of Topics lfoeeback; Facilitating efforts to
develop and evaluate training programs
Section 1 summarizes the development and training doctrine; and, Providing
approach for the model and outlines the assistance In personnel selection,
main results and conclusions. Section 2 motivation, and career planning.
through 6 are based on Interviews and
observations in the field. Section 2
describes the organizational structure The definition of Intelligence ana!ysis
of tho intelligence cycle and treats presented in the Glossary of *ntelll-
Information flow within that framework. gaene Terms and Definitions [see
Se'otion 3 presents a generic model for references] reads as follows: "A pro-
single-source and multi-source InteAli- cess In the production step of the
gence production, Jescribes the core Inteligence cycle In which Intelli-
InforVt•on processing functions of gence Information Is subjncted to
resource management, adaptation, and systematic examination In order to
Interpretation, and outlines task Identify significant facts and derive
processes common to Intelligence conclusions therefrom."
analysis. Sections 4 and 5 describe The problem with this definition is that
The I--
terbs, when used to describe
environmental and individual variables tetrs hnue odsrb
that affect Intelligence analysis activ-
"tat. processes inside the Oblack box", have
no frame •)f reference: What does
Section 6 presents the cognitive model "systematic' mean? What are the sub-
developed In the course of the study. processes In "examination"? What
The model Is synthesized from a review about "Identification'? Osignificant"?
of recent cognitive psychology litera- 'facts'? Oderive'? "conclusions"?
ture. This major section describes the Althouqh the cognitive model now pro-
structure of cognitive capacities, the vides a framework for answering these
basic dynamic cognitive processes, and questions, no such model existed at the
the cyclic modification of memory con- outset of this study.
•/ work In7 the
tents. Section
~analytic light of aspects
describes of
the cognl- Inodrtpusehsreac,
several operating definitions were
thv model, and is based on field obser- adopted. A basic defnition was that
vations made from tha point of view of Inted.igence analysis is what Intelli-
the cognitive model as It was
developed. The final section of the gence analysts do -- an understanding
report, Section 8, presents implications of the processes of Intellgence
of the cognitive model for a number of analysis and the cognltve processes
areas. Those include: Improving the underlying them must cme from the
analysts themselves, faon observing
accuracy and quality of analytic pro-
what they do and asking them about
ducts; Improving the management of
- 1-2 -
- 1-3 -
WHAT 33
WHAT, ARft1
Mode)A duct
ModelU-O
Jo
model~~~~Peese
fofISOM
prepare cnen. h sletd roese wr
as te SIINT rodudefnIntliong
Invetigaion ofg comnayil analyticalntask
nmdel~~~~~~~~fo-NC preare otn.Te eetdpoesswr
- 1-5-
MONTH I OfteANZAT1101 N0. INTERVIEWS/SPECIALTIES
DECEMBNER ca /MT
NATIONAL PHOTOGRAPHIC INTE~RPRETATION CENTER (NPIC) 6/IMINT
SIGINT a 20 INTERVIEWS
TOTALSI IMINT o 5a INTERVIEWS 1 17 INTERVIEWS TO DATE
MULTI-SOUJRCE 338 INTERVIEWS
-1-8-
r r-
serving functions common across the For purposes of comparing SIGINT and
disciplines of SIGINT, IMINT, HUMINT, IMINT, the following analytic processes
and multi-source Intelligence-- was commoa to both were selected:
selected for further analysis and
cross-discipline comparison. * Search
0 Target Detection
The following criteria were used to
select analytic processes Incorporating 9 Target Identification
common functions:
e Target Devolopment
* Analytical orientation - whether
the process Is mainly analytical or
primarily control and management a Functiorial Analysis
oriented. * Complex Studies (e.g., OB
e Generality - whether the process Analysis)
appears general o Intelligence
analysis or specific to the particu- * Asociated Reporting Processes
lar discipline of SIGINT or IMINT. 1.5.6 Comparison of SIGINT and IMINT
e Interpretive Complexity - Analysis
whether the process Involves Using the common task processes
sparse, possibly conflicting, data selected above as a framework, com-
that Is subject to many potential parisons were made between SIGINT
interpretations, or detailed and and IMINT along the following dimen-
unambiguous data whose interpre- slons, which are described in detail in
tation Is relatively straightforward. Sections 2 through 6:
e Level of Aggregation - whether e Strategic versus tactical intelli-
the r'ocass Involves discrete, gence production.
Iow..level data patterns or a more * Environmental and individual varn-
abstract level of Information that e sd
has been aggregated one or more
times (for example, SIGINT target - Type of data used.
detection veratis multi-source
fusion). - Work setting.
- 1-7 -
inMr PHASE UrC0 PHASIE ThIRD PHASE
ANALYTIC ACTIVITY PiOCMBSM PROCESSING PROCESGING
KiRcTMEN ANAL LOAJ ICINEN WA•L LOAJ ICMENAA.
ITERPRETATION
Search
TargetDetectlon L HL
II H HL MH"M
M'M H N1
H H H
H HHH
" H
Target Identification L M H H M M H H H H H H
Target Quantification L M H H M M H H H H H H
UnusualnessAnalysls L M H H M M H H H H H H
Function Analysis H H H H
Complex Studles IH HH H
Photogrammotric Sciences L L L H
REPORTING
CUPPORT ACTIVITIES
Collection Coordination H H H L H tL _UL _ _H_ . H .L
All Source Data Review & Reduction_ H H H I HH H H H H H.L H
Hlstory of Coverage Maintenance L L L H I .LL L L L L H
TargetDevelopment [I H H H H H H H H Hi H H
Interpretation Key Develt anent H H L H H H L H H H, L H
KimwledeBase&IIIlUDevopme H H L N H H L H H H L H
LA-LevelofAggegation
Ic - iterpetly Complexiy L o1
MAmou ýfi At Of ftovtWy
Generality HHigh
ANAL - Analytic Orientation
- 1-8-
Ii
- 1-9-4
1i
t~ii -
language specialists made In the o Ability to acquire anti comprehend
preceding section also apply to HUMINT complex conceptual models.
analysts. A major difference Is the
greater importance of special verbal now tonertean elu
skills for HUMINT analysts, who spend (hypotheses).
many hours interviewing in a foreign
language. Anoier difference is the o Knowledge, consisting of a general
relatively greater Importance, for mental Inventory of available con-
HUMINT analysts, of access to multi- ceptual models, Including mental
source Information, which provides them "indexg to locations of models in
with the neoessary knowledge base for external memory (in the form of
helping to elicit Information from per- colleagues, files, references, aids,
sons being interviewed. etc.).
Extending the comparison to multi- o Accurate, reliable memory func-
source analysis, the major differences tioning.
between single-source and multi-source
a i Special Interests and orientations
Involve: Sanalysis toward conceptual modeling as an
o higher levels of aggregationof the activity in its own right, Including
* Information to be analyzed in explicit recognition of models as
multi-source, and to some extent, mental phenomenon, and selective
attention and selective memory for
o greater Interpretive complexity forceti knd of ocpua
multi-source because of the rela- models.
tively greater number of concep-
tual models to be considered. e Mental flexibility and ability to
1.6 Concluskms and Implications for lear from past experience.
the Cognitive Model The use of such models is also depen-
i ~~The clear implicarsution th~ study le vaibe imlpIcting~ th analytic pro-
The most telling result of thle study is dent upon environmental or work settlea
Sthe clear Implication that Intelligence vaibeImctn h nlycpr'
- 1-101
economics).
* Date types (sensor types,
observers, filtered data, analytical
results, expectations).
e Judgmental factors (priorities, timo
available, communication
bandwidth, significance).
e System supports (displays, data
bases, colleagues, references,
computational aids).
Because both Individual and environ-
mental variables affect the analyst's
cognitive performance, the model of
cognitive proUesses underlying intelli-
gence analysis must show sensitivity to
these v.riables.
I;
S~-1-11 -
I "" [_ _'_ 'S' --•" • N.... . . ... .... ... .. . ..- ii"••
.
TyPse OF 1FOAr UrTTINOS
COLLECTION
/SINGLE SOURCE
MULTI-
SOURCe
CL/RN?
PRODUCT
PRODUCTION FUSION PACKA GING
ajb VOICK IAIG
71A
INTELLIGENCE /PSC r ntt
INFORMATION IR H UMI IIT or.
THIRD PHASE ,
- 2-1 -
I
ILI
the left of the figure Is sh•wn the Intel- settings are also linked by four kinds of
ligence Information cycle, which con- communication factorsi
s sto of a generalized sequence of four
Information processing phases that * Communication models.
occur throughout the syste" at most a Formal Information flow arrange-
levlls and for meot modes of data: ments.
9 Collsotion of data that is Indica- a Informal communications.
thiv of capabilities or Intentions. a Job rotation.
e 11irst phase exploitation at data Each of these are considered below.
(high threat and limited response
time window). 2.2.1 Communication Models
e Second phase exol cation of A communication model Is a common
data (for current 3rations and conceptual model shared by parties who
situation assessment), use It as a means of communicatiom,.
SThird phase exploitation of data Such shared conceptual models link
Ssupport basic lntelligencs intelligence work settings. As defined
earlier, a conceptual model consists of
needs and special requirements, a pattern of generalizations about a
and
used review of conceptual
to Interpret data. models given category or range of experience,
which depicts a relation or relations
2.1 Organizational Structure of Intel- between two or more entities, where an
Ilgence Analysis Tasks entity may be an object, an Individual,
The main types of settings for Intelll- or an event. Shared •onceptual modeis
are the basis for common understand-
analysis
gence 2-1
Figiire aretoportrayed
from left right: across Ingo of many mutual concerns, Including
insfmayutlcoerinligI
the characterismtios of Intelligence tar-
e Various modes of Intelligence col- gets, collection capabilities, use of col-
lectIon (SIGINT, IMINT, HUMINT). lectlon capabilities, and the operating
e Single-source correlation and pro- environment. These models are
dlul. reflected In training plans, in operating
doctring, and ?'i knowledge bases used
e Multi-source aggregation and by analysts.
fuilon (over time and sources) .
ac, ordIng to mission orientation 2.2.2 Formal Information Flow Arrange-
(IPB, Targeting, Situation Assess-"t
ment, OPSEC). Linking the different special work set-
e Specific client-oriented Informs- ting are flows of Information through
formal communication channels (record
and message traffic, mail, command and
In the figure, main data-flow paths are control communications networks, writ-
am left to right, with a corresponding ten orders, etc.). These carry require-
increase In e igregation of data. ments, tasking, raw data, filtered data,
2.2 Communication Factors and analytical results and products.
- 2-2 -
66144,~. -
2.2.3 Informal Communications
Informal communications (via secure
telephone, meetings, ronsultatiois with
peers, Interactive digital corr-miic•t-
tions networks, and personal lei.er.-)
link the work settings, proviclrg
analysts with clarifications, feedbact,
and ready extensions of their own
analytical capabilities. A functdon often
served by informal communications Is
that of making analysts aware of larger
perspectives. Interviewed analysts
observed that when they were left
unaware of the "big picture," they felt
Iso'ated end were less able to advance
their skills. This condition was cited as
being more prevaleat In tactical units
without an active mission. Analysts In
strategic facilities do not exhibit this
concern, because of larger local analyst
populations and better facilities for
sharing Information with other organiza-
tions.
2.2.4 Job Rotation
Job rotation through different work set-
tings serves to link the settings.
Analysts report that receiving a variety
of tactical and strategic assignments
develops a perspective about available
information sources (including personal
contacts) that are used in analysis.
A•alyata who heve strategic assipg-
ments prior to entering the tacticai
environment know where to obtain tac-
tically useful all-source Information.
[,i -2-3-
L...... -- 1
ADAPTATION
R UI/"PROCESSING. INITELL<-
PANNIC
iJENS I RE PORTING I PRODUCTS
- 8-1 -.
8.1 Resouere Management Analysts must frequently support multi-
The resources allocated to Intelligence pie missions concurrently and divide
analysis alldI i their time between several tasks.
Analysts may serve several clients
9 Time. when producing analytical results and
must make compromise decisions on for-
" Analytic personnel capabilities. mat and content. The analyst must also
"eInformation flow. find time to secure the long-term bene-
" Information storage capacities. fit of sidll maintenance and
knowledge-base development. Annlysts
"* Collection assets. who were Interviewed felt that they
"* System facilities, had lees control over this last category
than was necessary to develop and
"e Resource management capabill- maintain their proficiencles.
tis. 8.2 Adatatdon
"* Adapth',o napabllitles. Adaptation Is the development of
As Indicated In Figure 8-1, resource appropriate new responses, by what-
management tasks Include planning, ever means, In tie face of significant
allkA.ation, and tasking. Each of these change. Figure 8-1 shows the adapts-
tasks Involves decision making by tion function as a key feature of the
analysts as well as management. Vari- generic Intelligence production model.
ables considered In resource manage- Adaptation of the Intelligence produc-
ment decision making include: tion process requires that both the
9 Level of threat. erganization and the analysts examine
the quality of products and use what-
e Availability of resources. ever means are available to correct
o Priorities. deficiencies. Adaptation takes place at
both IndMdual and organl A•tonal levels.
e Short term vs. long term benefits. 3.2.1 Individual Adaalon
-8-2-
i.
.e Making voluntary judgment€ about e Analysts remigned to the new
own performance. area will have a substantial
-a Seeking Informal fevidbaok chan- start-up time to become familiar
hels.' with the targets and achieve con-
fidence In Interpretations.
.e strategies
Using non-standard processing
(whatever works). o Sociocultural knowledge may not
8ooulrlknwegmynt
be current for analysts who must
.e Using own Initiative for Increasing work a new geographic area.
awareness in significant areas The administrative adaptation process
Is Important In the study of intelligence
Seeking cues from other Inteili- analysis because It contributes factors
gence sources. basic to analytic performance. One of
Seeking cues from associated the strengths of strategic intelligence
organizations Is that they are able to
elements or processes. use highly experienced and qualified
Developing contacts In Intelli- analysts In the production process.
gence community or within These analysts accumulate a large
facility, store of knowledge on specific target
areas and are able to perform in-depth
to aid In distinguishing cultural Interpretations. SociocuItural
knowledge at the strategic level can be
background features from s1g- supplemented by immediate access to
nificant data. State Department and civilian sources.
Building
knBuledinge continuously
ontiuouy the
thes Because strategic production resources
knowledge of "how things are limited, some target areas'must be
work" to aid In interpreting assigned lower prlorities. However,
6~parae data (e.g., maximum asindlwrpoite.Hev,
speed and Incline capacities Of computer data bases maintain archival
sehiled, an iecapo ractes,o files of target Information stored earlier
vehicles, weapon ranges, that can be recovered easily after long
optimum transmitter positioning
requirements, etc.) periods of lowered attention to particu-
lar targets. Such data serve as base-
3.2.2 Admlnltratlve Adaptation lines for renewed closer attention.
Uk. the Individual analyst, the Intelli- Comutilcation networks make such
various
gthroughoutntzetstrategiczcommunity.
gence organization utilizes data available on a shared basis
adaptive mechanisms when faced with throughout the strategic community.
new problems. If a target area that On the other hand, Intelligence produc-
was not being followed In depth sud- tion facilities in tactical echelons below
denly becomes Important, the organiza- corps are faced with adaptation
tion may face several adaptation prob- requirements every time the supported
lems: tactical unit must prepare for a con-
e Inattention to the area may have tingency operation. The tactical Intelll.,
resulted In gaps In reference gence
materialsn adaptingunitto Isnewat contingencies
a disadvantagefor in
a
number of reasons. Analysts are likely
to be less experienced than at the
- 3-3 -
IN I NNWATM PIR•MORIAcx c
-, MESSAGES
-, = REPORTS
) MITERPRTE SUMMARIES
_-) PROCESSES ESTIMATES
ANNOTATED DATA
strategic level, and highly experienced short supply. Real data may be unavail-
analysts may be unavailable to assume able for analysts to work with. Interac-
training roles. Persinnel shortages may tion with community intelligence
draw analysts away from analytic traln- resources Is sometimes difficult.
Ing duties. If the unit does not have a In the worst case, the tactical unit must
current active mission, analysts may not depend almost entirely upon the mdlvi-
be current on the Intelligence threat dendaosetieyun
andmaynotbe gurantroreisontedInea atin dual skills and backgrounds ofh analysts
idi-
and may not be garrisoned in a ocatonrequIre-
close to the resources needed to main- ts.
ttan knowledge for areas of likely
operation. Storage facilities are often 3.3 Interpretation
not available for archival data that
would be useful In preparing for a wide Although the generic production model
rangontigences,
of ersonel depicts Interpretation as only one of
range of contingenciss. Personnel three main analytic functions, It Is, In
clearances and billets for sensitive
fact, the basic one. Figure 3-2 shows
the Interpretive processes as a cycle
-,-I
F
p
"INTERPRETIVE
nmirupte
331InterpretivaCmlexit
...- 8-.
--. |
aggregated over periods of tin.e, over The accurate and timely identification
multiple sources, or In levels of of three requires the use of much
abstraction (e.g., n artillery pieces vs. a sophisticated knowledge organized
battery). Aggregation of input data can around conceptual models. Potential
work positively or negatively in the threat is Inferred at the national level
Interpretation process. If the aggrega- from scenarios (conceptuq! models)
tion Is done properly, the richness of depicting capabilities of:
the input data is Increased and inter- a Military forces.
pretive complexity is lessened. On the
other hand, aggregation can Interject * Weapons.
biases due to normalization, to Incorrect s Strategic Industries.
interpretation fi abstraction, or to remo-
val of valid ambiguities in preprocess- 9 Economic factors.
Ing. e Organization and distribution of
Based on oue observations three con- power.
cluslons about interpretive complexity
have been drawn: e Strategic and tactical dis" sitlcn
of forces and weapons.
e The more complex interpretation
tasks are usually performed by e Electruiic warfare capabilities.
more experienced analysts better Interring Intentions to use such capabil-
able to cope with higher levels of Ities Is more difficult. Conceptual
data aggregation. models of necessary buildup patterns
a for threatening behavior are used to
*• Interpretive complexity is often Infer current and future Intentions. The
greater In work settings using high models Identify categories of indica-
levels of
becuseanlyss aggregation,
datamstmak del- t
tionw and warning signs that are
because analysts must make deci-
sions on the Interpretation quality
observable thrnugh collection assets.
Examples of such Indicators are:
I
of their Inputs as well as make
their own aggregation choices and 9 Provocative diplomacy.
Interpretive decisions. a Threats/ultimatums.
9 There Is sometimes distrust of.
Interpretations received from work * Hostile political actions.
settings at 4ower levels of aggre- e Intimidation.
gation unless the using analyst e M military action.
has trust in the source.
2 Major military action.
3.3.2 Knowledge used In Interpreta-
tion e Military augmentation.
The requirements for the knowledge a Domestic confilb-t.
needed to perform interpretations have
their origln In one common definition of * Exercise.
Intelligence: * Peaceful diplomacy.
Intelligence Is the Identification of e Verbal conflict.
threat; the two oompoijents of threat
are capabfltlWs and Intentions.
I - 8-6 -
In a parallel process, tactical threat Is • Models of enemy surveillance
inferred from scenarios depicting capa- capabilities and effects of terrain
olitles of such things as: and ECM.
9 Poeitioning and capabilities of Indlvi- e Political organizations and control
dual large weapons. of power.
* Positioning and capabilities of mill- e Command and control organiza-
tary units of significant size. tions.
* Movements of weapons and units. 9 Personality prgfily.
e Positioning and movement of logisti- 9 Terrain models for use in traffica-
cal units and headquarters. bility or tactical disposition
The best-known threat model is Order analysis.
of Battle (O). The O can be imple- • Ethnographic models.
mented In hardcopy or computer
data
base form. 05 provides capability e Chain of events.
models of force structures, weapons, 9 Time and frequency patterns.
status, and disposition. OB also pro-
vides Insight Into intentions of the e industrial production models.
forces by implication from training, • Weapon system performance
readiness status, tactics, personality of models.
commanders, and strategic or tactical
disposition of the forces. OB data Is e Economic models.
used at alh echelon levels, but Is e Unes of communications.
tailored to the 0eo",raphic area of
responsibility and to a level of detail e Network models.
that Is meaningful to the current situs- These models may be used to transfer
riga. general characteristics of known
Indicators of threat guide the develop- threats to unknown threats by analogy,
ment of further Intelligence Information and to develop higher levels of threat
ulnrablltls ad
for etem~nng
for determining vulnerabilities and pan-
plan- plete fragments
Information by piecing (such as Incom-
of datatogether In the
ning responses. In planning responses, Cuban missile crisis, when the
behavior modeling is used to develop existence of Soviet missiles in Cuba
wastasce fromit shaes of
and to authenticate models of possible
reactions.
antagonist predct These models was ascertained from the shapes of
robbleantaonit rsposes
predict probable antagonist responses hayvhce containers
shipboard and from tracks of
rudsmlrsae
under given sets of circumstances. The heavy vehicles around similar shapes
seen Inland).
importance of behavioral modeling lies In
its ability to project "what if?" situs- 3.3.3 Using Interpretive Models
tions. Because of the predictive nature The main processes of interpretation
of these models, they produce specula- involve the extensive use of concep-
tive, probabilistic results and require tnalme the sills ta enaeth
continuous refinement and adjustment tual models. The skills that enable the
to maintain their usefulness. analyst to exploit conceptual models
Include:
Other types of models frequently used
In Intelligence analysis are:
"- 3-7 -
.,F . r
• Formulation of conceptual models. characteristic).,2
e Storage and retrieval of data • Interpretation or ambiguities by
using models as the indexing matching to multiple t odels (such
framework (such as situation as a unit that could belong to
overlays, 09, Installation files), either a motorized rifle regiment or
• Communication with clients by uaa a tawk regiment).
of models to provide extensive * Recognition of uncertainty in
- a-8-
I1
determine the content and speed of
delivery of the product
Intelligence products that are highly
formatted and transmitted electrically
may be processed directly Into client
computer data. bases. When the client
does niot have computer assistance, the
product flow rate must be controlled by
the Intelligence production source to
prevent saturation of the routing sys-
tem and the recipients.
3.3.6 Summary of Intelligence Produc-
tion Model Charaoterlatlcs
To summarize, the generic model of
Intelligence production processes Iden-
tites three main functional areas:
adaptation; resource management; and
Interpretation. The general types of
tasks, such as monitoring and evalua-
tion, production planning, tasking, pro-
cessing, analysis, reporting, and special
product design serve these three main
functional areas.
The central function of Interpretation
Involves making many Information filter-
Ing decisions In the process of convert-
Ing sparse or uneven Input data to
Intelligence products. The basis for
such decisions is usually memory-stored
conceptual models of the types of
real-world objects or events thought to
have generated the data being Inter-
preted.
Comparison of the Information consti-
tuents of Intelligence products with the
Information constituents of the data
supporting the products shows that
often a large proportion of the informa-
tion In the products has been added
from memory. Thus, the Interpretive pro-
cess Is often more concept-driven than
data-driven.
4. ENVIRONMENTAL VARIABLES minlm'zed to make efficient use of rela-
Environmental or work setting variables tively scarce analytic personnel
affecting analytic performancA are resources. Nevertheless, requirements
veycmo.Teitlg.corn-
Important In the development of te for maintaining overlapping knowledge
Scognitive model because they cir- for different areas of responsibility are
So~~~~umscribe the range of perceptions, eyc mo.T ntlgaecou-
' deisin mkin conideatinsand Ity attempts to develop and exploit
mnakin
w g conderatina s, aed- such overlap through working groups,
which the
re a expert
nalyst information distribution, Integrated com-
esiputer data bases, and Informal communi-
tasks In a given work setting. The
scope of environmental variables cations.
affecting the cognitive processes of 4.8 Client Orientations
analysts is summarized in the diagram In Figure 4-1 shows client orientations
Figure 4-1. affecting the analyst. Attention to a
4.1 Assigned Domain particular client can Improve the value
of the analysis product for that client.
geograssigned udomarinusu cnistsn oh This goal Is sometimes difficult for the
geographic boundaries within whichto achieve In practice, because
data representing certain target types any ts are in eously ase
are to be Interpreted. Deep familiarity by c tion procssuand tero-
Swith
wt geographic,
georapic climatic,
clmaic and anus sociocul- by the production process and
reqir the pro-
inluiv o
tural aspects of the assigned geo-
graphic domain Is a basic asset to the compromise format The importance of
Intelligence analyst. Intimate familiarity one client's needs over another also
with the domain aids In identifying mill- changes.
tarily significant targets and in anticl- Tactical Intelligence production units
pating constraints on military opera- have multiple client orientations both in
tions. The domain variables depicted as garrison and in deployment. Tactical
Impinging on the analyst In Figure 4-1 Intelligence units are typically attached
become especially obvious during a to a tactical unit commander, and
change of geographic domain. When- thereby assignec main client. At the
ever an analyst Is reassigned to a dif- same time, the ta Jcal intelligence unit
ferent geographical domain, even also has the general intelligence corn-
though the types of targets may be the munity as a client. It Is Important to
same the analyst usually requires a note that the "perceived" client Is more
substantial start-up time to regain peak critical than the actual end users of a
performance levels. The same Is true of product; an Individual analyst or an
reassignment of target types within the intelligence unit may adapt to satisfy
same geographic boundaries, some goal, but thel Intended user is not
4.2 Management and Tasking always the sole beneficiary.
4.24. andpportsn
Manaemem
Management directives define the 4 System Supports
domains of an analyst's geographical The supports available In the intelll-
and functionav areas of responsibility in gence production facility are important
the overall production picture. These to analytic performance. Computational
tasking constraints change with time. aids and secure communications are
Overlaps in assigned responsibilities are valuable assets. Storage space for
- 4-1 -
|
DATA TYPES DOOMA MGM & TASIUNG
CLIENT ORIENTATIONIS
EPO AQUIS~iONTACTICAL COMMANDER
CNOLLECaUTION plW
PREDICTABILITY ANALYST 10111 p
OVERLAPS FIRES
PLAN&
LOGISTICS.
OThER INTL
maps and secure data can make a sub- Intelligence environment Is maintained In
stantial -difference In analytic perfor- the form of materials such as refer-
mance. Film processing facilities are ences, archival data files, and computer
Important to IMINT In the same way that data base systems. Computer aids are
electronic signal recording and repro- thought -to be essential for extending
cessing equipment Is Important to SIG- the knowledge base to Include archival
INT. data that cannot be effectively handled
4.5 Knowledge Bass auly
The knowledge base or externai store'
,4.-~..-....
. . . -... . . . . .
6. ANALYST VARIABLES 6.1.2 Science arnd Technology
A majo" conclusion from the work per- Most specialities of intelligence
formed on this project Is that great analysis use almost all for, s of physical
Importance must be placed on the attri- science and technology. A strong
butes of the analysts tasked with pro- technical background helps the analyst
duclng Intelligence. The main attributes understand what Is seen br heard In
needed are In the areas of: data collected from technically complex
e Relevant knowledge, targets such as alriraft, missiles,
"radars, communication nets, factory
"e Skills
(perceptual; conceptual; complexes, and the like. The complex
communication), workings of weapons systems, commun-
" Orientation toward managing Ications, command and control organiza-
relevantons and procedures, and electronics
systems must be understood for proper
"e Personality. Interpretation of Intelligence data In
5.1 Knowledge both strategic and tactical missions.
The knowledge relevant for analysis Emphatically, this principle holds for all
Includes: levels of intelligence analysis as
defined earlier. Although the Inexperi-
* Military science. enced Image Interpreter performing a
°• - c•-1 -
iL _
/ -
Imagery Interpreter may not need to 5.2.2 Conceptual Skills
know how a particular camera works, The generic P telllgence production
the constraints under which photo- model presentad earlier depicts In.ailli-
graphic data Is collected must be genoa analysis as predominantly
decoisioa
understood when making
about collection plans and the quality o concept-driven rather than data-driven.
altllection pierre nd quThis conclusion was reached after
Intellgence products, observing the extensive memory
6.2 Skills resources (see Figure 3-2) that
Skills Involve knowledge, but are dis- analysts bring to the production of most
Intelligence products, and noting that
tinguished here from knowledge In terms muhotemmoybsdifmaii
of added roqulrements for highly prac- was nature. The proaui-
conceptual In nature.bThe
muconptui produc-
tioed performances. tion process Is also concept-driven in
6.2.1 PerceptualSills the sense that new intelligence pro-
ducts can be, and often are, produced
The phrase perceptual skills, as used In the absence of new data. Inteili-
here, means practiced performances In
discriminating between things on the gene preparation of the battlefield
baal ofsuble
iffrenes n hw te~t (IPB) is analmost
depends example of anonactivity
entirely that
previously
sound or look. Perceptual skills are
developed and stored knowledge. As
especially Important for single-source Indicted earlier In this report, highly
Ther Indictgenc eradlieon thi reothgl
Intelligence production. There Is a experienced and effective analysts
strong consensus in the field that the often appear to organize the mental
to SIGINT
fundamental production storag eof owg e aon cont
and IMINT skills
perceptual single-source strgofuhknwee ondc-
andt bMe develousingi u rcea
pductin ceptual models. The analyst's ability to.
mTht isthe refinoped perceptureal skis deal with conceptual models grows as a
That Is, the refined perceptual skills result of experience In learning
necessary to Interpret particular kinds abstract concepts. This type of learn-
of Images or to recognize certain voice Ing appeara t3 be more In lina with that
or certain morse or telegraphic ypera- received In higher educ&tion than In
tore can'not be fully developed in exer- trade skill teaming. Characteristically,
clses disassociated from real targets. analysts who progress to higher skill
The analyst's confidence and speed in levels have had post-high school edu-
Interpretation and In the ability to catlort.
detect significant changes also depend 6.2.3 ComaunicationSkills
heavily on familiarity with the particular
target area. A substantial time period Foreign language Is of special Impor-
Is required to gain such familiarity even tance to COMINT and HUMINT Intelil-
for experienced analysts. SIGINT gence production for obvious reasons.
analysts stated that It would take two From a general 3tandpoint, language
to six months to adapt to a new target skills are vital to xhe analyst for under-
area after being reassigned. IMINT standing the meaning of collected Intel-
analysts are often semi-permanently ligence even after It Is hiterpreted.
assigned by geographic area and/or Writing and speaking skills are essential
target types In order to take advantage for the analyst to communicate analytic
of the resulting accumulation of percep- results to clients.
tual familiarity.
- 6-2 -
Knowledge of procedure
4- f
Knowledge of Judgorinal/
criterion
analyticl
. Knowledga of who to aM
or oml colleagues
8.3 Memory Management Orientation from storage facilities where they are
avallabde to storage facilities where
The two of Information from memory Is a the ar o. The oewyarw ni
centrally important factor In Intelligence the mrnn e one-way arrows ndi-
analysis. This Includes not only the use cats the manner In which use of the
sother two sources of information Is
of-the analyst's own memory, but also dependent upon knowledge contained in
the use of external memory resources
avoltable In the extended work setting. internal memory.
The three columns of Figure 5-1, to be 5.3.1 Knowledge of Events and Situa-
discussed in mae detail below, depict tions
types of Information contents available Figure 5-1 shows that the analyst
from Internal and external memory, and retains an Internal memory store of
from the functions for Information on situation and curent
updating/extending external ,kibmory. In ts. An Imagery Indreurr
The twc-way arrows Indicate the evsnts. An imagery Interpreter, for
reciprocal flows of types of Information Instance, may become so familiar with a
- 6-8 -
iN
Y
.
L-5-3-
terrain area as to be able to detect any quest•ons of colleagues when uncertain,
type of change that may be slgn' ,,ant. since this process continues to be part
8.adlarly, a SIGINT analyst may be able of many analytic problem-solving situa-
vo recognize targets on the basis of tions. The shared group value for "ego-
"personality" characteristics that are less" problem-solving exchanges was
not-definable in terms ot recorded sig- frequently observed.
nature Information
ana~ystmayais or signal content. An
analyst may also revew xtenal
review external 6.3.3 Knowledge of Accepted Judg-
m na n nltclCiei
memory resources, such aa situation
maps, status displays, and message The priorties and significance of
traffic files, to provide cues that, analytical results -,re established
through mental association, may lead to through cooperation between the intelli-
extending an area of search or expand- gence organization and the client. At
Ing the possible interpretations, the strategic level many of these cri-
teria are long-lived. In tactical environ-
ments, the analyst Is frequently
Figure 6 shows that knowledge of pro- required to make judgments of changing
cedure resides In internal memory. significances and can therefore profit
Other than manuals for operating partic- from frequently renewed contacts'with
ular types of equipment or for format- clients, In particular the unit com-
ting products, there Is almost no docu- mander.
mentetion on the detailed procedures 6.3A Knowledge of How to Get More
used In performing analysis. Such pro- .n Kormotion
cedures are conveyed to the analyst Information
through on-the-job training. The neo- The analyst normally works as part of a
phyte analyst geoierally gains profi- group of co-located analysts who share
ciency by working closely with experi- the Intelligence production workload and
enced analysts who provide assistance operate as a team-memory resource for
and Immediate feedback on perfor- one another. As Indicated by Figure 5-
mance and answer questions on tech- 1, colleagues are the most Immediate
niques and Interpretations. This face- source of knowledge after the internal
to-face learning relationship is very memory of the analyst Is exhausted. In
widespread and recognized as essential the operation of several intelligence
In intelligence analysis. It Is referred to fusion groups during tactical exercises,
by some experienced analysts as the It was observed that specific areas of
"oral tradition" of learning inte!l!gence memory responsibility were designated
analysis. to Individual members of the analytical
The oral tradition for learning ths pro- team. An analyst assigned a specific
cedural Intricacies oflntilllgonce content area was responsible for col-
cedual ntriacis
analysis emphaslzeb ofintllignce
the Importance lecting,
lelnrvwig reviewing, and remery~beriki~g or
drmebrigo
analysi
nforma ze-th-fce imporance- maintaining availability of all Informatioc,
tono l apertinent to "hat area, as well as briaf-
Ing the fusion tesm chief when neces-
In this regard, it Is Important that the sary.
analyst develop confidence In the abil- Association with expelenced analysts
Ity to analyze and at the same time Is the major source for gaining
remain comfortable about asking knowledge of where to find Information,
amt
Analysts develop contacts from past can be ierformed more effectively with
assignments or training courses and somewhat closer coordination between
retain Informal communication with those the two functions. As a result, It Is
contacts. Mlssion-defined units of sometimes fLiund advantageous In the
Intelligence organizations are not large, tactical environment for the intelligence
and analysts with wide experience are analyst to be involved In development
well known In both tactical and stra- of the collection plan at the early
tegic settings. stages of deployment, and to provide
continuous feedback on the quality of
Most analysts supplement personal collected data. For example, a SIGINT
memory with a "shoebox' of specific analyst who understands the limitations
refurencev, keys, training material, etc., of el.tronic signal detection has a
which are of rse In the particular better perspective on the reliability of
~stnntslmlrt.T etweeisno obvious con- producing regular Intelligence products
for the commander. Similarly, the IMINT
bo•xes of different analysts, analyst who understands the problems
Comnputer data bases, such as those of of the reconnaissance pilot has more
the DIAOLS/COINS network of the accurate expectations of the complete-
U afonse Intelligence Agency, are widely ness and accuracy of Imagery missions.
accessible in strategic Intelligence
facilities and are Indirectly accessible 5.4 Personality Attr.oftes of the
Ideal Analyst
to tactical unite. These computer data
bases greatly extend the ability of the The attributes of the ideal analyst
analyst to draw on previous analytical offered by analysts Interviewed during
work and archival data. the course of this project are summar-
6.3.6 Knowledge of Collection Capabil- ized as follows. The Ideal analyst:
Ities 9 Is a technologist.
Knowledge of collection capabilities Is a Is focused (olther a specialist or
important to the analyst for two main generalist, not both).
Sreasons: 0 is an Information er.Zrepreneur (as
1. To provide Judgmental criteria described earlier).
regarding strengths, limitations,
possible artifactual aspects and of • Is comfor table with changlng roles
prossie aas apprentice, peer, trainer, or
various collection meaus, and consultant.
2, To provide realistic knowledoe
about means aveo'able for acquiring Can
o comrl). nlce (written and
Information unavrllable In either oral).
Internal or external memory. 9 Is a dotentive.
a Is Imaginailve.
I! In most production situations, analysts
are Isolated from the functions of actu-
ally planning collection activities and
managing collection resources. How- • Has a profassinn (Intelligence
ever, there Is a growing consensus that analysis).
the generic functions of intelligence
production and collectior management
-6-8-
- - V .-- i
a Has related hobbles or technology
Interests.
* Prefers analysis to management.
9 Can perform multiple, concurrent
activities.
9 Is individualistic.
s Is self-confident.
9 Is a historian.
* Has a photographic memory.
This list reflects how analysts feel
about themselves. Professlonallsm Is
apparent at all skill levels. The most
frequent complaint was that tacttcal
unit asalgnments do not provide an
active mission or an adequate access
to real data and support facilities to
maintain and extend profeablonal skillj,
- 5-6 .
6. THE COGNITIVE MODEL The cognitive model is summarized by
8.1 Overvlaw the following three points:
The cognitive model presented here 1. An Individual's Initial cognitive pro-
cessing of Information from the
summarizes selected aspects of cogni- envint
environment is conducted
Is cnductid within
withi a
tive functioning that appear to be of few tenths of a second by mechan-
central Importance to the processes Lms operating ou'lde the
ol waren e te
Involved In intelligence analysis activi -lnm
ties. Each aspect has also been the andiidtlcs prengs dtpe
object of laboratory
fiel of verification in the Ictedatigure-sinformation
xpermens~pscholgyicted In Figure 6-1, Information
field of experimental psychology. etr hog sense
enters through es organs
ras(ys(eyes,
The cognitive model is en abstract ears, etc.) where It is converted to
description intended to summarize and nerve Impulses by automatic (out-
account for behavioral and psychologi- side awareness) processes and
cai observations and their relationships. conducted to the brain. There, an
The model serves to describe interre- automatic process rapidly compares
lated processes that occur Inside a the raw sonsory Information with
person's head when performing Intelli- Information patterns already stored
gence analysis. Cognitive processing Is in the Individual's memory. This is
a continuum-,-some Is superficial and the COMPARE arrow in Figure 6-1.
some very deep. During superficial pro- When a gross match Is found, parts
cess;ng the Individual Is sometimes
aware of the processing and sometimes ofath rawl ;elected
automaticeilly y patte r are of
because
not; during deep processing the Idivi- their similarity to features of the
dual ts sometimes aware of the pro- memory pattern and are combined
cessing and some times not. Whether vwith other elements of the inform&-
accomplished within or outside aware-
ness, cognitive processing is a dynamic Fion pattern from memory, shown in
Interplay of and romIntrnalmemryarrow.
information from the senses Figure The T-1 resulting pattern of
as the CONSTRUCT
and from Internal memory. combintd information, still outside
The cognitive model presented here awareness, cons-Itutes the Initial
focuses on the flow of information version of "meaning" (of a visual
through the cognitive "system". scone, of a pattern of sound, of a
describes Inputs and procesies operat- tactile pattern, etc.) Thus, all Initial
Ing on those inputs to produce outputs. meanings represent active con-
The Inputs may come from the external structions performed by cognitive
world or from Internal memories. The processing miechanism3 operating
model as presented does not account outside awareness. Aa already Indi-
for all known phenomena or describe ell cated, such conetructions aro ordi-
known processes in exhaustive d~tail. narily accomplisheJ within a few
It does provide a framework for under- tenth3 of a srfcond.
standing
gence cognitive processes in inteill-
analysis.2.MnInta 2. Many Initial meanings
enlgrmino- remain out-
side awareness and trigger -3at-
tems of highly practiced adjust-
ments that are also carried on out-
side awareness Automatically
-.- 1 -..
I|
E
V 8 COMPARE- M
I E E
R N CON8TRUCT M
0-0 a
N E0
S
8 R
E Y
"N
T INITIAL
MEANING
-6-2-
I
- 6-8 -
- - .. * ~~ '
The cycle is composed of three attention on the features of the expec-
mechanisms: sensory Information filter- tation, thus passively rejecting other
Ing, memory contents consolidation, and potentially Important Information that
memory access Interference, all of happens to be Irrelevant for confirming
which are described below, or denying the expectation.
8.2.1 Sensory Inf )rmationFiltering The polarization effect can bring posl-
tive results when unfolding events
The sensory Information filtering correspond to expectations and nega-
mechanism Is composed of two comple- tive results when events are unrelated
mentary functions:. selectivity,
meneryfuctions: eto and confirming or denying expectations.
generalization. Polarizing effects are stronger when an
8.2.1.? Selectivity Filtering expectation Is Implicit (i.e., is unexam-
Selectivity Ing
mechanisms
ined or unquestioned In awe ,eness).
approach
iewointof
romthe filter-
nsweingthe icit questionin of a ns can
Explicit questioning of expectations cn
Ing from the viewpoint of answering the rdc oaiain
question: Which aspects of the raw reduce polarization.
sensory information pattern are slgnlfl- 8.2.1.2 GeneralizationFiltering
cant? The compare/construct process
outlined in Section 6.1.1 compares the Generalization mechanisms approach
raw sensory input for similarity with filtering from the viewpoint of answer-
existing memory contents. An adequate Ing the question: How much and what
kind of similarities
gross match is usually found quickly, recognize things as are required The
the same? to
and the sensory relegated to an
InputrosIsategry.confident conidentius of k de dep e
menal
exising use of knowledge depends on
existing gross mental category, being able to generalize from experi-
Thus, the initial compare/construct pro- ence. Success in applying past experl-
cess often Ignores (passively rejects) ence (memory information) to the
sign~flcant information In the raw sen- present depends on the validity of geos-
sory Input that in fact does not fit (at a eralizations employed between the past
leeper, more detailed level of analysis) and the present. The effective use of
the mental category assigned to It. If generalization is a fundamental and
the overall first Impression of the sen- Inescapable aspect of dealing success-
sory Information pattern Is a good match fully with the world. The elemental pro-
with gross features of existing memory ceseing dynamics and basic capacities
contents, disparities between the sen- of the cognItive model (to be described
sory pattern and the memory Information later) provide the bases for identifying
pattern at more detailed levels often three
have no chance to enter awareness. filteringmain
by types of mechanisms
generalizatron: for
tolerance,
- 6-4 -
j4
are organized hierarchically by increas- 6.2.1.2.3 Fill-in Generalization
Ing levels of detail of Information stored In fill-in generalization, missing parts of
there, tolerance requirements for the raw sensory pattern are filled in
matching grow more stringent at the from similar chunks of Information In the
deeper, more detailed levels of a
memory slot. Of course generalization memory frame slot. If the reasons for
may be valid or Invalid at any level, but missing parts of a sensory Information
mayober validolrnes Inveal athanyevelpattern
s are implicitly understood,
loer(either because they are obvious or
that raw sensory information Is Inap- because of insufficient consideration of
propriately generalized, the fact of missing Information), the
The mechanism of tolerance generaliza- fill-in Is often automatic. The results of
tion usually operates outside aware- fill-In are advantageous If sufficiently
ness. Deeper, more thorough cognitive correct and disadvantageous If based
processing that Involves more time on faulty assumptions. Careful examl-
spent In highly focused aware comparl- nation of assumptions about missing
son between sensory information and data can raise the level of awareness
memory information can prevent some of used In fill-in processing.
the errors typeof
Introduced by the tolerance
gneraizaton.0.2.2 Memory Contents Cons;olidation
type of generalization.
0.2.1.2.2 Analogy Generalization Memory contents, Including Information
recently passed through the filtering
In analogy generalization, comparisons process and stored, are consolidated
of similarity are made between the pat- (i.e., made more accessible and vivid)
terns of relationships connecting the as a joint function of the frequency of
slots of different memory contents processing and the amount of atten-
storage frames. For example, the tion used In the processing. 1 hus, more
memory Information about very different frequently encountered, important
social organizations can be compared in types of experiences upon which signi-
order to generate analogies between ficant mental effort are expended
organizational hierarchy structures; or bE :ome more vivid and immediately
memory contents depicting the relations accessible In memory.
between pressure, flow volume, and The Increased accessibility and vivid-
pipe diameter for water can genorate ness of particular umemory contents
analogies to memory contents for the Increases the likelihood that they will
relations between voltage, amperage, be used as filtering criteria In
,nd r"- uctance for electricity. The comparing/constructing future, some-
udeipe -o generalization by analogy what similar raw experiences (versus
depends partly upon the actual reIa- using equally appropriate or more
tional
world equivalences
referents for bet
the esen the real-
analogy, and aporaemmr otnsta that are
appropriate memory contents r
less accessible and less vivid). For this
partly
ences upon
drawn the validity
on the basisofofthe Infer-
assumed reason the contents consolidation
mechanism can have Important Implica-
relational equivalences. The mechanism tions for the accuracy of analytic
of analogy
opertes generalization
utsde often
aarenss.Interpretations and estimates.
operates outside awareness.
If the results of the consolidation
mechanism match the realities of future
-6-5-
~ A A.
; -2
events to be Interpreted, the effects of the situation Is such that novel ele-
consolidation are advantageous; It not, ments of an experience are accurate
the effects are a disadvantage. Long portents of a future similar event, the
term static conditions tend to Increase caricature effect may provide help in
the favorability of results from the con- Interpretation when It arrives. If not,
"oldation process, while eras of rapid is caricature effect can be an Impedil-
and significant change do not. ment to accurate Interpretation, espe-
The caicature effect Is a type of dis- dlally If the Interpretation must be
based on Incomplete data.
tortion that can result from the process
of consolidation. Mental rehearsal of an The caricature effect Is a special "no
experience, rumination about an experi- new Information" version of the consoli-
ence, and problem-solving ihinking dation mechanism (the latter being
about ai, %xpedence can Increase the based on repeated Instances of a cer-
accessibilicy and the vividness of the tamn pattern of external experience).
particular memory contents related to Since the caricature effect depends
that experience. Given no additional partly on the experience of initial
external Information about a certain surprise followed by a situation favoring
experience, continued rehearsal, rumi- the Intensive use of unshared and
nation, and thought tends to emphasize unexamined rehearsal and rumination,
and deemphasize various aspects of the conditions for predicting and con-
the memory of that experience, trolling the caricature effect are at
The result of emphasis and deemphasis present only partially understood.
Is to "normalize" usual or expected 6.2.3 Memory Access interference
aspects of of
aserteunsu the memory
th exmemo and to exag-
tead topexag- Memories for very similar experiences
gerate unusual or unexpected aspects, caineerwthoenterdig
can Interfere with one another during
with usualness/unusualness being
Judged in relation to the rest of the memory access, slowing access and
overall memory structure. That is, the making It less reliable and less accu-
consistency or usualness between rate. (As Indicated In the diagram of
someofthconsisenc or u ess betweer the modification cycle, such Interfer-
some of the contents of the particular enecnhvstogfetsnte
memory ant the balance of memory con-
be exagger. ted beyond their memory Information available for the
originalmay
tents consistency, and the disagree- filtering stage of the next cycle.) The
ment and Inconsistency In othe d aree two main Interference effects can be
- 6-6 -
kinds of vehicles were present In a.2.3.2 Similarities SaturationEffect
the imagery you viewed before
lunch yesterday?" That is, recall aoncentrated repetitions of hghtiy somf-
consistsr experiences cause proliferation of
contents .fora focussn memo many highly similar memory contents in
ontent forr, a foicusef based on related areas of memory. The
of an easrlier experience, based on Increased difficulty of comparing across
receiving a name or description of and discriminating between many similar
the situation w~thin which that memories cause^ rcduoed speed and
focus
enced of attention was experi- accuracy In the compare/construct pro-
ceasing of each new related experl-
a Recognition consists of, for exar.- ence. it also Interferes with rapid and
pie, responding to the question "is discriminable storage of the similar new
this frame of imagery one of those expe lances in memory.
that you viewed before lunch yes- The similarities saturation effect can be
terday?" That Is, recognition con-
terdy?"Thatisrecgniton on- lessened by providing the Individual a
slats of accessing a memory for an lsee ypoiigteIdvda
sietsro accession waitemoyforcan chance to refocus attention on dif-
earlier situation within which
cderent memory contents for a period of
currently
mation waspresented specificasInfor-
experienced .the tm
time, hsalwn
thus h
allowing the nefrn
Interfering
mationwas experiencedmemories to become less vivid and less
Immediately accessible. When the
For both recall and recognition, highly recovery phase has been accomplished,
similar experiences that have inter- capacity is again available to learn new
vened between the original experience discriminations In that area of memory.
and the current
accss requirement
ntrfee forwth
endto memory
he Thee Intervening similarities and similari-
access tend to Interfere with the ties saturation fow
tissurio formt ofnerrncI
of Interference
accessibilty of the original memory with memory performance are predict-
material; the Intervening similarities able cognitive mechanisms of informa-
effect creates Interference with tion processing. They operate to
memory access for both recall and weaken and diffuse the Information
recognition. Thus an analyst processing
many messages of very similar contents available from memory by affecting the
from the same domain, under constant speed, reliability, and accuracy of
conditions anm over an extended period access to memory contents. As indi-
cated by the diagram of the modifica-
of time, is unlikely to be able to recall tion cycle, such weakening and diffu-
the specific messages processed dur- sion can change the pattern of memory
ing a certain period of time. Also, the contents that will be used as filtering
analyst may not be able to recognize a criteria for the next cycle of experl-
specific message presented for re- once and memory modification.
examination as having ever been pro-
ceased. To sumirarize: Memory contents sub-
stantially determine the Individual's
When the Intervening similarities type autoatic rmine the i dlls
of memory access Interference must be auati experience
aware rense of,o,new
n sw as
information.
circumvented and can be anticipated,
recourse to external memory aids is the At the same time, the functioning of
only currently effective solution, memory and of perception Is not under
the direct conscious control of the
- 6-7 -
i(
- 8-8 - (
4 1'
a6 4
I K a
R 0 0!
R ---- \ LOW
seasrelc3orfre
Ssenses rapist63 or forces
out
out one-half to two or three seconds
I-6-9-
*I _
_
_
_
_
_
_
_
_
_
_
_
_
_
_ I,
2
is typical. behavior.
e it may be "commandeeredli Large
changes in stimulus intensity for These three processors combine their
one type of ot',nulus can "swamp" functions to produce:
tebuffer capacity and momen-
tyeeliminateapactracesdofother
tarily eliminate the traces of other 1. External behavior within individual's
- 6-10 -
I
.. . .
access, and level of detail of and "ground"); for example, a
Information available. The overall truck figure in a camouflaged
dimension of accessibility in dep- poeition background or a division
lted In the diagram by the scale figure In field maneuvers back-
shown at the bottom of column 5. ground. The figure and the ground
Highly accessible contents are can be thought of as two gross
depicted as "coser" to the pro- "chunks" Into which the experl-
cessor structures that will use ence is divided. Figure and ground
them. chunks are often further divided
SMemory contents vary wih and expanded Into chunks at
respect to the amount of time greater levels of detail (analogous
respect tothve amunt of tige, to the effect of a zoom lens In the
they have been In storage. visual realm).
Althotegh storage times are on a
continuum, memory researchers o The storage structures of memory
have found It convenient to desig- consist of frames, each composed
note recently stored and/or of a pattern of slots connected by
recently accessed and re-stored links. Each slot represents a car-
contents as being In "working" or taln category of experience
medium-term memory. Contents chunks already stored In memory
with long storage lives and less and is organized hierarchically by
recent accesses and re-storage Increasing level of detail of the
are designated as In "long termw experience chunks stored In it.
memory. The examples In Figure 8-4 pro-
e The amount of Information ipoten- vide phrases describing Informa-
tially available from long term tion category chunks stored in
memory is much greater than In memory frame slots, with progres-
working memory. On
On the
workng mmory he other
oherlower alvely levels the lists. chunks at
more in detailed
hand, as Ind!cated by the accessl-
blIlty scale in the diagram, the o A link in a memory frame is a spe-
Information In working memory is clal kind of slot that represents a
more accessible than that In long certain type of relationship. For
term memory. example, possible relationships
linking two slots designated A and
The storage structure of memory Is uni- h would be:
form across its working and long term A: Is part of B; succeeds B;
portions and across all categories of occurs with B; Implies B; Is a
contents. The structure is built up from subclass of B; is a functional
"chunks" of experience that are fitted equivalent of B; Is synonymous
Into the "slots" of memory "frame" with B, Implies NOT B; was
structures, as follows: acquired with B; Is associated
with B; A and B are: parts of C;
o An experience is organized as an
Instance of a type of something,. subclasses of C; etc.
occurring within an Instance of a
type of background setting (i.e.,
organized as instances of "figure"
....-.- 11 -
j 1
VISION HEARINa
Vehicle Moving vehicle sounds
Tracked vehicle Tracked vehicle sounds
Ught tank Particular motor sounds
Topside Particular track sounds
Turret Combined Tank sounds
Turret hatch Sounds of Specifc Tank
Thus, both slots and links are arrows represents a link betwevp a pair
cai egories of experience chunks of figure-in-ground slots. While all pos-
already stored In memory, the sibie relationships between slots have
cateaodes each having a toler- been depleted In the diagram example,
ance limit for accommodating simi- many potential rek~tionships between
lar new chunks of experience, slots irs actual memory frames may be
Each noew experience Is nion-existent. The contents of slots In
represented as an "instance" of the example were selected soaiewhet
the category, with content varla- rtbiftarlly Irom a larger set of possitill-
tions appropriately appended. ties, to help shed light on the concept
ofmemoy ao ~
S Th cotent of a memory frame, &afollows:
side awareness until they are Time locale *lot#s tores a times
accessed by the awareness and trace organized In terms of
attention processor. Ordinarily, Nbefore and after" relationships
when being accessed by the between chronoclalcal anchoring
awareiless andi attention proce.- points for significant events, and
amr, the chunks at varioue' levels being more fine-grained for recent
of detail In a memoi.y slot are experlence.
'*opaque" to one another; L~e., twonoysot fe ~ntisvge
different levels of detail from gene'ay lo chuenk fortn sagensr
memory do not occupy awareriossexrineolvsnhrng
almultaneously. touch, taste, etc.; this Is espe-
Figure 0-5 diagrems an example of a diaily true In cases of more
memcory frame. Each of the two-way abstract experiences Involving
-7-17
4,,IME
Figur 6-5.Examle
ofMemor AraeECTIVE/r
LOCALElcctego LUATIEtl h
chukseprseningur v-ue
Exml ofMmoryFae lieytuchave vvdmtra
Inorationschoasugoodness or bUd-a rea iya ccsibe I tisslritot.
lnguagstentor wteakesOantehe
asdmbolcs. slot: Containschnsrpe ntg
dothecr shatnc, ahe
mewr oas fur- chnunkst reprsentIng dsrptives
tIncld su as
i enychuk eoeaind whchther symblscu-n
lf~toangergo
tear. meaor sloncto lioraed experiences
htteIdvda
I'¶.~~~~~.L,.~"'
tt.k., ' .. ;Ck
. .. ,., . .. , .........
to the memory and batk to the proces- actions processor may operate In
ear structures. In brief, In the MOME conjunction with the awarenese
sequencs, sensory Information In the and attention processor to prouiuce
formn of neu~aI Impulses, I8: aware, deliberate forms-of external
I1.matched- grossly against Mmory th xctv cin rcso
tio acivaed4s
roslysimlarIsproduca aujtom&t!c external
2.toa dpth uffcien tobahavior
dcodd In response to DMWRs.
2. oecoed
adeph sffiien to 7. Under special cood~tlon, raw Infor-
ensure the degree ef secondary
match niocessary In the particularmacerrmtesnoybtemy
momentarily force Its way Into
situtio.
Tis ompae/cnst~ctawareness before being processed
ptocess produces a new contigur- through memiory by the MDME
lng or "chunking" of Information, processes. As a result, there Is
whic Ismomentarily no DMWR, and the raw
8. encoded In the form of' now pas- sensory Information Is therefore
sive brain tiraces. experlen".d as meaningless.
4. The newly constructed chunk of To summarize the MDME processes;
Infoqrmation also flows -to other Several points for application to discus-
parts at tfr: co'gnitive struu-cure In slons In the chapter following can be
the tem' of a D~ecoded Memory drawn:
Return (DMR). The DMR may flow
to he warnesan atentona The awareness/attention proces-
procssorwher
itmay rogrm er has a limited capacity comn-
r ~~~~~~external 6beavior wmitin awarenesspaetoM Eprcssoea-
and/or match and decode othwr Ing outside awareness.
rremory contents, Including aware- e All In~ormation In normal awareness
nosw oft no signiticant chenge." has been filitered anid filled In from
The awareness processor has a memory contents by processes
limited Information processing capa- usually outside awareness.
city, and can focus clore attention aSnoydt rmteetra
oneve
oly ofne etal o anworld has no meaning unless ffl-
experience at a time. tared and filled In from memory
5. In thought and problem solving, the contents by procecses operating
DMR often originateon In cogrltivn Initially outside the Individuekl's
activitiens timulated by memorj,' awareness.
contents rather than by Information eFcosta omadcnrlsn
fromthehufer.sory
ensoy perceptions and attention are
8. The DIOR mtay also flow to the exe- mostly outside the Individual's
cutive actions processor, where it control. This ist also truie of
Iloperates, In coordination with other rememboring and thinking; Iundivi-
I
behavioral plans Informiation fromn duals cannot force their thought to
memory. to program patterns of contain exactly the desired con-
xtern&! behavlor. The executive tents.
To summarize the cognitive model:
Memory contents substantially deter-
mine the Individual's automatic
responses to, as weil as aware expert-
ence 0 , new Information. At the same
time, the functioning of memory end of
perceptkin Is not under the direct cons-
okoxw control of the individual.
Nevertheless, three potentially predict-
able and controllable cognitive mechan-
Isms operate In a cycle to modify infor-
matlon contents avallab'a from menory.
S'nce memory contents provide a large
portion of the Information used In making
many Intelligence analysis Interprets-
tions and astimates, the information
contents mod~flcatlon cycle Is an impor-
tant concept for suggesting ways to
Improve Intelligence analysis.
Memory contents are stored hierarchl-
cafly by level of detail, with gross
features and outlines of nformation at
shallower, more accessible levels of
storage, and fine details at deeper iev-
els. A central compare/conatruct
mechanism matches Incom!ng raw 3en.,
sory Inputs to similar memory crntents
and actively constructs a comp-.site
return which drives behavior and
experience. The compare/construct
mechanism also matches Inputs from
one part of memory with those from
anoiter, thu4 allowing thought and prob-
lem solving without external stimuli.
Thv basic memory storage frame struc-
ture composed o? slots and links aClows
fcr very fiexlble, complex Ptorage
structures comprising super-frames and
memory systems. The strategies and
Judgmental criteria used by the action
executive processor and the aware-
ness and attention processor are them-
Aives composed of contents from com-
plex memory structures.
-8-18-
7. THE COGNITI IVE M EL IN THE ANA!- 7.2 Awareness of Mory Functon
SLYTIC WORK SETTING Often we are not aware that Information
This section reviews the results of uar- we are using to coming from memory.
Sveying the analytic work settings In the Memory Information used at even high
light of the cognitive jt levels of awareness does not neces-
presented. sadly obtrude Into awareness labeled
as winformation from memory." Figure
7o o7-1 provides a simple Illustration of this
A main theme of the cognitive model In phenomenon In an example of contribu-
that, In normal psychological functioning tions of memory to thi task of Identify-
In everyday environment3 with "ideal" Ing a military vehicle masked by a tree.
outside Information, the balance o-? Visible parts of the vehicle provide the
information used from memory and cues for matching and decoding memory
yEcelved from the outside favors contents and reconstructing the visu-
* -,,y much more than casual obser- ally missing parts of the vehicle. As the
vation would lead one to suspect. In fill-in Is accomplished, the image of the
many kinds of intelligence analysis, this tree is effectively dimmed or even
balance Is tipped even further toward erased from consideration. At this point
use of memoty by the conditions of the tree is down-graded or eliminated
these environments; analysts rarely from awareness, and a "camouflaged
have what they would view as Ideal tank retriever" Is confidently reported.
data coverage of the objects of their The fact of using Information from
interpretations. memory for fill-in Is usually dismissed or
Often Information from memory provides not even noticed. The same sequence
trhypothesizing rol- of data occlusion, fill-in, and dispensing
the sole heals f hywith the fact of occlusion and fill-in
tionships among data available for
Interpretation and for classifying varl- occurs continuously for conceptually
ous data as relevant, redundant, more complex and subtle forms of
present, abeent, or crucial for the Inter- experience associated with analysis.
pretive task. Highly confident classifi- 7.8 Memory Aids and Memory Load
cations of data value can be made only The Information resources and variables
In hindsight, since it is the unique
nature of the object or event Inter- in analytic work settings are usually
preted that finally
cla~sffcations. determinesmodels,
Information such quite complex (seenenlmmr
lasIps4o FIgure 4-1). r
The
(models couched In information descrip- lessened by external memory aids such
tive terms, and derived from the more as maps, reference materials, and com-
general conceptual models defined puter displays. Such external aids
have advantages. The externalized
earlier) provide some aids for classify-
Ing available data prior to actual Information models they contain (tem-
t bplates, doctrine, IPB, etc.) usually
Interpretation, but at brast serve merely sfe esfo eoymdfcto
as guidelines, and sometimes even mls-
guide analysis. The analyst Is left with and judgmental distortion factors than
the on-the-spot task of dynamically models stored In the analyst's cognitive
memory. Cur ntly, however, such
lasoifying much of the data presented mery. Cr ctly howvrdsuch
for Interpretation. materials ari citly to produce,
-7-1 -
i
PrOW11N6 DATA INTEWIJMATION
€'1 " | t, 0. , I_
I-- / ) ,
I /
I/
/ I
CUES
MW PAT"TERN
-7-2-
which Imposes memory load when used. attention to all parts.
The analyst must use available * E oscilato In choosinga
resources of time end Information wisely
to obtain the best Interpretations and
estimates possible under given cir- a Lowered predictability and orderli-
oumstances. No static formula Is evail- ness In final interpretive choices
able for planning the proper use of (fleapsm rather than logical
resources In each new situation; many steps).
considerations for intelligence analysis Certain arrangements an procedures
are unique to each situation, and deac- observed In analytic work dettings can
sian making about related cognitive function to forestall decision pressure,
Information processing activities must to Insulate the analyst from It, or to
accordingly be dynamic, constrain behavior under pressure.
Most centrally, the analyst must These Include:
repeatedly decide when the point has
been reached where the results of datebha tkgdlsf
each analytic endeavrs. a-•. 'friclently data-handling.
<thi i.xjpendlture
clear to warrant no -%, e Checklists and templates to help
of analytic resources 'e •," tUie current channel thlnklng.
conditions of -ioourcc availability. * Allocation of resources and task-
Situation"' varia les that focus pres-
sure on such decisions Include: Ing Instrucaons provided by
management..
a Amount of ambiguity and uncer- * Discussion and exerciss con-
tainty In the data aid In memory. oerned with:
e Possible losses or penalties asso-
ciated with a serious error of - Thevrecognituon iof i
Interpretation. presueres in a situation.
a Amount of error reduction possible - The techniques for redictribut-
If more data and analytic Ing analytic load, if that can
resources could be applied to the help.
Interpretation. - The uses of accountability pro-
SLiUmitations an applying more ana- cedures as checks.
lyric resources, Including time, to - The uses of consulting and
the Interpretation. consensus among colleagues.
Analytic situaticos hivolving grast ambi- Of course, each of the items listed
gt•L•y, large iceslble penalties from above also serves other purposes
error, great poteitai for error reduztion besides lessening the effects of
with more processing, but severe limits decision pressu.e. Decision pres-
on more processing cAn cause great sure as a phenomenon Is recog-
decision pressure. Under such cir- nized with different degrees of
cumstances, typical decision belfrviors expbltneas in different work set-
Include: tinge, but the problem of lessening
e Fixation on isolated aspects of the the pressure Is rarely approached
situation rather than a balanced on an explicit systematic basis.
-7-3-
T.6 Memory Resource Management whether or not any help can be
Concerns of management and analytic expected. This allows the analyst
personnel about the management of to search widely In a short time If
-7-4-
IRST
A ~- 7-6 -
regarding tanks and trucks. In that will you entertain men....iy.4 How large
case, either Interpretation can be made, a geographical area will typically be
and the Interpretation produced will be occupied by a phenomenon to be Inter-
controlled by the analyst's current pat- preted by you? Wh~at Is an average
tern of accessible memory contents. span of time over which an Interprets-
The figure also depicts the same tion made by you can be expected to
phenomenon applying to Information remain -In correspondence with the
about larger, more complex realities. real-world objects or events? Such
7. Sspecialized viewpoints are an Integral
7.7 System Aggregation Models for part of the efficient performance of
- Dataend Concepts analytical work In the various settings.
- T-S -
-..- 1 -
6.8 System Supports for Analytic serve as high-capacity formats for
Punotions transmltting somewhat Inpccurate Infor-
the use-
Much Is already known about
fulness of various systoim supports for Such questions become even more sig-
analytic work, and It Is clear that nhflcant In light of the fact that there
modern Intelligence systems cannot presently exist concepts and working
hope to perform all the functions models for various advanced, experl-
required of them without carefully mental, computer-based facilities for
planned and designed automated sup- conducting team judgment pro-esses
ports. The general problems oi ,troviding via networks of CRT terminals. Team
non-obtrusive but active mbwaory and communications can be constra!ned to
judgmental supports for analysts were any desired pattern through such facill-
alluded to earlier. The recent history of oies, and computer Information store.L
developmcrntal research efforts for and graphic capabilities can combine to
automated analytic aids Includes con- allow members to form and display their
tinuing efforts to provide not only con- Individual hypotheses to one another in
ventional automated support for data vivid ways and to overlay their vs,'ous
and Me•ssage filN% but semi-automatic offerings to facilitate ccmparisons.
mess. je handlinG and other automation SA4 Performance Fo ;,iback Arrange-
almeo at forming and maintaining
syattm-based versions of the concep-
tual :odal. (and Implied Information Is there somethingo•. be ýearned from
modela) used !jy analysts. A number of discarded Interprcatlorv? Post hoc
questions regwidlnu such supports are analyses of Inteflegear,ij lapses that
prompted by the present study findings, reach public awarorf ess sometimes
Static versions of many conceptual and Include corollary w"I~eetyfail
mtra.Teei told you so"
mre preseny
Information models currently exist In
documented form (e.g., Order of Battle, way to save discarded alternative
Intelligence Preparation of the Battle- Interpretations on a largo scale, but it
seems likely that these Interpretations
field). How will dynamically supported would sometimes have proven more
versions of such externalized models accurate than the.-nos chosen for use.
affect the expectations of analysts? Only large-scale Inaccuracies on Impor-
In what ways might the models serve as tant events are likely to prompt post
armatures for team analyses of Inter- hoc Inquiries, with the result that
pretive dispariUes In problematic situa- Potentially superior but unused every-
tions? In such uses, under what condi- dynalytsuperior bu une v -
tions will they: cause Interference; day analytic performances go unno-
ticed.
clarify analytic alternatives; support or
curtail productive hypothesis genera- Yet, the cognitive model suggests that
tIon; focus premature convergence on more can be gained by focusing on com-
Inaccurate Interpretations; speed parative degrees of success than upon
correct Interpretations; accelerate scattered Instances of highly notice-
recognition of anticipated events; delay able failure. Deep cognitive-procesalng
recognition of marginally unusual rehearsals of analytic failures, will instill
events; serve as high-capacity formats highly acceisible memory contents
for transmitting accurate information; about what not to do, which can be
-8-2-
!! t
very Important. Nevertheless, such Inhl- 2. Having •nce learneL something
b"tory contents suggest t, a proper does not necessarily mean that It
ways to proceed only on a def sult will be appropriately accessible
basis (by exclusion). A rapid and effec- from memory when needed. The
tive response Is more likely to be gen- memory mod;flcatlon cycle of the
erated by accessing memory materials model shows that a filtering and
related to comparative successes. consolidation buildup period Is
requi7ed, in which earlier learnings
Can the analyst profit equally from are refreshed and configured to be
negative and positive memory exem- properly accessible by cues from
piers that Nfit" a certain altuation? It Is ther accressible by cues of
worth recalling that the cognitive model the concrete ant. ytic situation of
Indicates that the Individual In not free the present.
to choose what will be recalled In a Moreover, success of the buildup
given situation: men.ory access func- process Is not fully uaider aware
tions are mostly automatic and outs;de volitional control of the analyst. The
of awareness. What will emerge first memory modification cycle mechan-
from memory Is what has been pro- Isme of filtering, consolidation, and
ceased most frequently and deeply. Interference will operate outside
Since there are many more ways to do awarnness during the buildup
a thing wrong than to do It right, there period. Efforts must therefore be
Is ample opportunity to load memory made to channel the results of
with detour signs rather than posltive these mechanisms In desired direc-
directional poin'Lers, tacne.
8.8 Training for Analytic Work analysts. This Is especially true since
The study findings Indicate two main some personnel selection studies have
- 8-8 -
2
- 8-4 -
REFERENCES
Aerial Photography Airborne Sensor Imagery, Forwarding, Titing, and Pptting. DIAM
%5-6, September 1971.
Birnbaum, A.H., Sadacca, R., Andrews, R.S. and Narva, M.A. Summary of BESRL Surveil-
lance flesearch. ARI Technical Research Report No. 1160, September 1069. (AD
701 907)
Field Manual No. 100-6, Headquarters, Department of the Army, Wa~hlrgton, D.C., 1
July 1978.
Glossary of Intelligence Terms and Definitions, NFIB No. 24.1/18, June 16, 1978.
Graduation Criteria for Intelligence Officer Basic Tactical Survefllance (03C). USA-
ICS, 22 March 1978.
Ground Forces. USAINSCOM/IASA, January 1078. (Secret)
- 8-5 -
kA
Intelligence Reports Handbook. SLpr 9881 024A, USAICS, October 970.
Katter, R.V., Montgomery, C.A., and Thompson, J.R. Cogntve Processes In Intelligence
Analysis: A Destdptlvei Model and Review of the Literature. ARI Technical Report No.
441, February 1 9U.
Katter, R.V., Montgomery, C.A., and Thompson, J.R. Human Processes 'n Intelligenca
Anal~•s: Phese I Ovvrvlew. API Research AepWort No 1287, February, 1980.
Kattar, R.V., Montgcmery, C.A., and Thompson, J.R. Imagery Intelligence (IMINT) Pro-
duction Model. ARI Research Report 1210, Svptember, 107S.
Lepkowsk!, J.R. and Jeffrey, T. Some. Factors Wffecting Mensuration Variability Among
Image Interpreters. ARI Research Memorandum NM. 72-7, September 1972.
Levin, J.M. and Eldredge, D. Effects of Ancillary Information Upon Photo Interpreter
Performance. ARI Technical Paper No. 258, September 1974. (AID 785 708)
Martinek, H., HIligoss, R.E. and Herrlngton, B. Effectiveness of an Error Key for Image
Interpretation In Vietnam. ARI BESRL Technical Research Note 230, September 1972.
Sewall, E., Harabedlan, A. and Jeffrey, T. Total System Accuracy, for APPS (The
Analytical Photogrammetric Positioning System). ARI Technical Paper No. 348,
October 1978. (AD A063 59•)
SIGINT Production Model, Technical Report, The Kuras-Alterman Corp., July 1977.
(Confidential)
S~- 8-8 -
(secret)
Strasel, N.C., Hcnsen, O.K., Colson, K.R. and L. Vettese. A Method f1r Doeloping a
Laboratory Model of an Image Intorpretation System (U). TRN 186, U.S. Army
Behavioral Science Research Laboratory, June 1987. (Confidentlai)
Tadlcal Order of Battle: A State-of the Art Survey. ARI Technical Paper 265, US
ARI, October 1976.
The Role of Human Intelligonce (HUIAINT) in Strategic Decisions. Air War College. April
1978. (Secret)
SUnited States Army Combat Deveiopments Command Functional Area Description for
Enemy Situation. USACOCINTA, December 196g. (Confidential).
United States Army Combet Developments Command Functional Area Description for
Intolligance Collection Management, Vol. I and ii. USACDCINTA, June 1989. (Confl-
dential)
United States Army Combat Doveloolments Command Functional Area Description for
Order of Battle, Vol. I and II. USACDCINTA, November 1968. (Confidential)
Vecchlotti, R.A., Berrey, J.L. and Bedarf, E.W. Development of Resource Management
Materials ior the G2 Air Officer. ARI Technical Paper No. 338, September 1 e78. (AD
A061 696)
Ve-chlottl, RJA, Berrey, J.L. and Narve, M.A. Training In Utilization of Surveillance and
Reconnaissance Resources by Combat Arms Officers. ARI Technical Paper No. 326,
September 1978. (AD 061 677)
Youngling, E.W., Vecchlotti, R.A., Bedarf, E.W. and Root, R.T. Job Requirements of G2
Air and Image Interpretation Personnel. ARI Research Report No. 1 181, May 1974.
"AD 780 816)
8-7-
DISTRIBUTION
I
1 W)i UAL.~ AO. $SA. AT-A~4 I USA Cod 6ae Pt meWuSO, Al-TN: FtUhrVV TA:6 AA
1H UAMA Artngus, AnN:. IARO.T1 I USA ToPSikwd AnnLajbtUsleir AIIM:t UL-wwr TTN-S 00
1 UO" ArVO.OSaam, Ftd MATYN USA Nuh'l- ArmL, Pt Oehhr Act.:
Ii.SleesO Ft MP Cewnewth.A
Nake
1USrARIw$Sty" ATYV:IGNUClA C I USA Topmue~ldMat L Pt Oawr&?M:0 ULawGSLO T
I USAMA Ofeso,Pa Al-dif: A00C0 - 1 1USA liek~nvipArmCr' SAct,Pt Heawieam, A
Ow ATS-TN: TCAU
I Pt rSAl-TN MeqaiU
RSATIMA UBA C~binedl6m CmW Sae.PwtHads, F Al-wwo ATTN-IU AC-
1 Uhe WAC CUb . Patw ,~eie RU Al-TMCWi USA ICOMpe Cuf&~ Sabe,PtUsiade-u, Al-TN: AMO-lUX-M
1 USe WACWCUb , PtnW MATiTaN: ATT#4: ~ 3nUSA lnuhllgmee Cu'& l, Pt HeSaae. ATTN: ATech CIS-O
I UStAt Caoremeh of e PoLmwA(RN: -T I USAMINKp~ @@*Sal. Ct PTTN!"S~ueAiM: TSCO
I TOOullia Oft.u OX3 USA finmllp" Fti
tlS~,PtHsge Stae, Nudusil-SbAm-OD
PtTW
I USAZ Aii ipedSal, PTTGodN, ATTN AlO- I US1A inolpeeseWCab&Sl, Pt lWw.lee Al-IN: L-OAS3
I USA Richae COfStF Ar,aafo, fSwýAl-l AlCTUN 1 USLA Inelpegew CL abe, Pt Uwdues. Al-TN: £750-ldw
1 U$A1I.FCla, t wt, ATTNd: hue 40Adv I USA inoelpfla Cir & lde, Pt Hdsiuwm, AlTTN: Ih-04
1USJA. CoalLe.
Fte CAiTihSwdTN: LibCT0 1 CON HnOpa Ptr AFM:te
&uSomm, Hueft ATN-ASlvD
IWRAIN.k FtuSML lATTN. Olm 2b
I USA ir Ag" Ftl AiIM:ua SlT-Ti I-S
Ulnsffmel
I OUSOWACMsetr eey
t.F s TT- I O, IATA Al-TN:ma Oar & Lobtyufa AT:ASITX
I US ACCmst & re ", Ft seeda, A-Ill: TOC.M 1i
IHU" ICAA l-m:p CAI4.O
AT$0 t uiewAT*sd
&t LCT
1 USA Cmnwnpt Soh, FutLos, Al-Il:AOCA-JPE I USAIStmuldegCadSo, Pt U@s0asLATM:AUSA -CM.P
1 ImSA Mait CO, W AOleSiWL,AltN HTSAC-e.M I SUSAe Ade. UA AOFtHaC,
Messype ATTN:AAwePCMK.
I USA Mith Vag Cft,AFO flat9,AW. Al-T: 0SUPA I I tIUSAla~PACr DOW", SFt
HUsko Al-IN: DGitM
I USA Aememeet&Cad, Ftoadkonsen, Al-TN: AIIK-IUM I 2wUSALb
I e~eCte &HWU,Ft Nesavm AT, Pt81- Nes
I USA Aneeme~ Cad.* &Rodiea. AlTNT: LNARib C MaIn
CDRQFamsefuacArMT:Oseat AW 0
Nrmeaneha ity, Alivl
1 "~AIRC, 2ien POr.ATTN:Cai
1WH, U$MO Cose-uawe"u*, -WM-6
I PM-MSAPE,Madtoa CiV lr:Hmnje' I HO, USMOATN,Cawessulml ATN.Otr^V 20
2 USA P18o Aryie, Ptowi, &AlotN: LibrN:MCA4 2QUSCAA.uy Ne ATLA4LknAlT: f Wy
I USA Ajeesa ide FtKwe, Al-f ATN : MOibem I USAO TrsesnaCu',FNY-, Al-TN:
CO 920
IUSA Miner SaleC, APt Gijw s £153.04-I
Al-TN l 1im
UCow Tedw.e CU', ,Al-DTN: Film AP Am. K
1USA APO l-tl ATMS:I
Armir Salea,Keco, .M*L I UHCG PXWdACl R.ei C APOTN SPSIM TN:U4
5i
9-1
1 US NMaln Cam Liamn Oft. AMC. Almasnd AMI AMCGS-F I Def Cvil Inn of nvire Medcind. Camial
I USATRADOCK Pt IM, - ATTN: ATRO-AD I AIR CRISS. Ka iofi, ATTN: Info Sys Or
6 USAiRADOC. Pt Moo as. AT'N: ATPN-AO 1 Milltrlarvitcangmld Tiumu. Coswlpon
1 USATRAOOC. Pt Mm-a. ATIT: AT-IA 1 Mitary A t Frandt Imulsy, ATTN: OgeS
,ls.
I USA Porm Cuod, lPt MoI•low. AiM-: Ubmy I Msds Chef. C.ER.P.A.-Ariml . TaiulanNevl Franea
3 USA Aviation Test K, Pt Rucler. ATTN: STlG-P( I Prin Scientific Off. Ar-1 HImmngr Rich Olv. Miniatry
1 USA Apy hr Av4iao SAWe. Pt buckJw, ATTN: Library of Oatme. Now 0m
1 USA A•y lr Avistion Salot. Pt Ruhr. ATTN: Un Adviwr I Pon Rich Ofc Library. AKA. Israe ODefemm Poi
1 USA Aviation fh.F Pt Ruom'r. AIM-: P• Oreser 0 1 Miniosh van Oeformis. DOOP/KL Afd Social
I HOUSA Aviation 9he Caod. St Louis AM"-: AMSAV-ZODR Palm Zaltn. The Melia. Ne. eas
2 USA Aviation *a Tom Am. Idsed AFLI ATTM: SAVil-T
I USA Air Oaf 3. Pt WIles. ATrN: ATSA TEI
1 USA Air WMoI Rhs & Deo Lab. Mo.fft Fid. ATTN: SAVOL-AS
I USA Aviatio•R Slh, No ig M. PetRucker, ATTN: ATVT-T-RTU
I USA Aviation Soh. CU. Pt Rukier. ATTN: ArST-O-A
1 M4, 0ARCOM. Alexandia, AMTN: AMXCO-TL
I MM 0ARCOM. Abuaanduim ATM: COR
1 US Mii Admy-. W Poi•nt. AiM: Sari•h Unit
I US Mitary A4•eab . Wool Point, ATIM: Oh of MIt LMhp
I US MIlwry Aca•imy. Wut Poin. A"KT-MAl3R
1 USA U.randitoulwnGOp. UK. FPO NY. ATTN: MASI-4C
I Of of PIlol Rmih. ,1kipM. ATTM: Cods 462
3 Oft of Nwel Rich. Aruintln. ATTN: Cods 40
1 Ole of Nwel Rd*. Arlington. ATTN: Cods 460
I Oft of Naed Rah. Arlingeon. ATIT: Cods 441
1 Naval Asrat Med Lab, Pas . AM: Aom Sch ONv
I Nawal ,Aos Med NS. Lab. Penaesols. ATTN: Code LSI
1 Notal LArsnot Mod Oen Lab, emoe.ATTN: Code LS
1 Chief of Nwelam ATTN: PersON
I NAVAIRSTA. Norfk. AIIN: Safet C(r
1 Nw Occmolpalil.. DC. ATTN: Code 261. Chem St Tech
1 Center•f
w N" o
Anal. T? : OateCur
I Nav*A1krsom ATIN: AIR-S313C
1 Nor Balled.ATAM: 713
I , II 1 -- 2. FPO SPU•1
1 APHRL IM •oIm AFS
1 ALR4L ITT) Lowry API
I AFHMRL (ASI WPAPL. ON
2 AFHRL 00OJZ) Broks AIR
1 AFHPIL |00*4 Lawkland AFi •
1H-USAF (INYSO)
I HNUSAF (OPXXAI
I AIPVTG 1RO) Radoilh AFIP
3 AMRL (HE) WFAFL. 06l
2 AF linst of Tods. WPAFS. O. ATTN: ENEISL
I ATC (XPTOI Mandolph APB
I USAF AroaMd Ub. Books AFS (SUL-41. AITN: DOC SEC
1 AFOSR (NL). Adlngeo
I Al LIg Cmd. McClellan AfL ATrN: ALC/OPCR@
I Air Poem Acadmny. CO. AMIN: ODet of
a Slc
S NawPn & Ow Ctr. Sm 01go
2 N"wy Med maropriycsrc Rath U•Lt. Son Oao
I MN& Electronic L.k Son Dimp. ATTN- Res Lab
1 NMvTmgCom. San Olep. ATIerz Cods SCO-Ub
I NwoPostGnit, MomwmV. AIIM: Cods 55eA
I NotPmstrdds, Manlmlo. ATM-: Code 2124
1 NawvTonlquioCor. Orianda, ATTN: Teoh Lib
1 UISDow of Labor. DC. ATTN: Mnpowemr Adrmin
1US Dot of Jusie.. OC, ATTN: Onag Enfam Adesin
I ar of Steandrds. OC. ATTN: Coanper Info Suction
But
I Net Clan Hmo flor MH-Info. R•okville
1 DammorFdef Cur. Lakewood, AW1N: SW
12 Worse Do0ium=entown Comnvr
4 Dir Psvch, Anrny Hif RumlI Of. Canberra
1 Scientfifc Adctr, Mil ad. Anly lIH, R"umell Ofm Canberra
1 Mil end Air Attadc, Au•sin Embassy
I Comrad a Pnsurn. Humain. dsa Is Doee
scecs Daees
Nationals. Snuee
2Canadian Joint Staff Washlngi
I .'Air Staff. Royal Canadian AP. AITI: Por Sad Anal Or
3 Chief. CaniAn Doa Ruh Staff, ATTIN: CrCROSIW)
4 Sritish 0. Staff Intish Emb•y. Washinqgt
9-2 j