Approved For Release 2000/0 A-0191R002100300004-2 to" 5h El G if R E0 "' ~ UNITED STATES GOVERNMENT memorandum DATE: 19 Sep 85 REPLY TO: DT (SUN STREAK) ATTN OF suejecr: SUN STREAK Ops/Tng Objectives, JAN 86 - JAN 88 (U) T431: DT (Dr. Vorona) 1 . (SISKIWNINTEL) GRILL FLAME, the progenitor of SUN STREAK, established that remote viewing (RV) was a human behavior (real phenomenon) which could be enhanced through training and that RV had potential for US intelligence application. SUN STREAK I s Prototype Operational Group (POG) will integrate RV into the intelligence community's repertoire of collection methodologies. 2. (S/SK/WNINTEL) Using GRILL FLAME as a research platform and Army's CENTER LANE as an experience base, the POG will provide: a. (S/SK/WNINTEL) An RV Intelligence Utility Assessment: Approximately 80% of the POG's operational effort will be devoted to the production of this RV Intelligence Utility Assessment. This effort has as its primary objective the identification of those categories of intelligence targets which would best be serviced by RV. To accomplish this, a systematic group of intelligence targets will be examined using RV (see Incl. 2). The results of these sessions will be analyzed with the help of an office information system. The secondary objective of this effort is to provide a skill qualification internship for trained RV sources. It is anticipated that this phase of the effort will identify the strengths and weaknesses of individual RV sources in acquiring intelligence about different categories of targets. b. (S/SK/WNINTEL) Response to collection requirements: Approximately 20% of the POG's operational effort will be devoted to the conduct of RV in response to current intelligence collection requirements. Tasking of the POG's RV sources will be the exclusive responsibility of the office of the Assistant Deputy Director for Scientific and Technical Intelligence, DIA. HANDLE VIA SKEET CHANNELS ONLY SPECIAL ACCESS REQUIRED WARNING NOTICE: SENSITIVE CLASSIFIED BY: DIA/DT INTELLIGENCE SOURCES AND DECLASSIFY ON: OADR. METHODS INVOLVED OP`r1ONAL FORM NO. 10 (REV. 1-80) Approved For Release 2000/08/OIZO- W8 GSA FPMR (41 CFR) 101-11.6 TO02100300004-2 5010-114 * GPO :1984 0 - 461-275 (272) Approved For Release 2000/088 -E ORE+R002100300004-2 C. (S/SK/WNINTEL) RV Training: Concurrent with the above outlined operational effort the POG will provide basic RV training for newly assigned personnel and advanced individual training as required for RV source personnel. SG1J 4 Encl 1. Ops/Tng Objectives Chart 2. Target Categories Chief, POG 3. Evaluation Methods 4. Database Management CF; DT 5A SG1J Approved Disapproved Approved For Release 200OAQPF:13-[tE~1-789ROO2100300004-2 %..A L. Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 .I TAB . .1 Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 Approved For Release 2000/0 ff%rwhE6f89R002100300004-2 BECRT"t SUN STREAK Ops/Tng Objectives January 1986 January 1988 Operations Training 900 sessions (4 sources) 450 sessions (2 trainees) Utility Assessment SI SIII 80% (720) 66% (300) Collection SIV - SVI 20% (180) 33% (150) Approved For Release 200018f- ()ftE-f789R002100300004-2 Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 L TA B ------A Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 J.QQM Approved For Release 200010R=tJ--lK , R002100300004-2 51-uRr. I TARGET CATEGORIES RV Intelligence Utility Assessment 1. (S/SK/WNINTEL) Attached hereto are the target categories selected for examination by RV in support of the planned RV Intelligence Utility Assessment. They have been carefully chosen to represent a broad spectrum of intelligence problems. The intelligence function and production codes of the DIA Register of Intelligence Publications (RIP) have been used so that results from the RV assessment study will be readily understood by intelligence users. Intelligence indicators will be identified for each category as target packages are developed. 2. (S/SK/WNINTEL) Plans are to conduct 20 RV examinations (5 each per source) of each of the 36 selected categories from January 1986 to January 1988 (20 X 36 = 720 sessions) . Care will be taken to maintain appropriate compartmentalization of information relative to actual sites to be RVed. These procedures will guarantee that sources are unburdened by preconceived notions of the sites as well as insure that the information reported by the sources is the product of RV and not more conventional analytic efforts. 3. (S/SK/WNINTEL) The RV Intelligence Utility Assessment is not an attempt to scientifically prove or disprove RV through the use of statistical methodology. It is, as stated earlier, an attempt to identify those categories of intelligence targets which would best be serviced by RV. Therefore, each of the 720 RV examinations will be rated for accuracy and overall intelligence value. The 0 to 3 point accuracy rating scale developed by SRI International for GRILL FLAME will be used in conjunction with a 0 to 3 point intelligence value rating: Accuracy Scale 0 - Little correspondence I - Site contact with mixed results 2 - Good 3 - Excellent HANDLE VIA SKEET CHANNELS ONLY SPECIAL ACCESS REQUIRED WARNING NOTICE: SENSITIVE CLASSIFIED BY: DIA/DT INTELLIGENCE SOURCES AND DECLASSIFY ON: OADR M13THODS INVOLVED Approved For Release 200 6f0789ROO2100300004-2 18F.0 RE Approved For Release 2000108SE, O-RE719ROO2100300004-2 Value Scale 0 - No intelligence value I - Minimal intelligence value 2 - Moderate intelligence value 3 - High intelligence value The reason for this dual rating is based on the experience of CENTER LANE. Many times a RV session will yield very "accurate" data, but that data will be of little "value" to the intelligence community. The RV Intelligence Utility Assessment will identify those categories of intelligence targets for which both accurate and valuable information can be provided. Approved For Release 20001 89R002100300004-2 1BEG REOW10 SG1A Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 Next 11 Page(s) In Document Exempt Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 ---7 IF71 c TAB -1 Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 Approved For Release 2000/08/08 : CIA-RDP96-00.789ROO2100300004-2 UNCLASSIFIED OVERVIEW OF SR.I-INTERNATIONAL EVALUATION METHODS Judging on a Blind Basis In this method, SRI selected an analyst not otherwise associated with the series of sites to be judged to quantitatively assess the degree of correspondence of a given transcript of the remote viewer's data concerning each site and the actual targets. The judge was given a transcript including a list of specific concepts (e.g., "red" or "shady") for each site and was instructed to compare each transcript to each site (i.e., 6 sites = 6 transcripts/concept lists = 36 assessments per concept). Each concept was rated on a scale of 0 to 10 with "0" implying no correspondence between the concept and the target site and "10" implying complete correspondence. Upon completion of the rating, the judge then computed the average rating score for all concepts in each transcript matched against each target, displaying his results in a matrix with target displayed as rows and transcripts displayed as columns. The transcripts were then ranked 1-6 indicating which transcript most closely matched the actual site. This technique, although apparently excellent with regard to demonstrating the presence or absence of a viable RV function, did not provide a uniform measure from transcript to transcript of the quality of RV functioning. It therefore became necessary to develop an objective method of evaluation. 0-to-7 Point Ratinq Scale This system was applied "nonblind", post hoc to the evaluation of the transcripts by the blind-judging method. For no correspondence between the transcript and target site, 0 was assigned; for excellent correspondence, 7; and for intermediate correspondence an intermediate rating. Several methods of "targeting" the viewer were used, and an average of accuracy was obtained for each method. A comparison of the rating produced with this approach against the ratings produced by the blind-judging approach showed statistically significant positive correlation between the two techniques. This, combined with the finding that application of the 0-to-7 point scale to randomly matched transcripts and targets (blind-judging method) yielded chance results, established that application of the 0-to-7 point scale provided a reliable, objective measure of RV quality. UNCLAPOR&MIPor Release 2000/08/08 : CIA-RDPi6-00789ROO2100300004-2 _Z: tv C_ Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 UNCLASSIFIED 0-to-3 Point Accuracy Rating Scale The FY 1984 SRI Evaluation project further refined RV evaluation procedures by developing the 0-to-3 Point Accuracy Rating Scale. This was used to provide a "bottom-line" assessment of the accuracy/quality of individual elements in a transcript, or of the transcript as a whole. 0 was considered a "miss", progressing through some correspondence (1), good correspondence (2), and excellent correspondence (3). While this reduced the number of factors needed to determine a viewer's accuracy based on objective measures, it still did not meet the criteria for scientific standards. Princeton Evaluation Procedure (PEP The PEP was based on comparing independently valid quantitatively-defined target information with similarly quantitatively-defined response information. The definition of ~ particular target site was contained in the yes/no answers to ~ set of questions (30) called descriptors. The only target information to be considered for analysis was completely contained in the yes/no answers. A binary number (30 bits for PEP) was constructed for the target and the response descriptor respectively. YES = binary "l" and NO = binary "0". The resulting two 30-bit binary numbers were than compared by a variety of mathematical techniques to form a score for the specific RV session. For a series of RV sessions, a quantitative assessment was made by comparing a given response (matched to its corresponding target site) against the scores computed by matching the response to all other targets used in the series. There were four basic problems with the PEP system: Bit descriptors were not appropriate for the training environment. PEP was not interfaced to a standard data base management system. Cross-target scoring was not sensitive to intelligence requirements. Cross-target scoring was not appropriate for a training environment. This led to the the development of the SRI Evaluation Procedure. UNCLA00rTbWj641Por Release 2000/08/08: CIA-RDP~6-00789ROO2100300004-2 Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 UNCLASSIFIED SRI Evaluation Procedure (SEP) As in the PEP, the SRI Evaluation Procedure quantified the target material into binary numbers corresponding to yes/no answers to a set of descriptors. Descriptor lists and coding techniques were devised for each RV response for analysis. However, it modified the PEP by using two different types of analysis -- the target-pool-dependent analysis and the target-pool-independent analysis. The target-pool-dependent analysis measured the uniqueness of the target/response match compared with the remainder of the target pool. The target-pool-independent analysis measured the accuracy and reliability of a single RV response matched only against the target material used in the session. Both methods of analysis Met the need for a system scientifically measuring RV ability and accuracy, but they did not address the real world of operational intelligence collection. Intelligence Ratings This system rates 6 descriptors ranging from major gestalt to particular site relevant information on a scale of 0 to 3, 0 representing little correspondence to the site and 3 representing excellent correspondence to the site. Unknown and non-applicable factors are also considered, but not scored. Information perceived by the viewer is then rated for overall intelligence utility, ranging from no utility to very useful, or in. some instances, indeterminable at the time of analysis. This procedure has not been extensively applied because there have been relatively few operational taskings since it's development. The next milestone will be the development of a data base management system that will provide the following: Storage of operational RV session evaluations. Analytic information concerning RV effectiveness when targeted against a variety of intelligence collection tasks. Identification of reliable RV sources for each collection requirement. UNCLPkp'j*9WTFor Release 2000/08/08 : CIA-RDF296-00789ROO2100300004-2 Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 F [77 1 TAB Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 Approved For Release 2000/SU7*FRET9ROO2100300004-2 C. %a DATABASE MANAGEMENT RV Intelligence Utility Assessment 1. (S/SK/WNINTEL) The RV Intelligence Utility Assessment will be expected to provide us with data which can then be manipulated to provide information on: a. Which categories of targets lend themselves best to remote viewing intelligence collection. b. The accuracy of each RV source. C. The accuracy, dependability, and saleability of the RV process in the intelligence collection arena. 2. (S/SK/WNINTEL) In order to properly assess the results of the RV Intelligence Utility Package, we must first establish a database which will track specific items of crucial interest. (See Fig. 1) These include, but are not limited to: a. Intelligence Utility Function and Production codes: Target categories which have been selected for examination by remote viewing. b. Specific sub category of tasking: Specific category of interest to the RV process: target location, specific details, presence/absence of person/thing at site, etc. C. Job number and job numbers of related tasking: For filing, reporting, and data management purposes. d. Source ID (number or code): Tracking the results of each source will not only indicate the personal abilities of each source, but will allow a diagnosis of that source's tendencies towards greater accuracy with differing target types. e. Date and Time of session: Recent ELF studies indicate thaE-there is a positive correlation between sunspot HANDLE VIA SKEET CHANNELS ONLY SPECIAL ACCESS REQUIRED WARNING NOTICE: SENSITIVE CLASSIFIED BY: DIA/DT INTELLIGENCE SOURCES AND DECLASSIFY ON: OADR METHODS INVOLVED SECRt i Approved For Release 2000/08/08: CIA-RDP96-00789ROO2100300004-2 T" Approved For Release 2000/09ft 9ROO2100300004-2 0E0- RFof activity and dependability of RV collected information. Positive prediction of best RV session times will allow for the most efficient planning of work schedules. f. Session number within a tasked series: Since RV results are statistical in nature, more than one Source and more than one session is run against each task. This field will allow for more refined accuracy in analysis. g. General and specific tasking: A short explanation of tasked activity. h. List of information known at beginning of RV work: In order to allow an assessment of the necessary information requirements to be made of future tasking agencies. i. List of information generated during RV session: A list of the main information items returned to the tasking agency. e. Accuracy of results: An assessment of the accuracy of generated information, as made by the tasking agency. g. Value of results: An assessment of the intelligence value of the generated information, as made by the tasking agency. Analysis of this factor will provide the only reliable means of predicting the efficiency and usefulness to future tasking agencies. It will be the only accurate vehicle for generating credibility in and saleability of our product. 3. (S/SK/WNINTEL) Once the data base has grown to sufficient proportion to have statistically analytic value, questions which are statistical in nature and data-oriented can be tasked and answered. An example of these questions is presented in Fig. 2, below. Approved For Release 2000/08/oSEGRA6 -8puR002100300004-2 Approved For Release 200 Ve GMT789RO02100300004-2 SM FIELD Tasking data: Function code: Prod. code Specific cat.: job number Related jobs Session data: Cniirr,,n TM VdLul Time Sess. number PGT 2630 Location 86-062 86-078 86-112 COMMENTS (Targeting information) (Internat'l terrorism) (Search problem) 132 860312 1302 hrs 003 (Encoded for security) RV hostage situation Hostage location EEI State of health Tasking/site data: General task : Specific task: Given by tasker Hostage name Hostage DOT3 Hostage photo Last known location (Information provided by tasking agency) Results Alive as of 860312 from PV Well-fed Desert town Radio station antenna Airport to east Evaluation of session: Accuracy 3 Value 2 (Information provided to tasking agency) to west (Assessment made by tasking agency) FIGURE, 1. EXAMPLE OF DATABASE RECORD E C R Approved For Release 2000/08/08 CIA-RDP96-00789ROO2100300004-2 SG1A Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 Approved For Release 2000/08/08 : CIA-RDP96-00789ROO2100300004-2 SECRET SPECIAL ACCESS PROGRAM SUN STRE4K WARNING SENSITIVE INTELLIGENCE SOURCES OR METHODS INVOLVED. NOT RELEASABLE TO FOREIGN NATIONALS. THIS COVER SHEET OR ENVELOPE WILL BE USED AS AN INTEGRAL PART OF THE DOCUMENT TO ALERT CLASSIFIED BY: IDIA/DT RECIPIENTS OF THE SENSITIVITY INVOLVED. DECLASSIFY: OADIR 0" vemm f" In V--m pirm Approved For Release 2000/oabMA-RdMS;18JR002100300004-2