SEcgRE I Aporo RDP96-0 , For Release 2000/08/07 ~ CIA- 788P,101300220001-4 9 20 November 1980 A DATA-BASE MANAGEMENT SYSTEM FOR OPERATIONAL REMOTE VIEWING (S) Prepared by: E. C. May, Ph.D. B. S. Humphrey Radio Physics Laboratory CLASSIFIED BY: Msg, HQDA (DAMI-ISH) dated 7 July 1978 REVIEW ON: 7 July 1998 SRI 0-4472 n This document consists of Qq pages. Copy No. aFtl 333 Ravenswood Ave. * Menlo Park, California 94025 International (415) 326-6200 - Cable: SRI INTL MPK * TWX: 910-373-1246 '--~~ved For Release 2000/08/07 96-00788R001 300220001-4 MAET -NOT RELEASABLE TO FOREIGN NAT, IONALS Approved For Release 2000/08/07 .9 E a% "Lo-PH788RO01300220001-4 I OBJECTIVE In this document we propose the application of a computer data base management system (DBMS) (with associated operational RV assessment forms) to the organization of the client's RV data, including trend analysis through multi-variable DBMS manipulation of the data. 1 SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 Approved For Release 2000/08/07 : CC Riff88ROO1300220001-4 II INTRODUCTION A. Background As operational remote sensing by psychoenergetic means evolves from the demonstration phase toward full status as a recognized intelligence collection technique, it is necessary to develop an overall accurate assessment of the large amount of data collected to date, and to be able to recognize significant trends within that data. In addition, as the data base continues to expand, a convenient archival technique with rapid access to the data is mandatory. It is possible to ascertain interesting trends by casual examination of the raw data transcripts. However, this type of informal inspection does not easily provide the detailed, multi-variable analysis by which to optimize further collection assignments, and it may lead to underutiliza- tion of RV'er resources. A mission officer could in principle increase contribution in the operational environment on the basis of correlation revealed by detailed DBMs analysis of previous results. A data base management system provides at least three major advan- tages over manual inspection. DBMS 1. indicates optimal use of multiple RV'ers for specific operational targets of interest, 2. efficiently archives and cross-correlates rapidly increasing volumes of RV data, and 3. provides means for recognizing and implementing more subtle targeting strategies for individual RV'ers. 2 SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 Approved For Release 2000/08/07 : SIEIM-10788RO01 300220001-4 Appendix A contains the introductory comments of one such DBMS as an illustration. B. froposal We propose to select a standard data base management system (DBMS) which optimally meets the client's requirements, and to construct RV data assessment sheets to simplify data reduction. We further propose to create a data base from existing data, and to initiate a multi-variable search for important trends. 3 SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 Approved For Release 2000/08/07 : SIE-ON14rL T0788RO01 300220001-4 III METHOD OF APPROACH It is important to note here that the technology of data base management systems (DBMS) is finely developed. The required computer codes already exist; it is necessary only to select that system which is most tailored for application to the client's needs. Once a DBMS has been selected, we will modify and expand the tenta- tive prototype RV assessment sheet (shown in Appendix B) so that it con- forms to the constraints of the DBMS and accommodates the specific needs of the client organization supplying the data. It is presently envisioned that a number of assessment sheets would be developed and tailored to the type of facility targeted for the session under consideration. The follow- ing is a tentative list of possible operational remote sensing target assessment categories. SG1A tions and guidance to reduce the current data for entry into the DBMS. We would then create the data base using the DBMS itself, working closely with the client to initiate trend searches. 4 SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 We propose to work with the client organization to provide instruc- Approved For Release 2000/08/07 788ROO1300220001-4 IV PROPOSED PROGRAM We propose the following: ~ Select an appropriate DBMS. ~ Construct a series of task-related assessment sheets. ~ Build a data base from contractor and client-completed assessment sheets. ~ Initiate trend analysis and produce computer-generated reports describing the results. ~ Provide access to the data base by the client organi- zation and recommendations for an in-house DBMS capability. It is proposed that the above program be completed on a one-man year level-of-effort basis. We envision a single year's expenditure of approximately $75K. An itemized cost breakdown will be provided on request. 5 SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 I I Approved For Release 2000/08/07 :RQ29fimf 788RO01 300220001-4 §tc-Rt Appendix A INTRODUCTORY CHAPTER OF THE PRIME 400 DBMS SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 I[A al, INTRODUCTION Approved For Release 2000/OE :_~A IWIFIED1300220001-4 SECTION I INTRODUCTION INTRODUCTION PRIME/POWER is a complete data management system combining the features of Prime's operating system (PRIMOS) with the simplicity of a high-level, user-oriented query and report language. With PRIME/POWER, anyone can quickly learn on-line data management at an interactive terminal. It is not necessary to know anything about programing or data processing to use PRIME/POWER. The POWER language is based on simple, easy-to-understand English commands. Using interactive dialog in all its operations, POWER prompts (asks) you for the input it needs to perform each function. If you give it the wrong information, POWER displays an error message describing the problem. POWER's HELP command provides a brief description of the function and format of any POWER comrnand. PRIME/POWER and PRIME/POWER+ POWER has two versions: PRIME/POWER and PRIME/POWER+. PRIME/POWER runs on all Prime CPUs, from the PRIME 350 on up through the 750. it provides the basic query language, report writer, data entry and maintenance functions required for simple data management. PRIME/POWER+ expands these capabilities by providing the end user with the tools for system development. The additional features include formatted data entry, validation of data entry, text and keyword processing, table processing, a dictionary file for keywords, sophisticated report features, procedure files with variables, file linking, multi-file reporting, concurrent usage safeguards, and a versatile EDITOR facility. PRIME/POWER+ runs only in V-fftode on a 350 CPU and up. Common Features PRIME/POWER and PRIP4F,/POWER+ use PRIMOS file utilities to create, interrogate and update all types of standard data files. These file types are: MIDAS (ind-exseq-u-ential), binary sequential, binary direct access and ASCII sequential. Files created outside the P04ER system can be easily overlaid, or mode compatible with POWER. Such files can then be interrogated and updated like any POWER-created file. Since PRIME/POWER and PRIME/POWER+ are self-contained, all data management operations can be performed entirely within the POWER system. In addition, all files created or overlaid by POWER are accessible by applications programs written in COBOL, FORTRAN, PL/l, RPGII and BASIC. Similarly, files created by such programs can be 1 - 1 June 1979 Approved For Release 2000UNCLA SSIFIED001300220001-4 001300220001-4 Approved For Release 2000/ fYf I U: 'M SECHON 1 "IDR3 '10 overlaid and interrogated with POWER. Features of PRIME/POWER and PRIME/PCWER+ The common features of PRIME/PCWER and PRIME/POWER+ include: ~ Easy-to-use interactive language. ~ Up to 20 user-defined direct access keys. ~ Support for complex search expressions, including range evaluation. ~ Automatic data length check during data entry. ~ Interface to all standard file types: Index Sequential (MIDAS), ASCII sequential, binary sequential and binary direct access files. ~ Simple creation of all standard file types. ~ POWER-created files accessible by applications programs (COBOL, BASIC, FORTRAN, etc.). ~ Simple data update capabilities. ~ Basic report-writing features. ~ Extensive computational functions. ~ Support for all standard data types, including COBOL CCMP-3 and DECIMAL. Procedure files to perform routine or repeated operations. Automatic retention of CREATE and ADD dialogues for easy procedure file creation. Password-oriented security system. Features exclusive to POWER+ ~ Ability to define and search on keywords. ~ Text processing and editing. ~ Support for tables in files and reports. ~ File-locks to prevent simultaneous file modification. ~ Dynamic and static file linking. REV. 0 1 - 2 Approved For Release 2000 offAMMY 001300220001-4 8YN~ IFIED Approved For Release 2000/0 7 : 6-00788R001300220001 _JMODWTION 0 lW; ~ Range checking for data input. ~ Cbmputed fields and linked files in reports. ~ Support for different terminal features. ~ Screen formatting for simplified data entry. ~ An EDITOR facility for text, keywords, and procedure files. ~ System-level audit and accounting facilities. INTRODUC*TION TO rATA MANkGEMENT 'Data management' is a widely used term which refers to the organization and upkeep of large quantities of information. This can be a difficult task; however, a simple approach often yields the best results. The PCWER system is designed to make data management as simple and painless as possible. If you have never used a data management system or language before, the summary below should help put some terms and concepts into perspective. Data Management: The Basic Concepts Data management involves five basic operations: 1. Organizing and storing information (data). 2. Retrieving and optionally reporting on specific data items. 3. Updating information in a file. 4. Adding new data to a file. 5. Deleting data from a file. These data management operations are based on several general concepts: * Information, or data, can be stored and accessed most efficiently using computer facilities. ('Data' refers to two or more 'pieces' of information, while 'datum' refers to a single piece of information.) * Similar information is grouped into files; e.g., all data pertainirrg to a company's employees may be put Into an Employee file. * Files are composed of records; for example, each record in an r- employee file might conta n several pieces of information pertaining to a single employee. See Figure 1-1. 9 Each record in a file is usually divided into one or more fields I' each o which contains a singular piece of information. An ar~p-loyee file record might contain fields like last name, first name, social security nunber, date of hire, etc. These fields are camon to 1 - 3 June 1979 Approved For Release 2000/UNC W,&IF16DO01300220001-4 1r- UNCLASSIFIED AOFX;~U Por Release 2000/08/07 : ClA4W%%0788R001300220001-4 FIELD NUMBER FIELD NAME RECORD I RECORD2 RECORD3 RECORD a FIELDS FIELD FIELD FIELD 3 FIELD FIELD I 2 SOC. SEC. 4 a LAST NAMEFWT NAMENO. BIRTH DATE Jos" Steve 323-40-9M 2 DEC 53 Harris Mike 10474091 23 MAY 0 Uminsky Becky 231-57-M) 25 MAY 52 Figure 1-1. Eknployee File Records REV. 0 1 4 Approved For Release 2000/c9NG1AWRE&01300220001-4 Approved For Release 2000/01UN CLA"Lal 300220001-4WMODLICTION every record in the f ile. Each field within a record is given a name which accurately describes the information it contains. Such field-names are referred to as descriptors or keys. ordinarily, one retrieves certain pieces of inro- ion from a file by specifying the search conditions, fields or kkeys must meet in order to be retrieved. only those field values which satisfy the stated search conditions are retrieved from the file during a search. Data ManNement: The Basic 922rations V%hat can be done with information once it is organized in files? Some of the possibilities are: ~ Retrieve certain information from the file. ~ Examine data. ~ Perform arithmetic operations on the data. ~ Change or update the data. ~ Delete specific data items. e obtain a paper copy of the data (i.e., print It out). ~ Flormat the data, and print it out in a 'report' format. ~ Add new data to the file. POWER TEMS AM CCNCEP`rS Most of the terms used in POWER are very similar to those just discussed. There are a few modifications: o In POWER, fields are named by descriptors. o There are two types of descriptors: search and display. Search descriptors name fields which will be used as ys and will be frequently searched on. Display descriptors usually describe fields which are less frequently searched on. 1 - 5 June 1979 Approved For Release 2000/ MMMMM 01300220001-4 bWMRdlFor Release 2000/OUNG=TIED01300220001-4 Terms In addition to those defined above, the POWER vocabulary includes the following terms: e File A collection of related information divided into common records. Each file has a unique set of descriptors or fields associated with it. Fbr example, a file containing payroll information might contain one record per company employee. Each record is composed of several fields or descriptors, e.g.j NkMEr SALARY, AGE, etc. ~ Data Base A group of interrelated files. ~ Record A block of related data composed of one or more fields named by descriptors. A file is made up of one or more records. ~ Descriptor A field that is common to all records in a file. Descriptors are defined when the file is created. Pbr example, in a Personnel file, there may be several descriptors such as MME, ADDRESS, PHONE, etc. ~ Search Descriptor A descriptor that is used to retrieve a selected record or records. This descriptor can be used with the FIND, GET, PRINT or DISPLAY commands. Search descriptors can be up to 32 characters in length. (In a MIMS file, each search descriptor is an index and is part of the index subfile.) ~ Display Descriptor A descriptor that is used in a selected display or print of a record. These descriptors are used to sequentially search a file for information. Display descriptors can be a maximum of 80 characters in length. (In a MIDAS file they are not physically part of the index subfile, they are non-indexed fields.) ~ Text (POWER+) A free-form portion of a record that may contain up to 50 lines of data. Each line can be up to 80 characters in length. REV. 0 1 - 6 Approved For Release 2000/0 UNMAMM 1300220001-4 OULA661HLU Approved For Release 2000/08/07 : CIAIWO-00788ROO1300220001-4 INTRODUCTION Set A group of records fulfilling any stated search requirement. A set is created as a result of a successful FIND, GET, or EXPAND command. For example, a FIND command may search using NAME IS 'EMITHI as the criteria. All records within the selected file whose MME field contained 'SMITH' would form a set. Up to 49 sets can be active at one time per user. * Current Set The last set created by a successful search operation, such as FIND, GET, or EXPAND. 9 Keyword (POWER+) A word or phrase that is contained within a record or which appropriately describes a concept within a record; can be used as a search criterion. Keywords can be up to 20 characters in length. (Keywords are stored in indices 15-17 in a MIDAS file). * Internal Keyword (POWER+) A keyword actually contained in the TEXr portion of a file. Keywords are defined by bracketing them, , as text is added to each record. a External Keyword (POWER+) A keyword that is not contained within the text of a record. External keywords are logical search keys that describe or relate to the information contained in a particular record. External keywords are added to a record after the text has been entered. Data Management in POWER POWER offers all the basic tools needed for data organization and management. With POWER you can: ~ Create a file with up to 20 keys (search descriptors) for retrieving information. ~ Take an already existing file and define it according to POWER terms; called 'overlay'. ~ Retrieve and display information from the file, using previously defined descriptors as search keys. ~ Compute and update numeric data. ~ Change fields in selected records or change file globally. 1 - 7 June 1979 Approved For Release 2000/00NOIASSfIT 1300220001-4 UNULAMNLU A$F;% Oor Release 2000/08/07 : CIAIRN;W-00788ROO1300220001-4 ~ Write simple command sequences (procedures) that can be performed repeatedly. ~ Write reports to format data output. ~ Delete data from a file. ~ Add new records to a file. Files Created by POWER most users of POWER will not need to worry about file types and structures; POWER takes care of file-related details for you. However, some users will need to know about the files POWER creates. The most commonly encountered files in the POWER system are called MIDAS, (Multiple Index Data Access Systems) files. MIDAS files: MIDAS files are special data files structured for quick data retrieval. POWER can access these files using a 'direct' retrieval method. Each MIDAS file has an associated index subfile, which serves as a quick look-up file (much like7 a phone book). All the search descriptors you've defined for the file are listed in the subfile along with their 'address' locations in the file. When you specify a descriptor to be searched on during a file query, POWER goes to the index subfile, looks up the descriptor and its address, goes to the data file and retrieves the proper records. This kind of search can be called the index access method. Other files: Files of other types, such as ASCII sequential, may be created or overlaid in POWER. Sequential files are set up quite differently from MIDAS files. There is no index subfile for sequential files; therefore, all descriptor values must be searched for sequentially in the file instead of directly. Sequential searching involves stepping through every record in the file, one after the other, in the order in which they are physically located in the file, until the desired one is found. When a descriptor is specified in a search expression, POWER goes directly to the file and searches every record until the proper descriptor (key) value is located. The sequential access method can take a lot more time than the index access method, especially if the file contains many records. Display Descriptors vs. Search Descriptors In MIDkS files, a descriptor defined as a display descriptor does not appear in the index subfile. Wben you search on a display descript7o-r, POWER must do a sequential search through the actual MIDAS file until the desired field value for the descriptor is found. In other words, for MIDkS files, search descriptors are accessed by the index access method; display descriptors, by the sequential access method. REV. 0 1 - 8 Approved For Release 2000/08tjMS'VF&1300220001-4 'a- 'Irl L U NG akz%~IVILU U INTRODUCTION Approved For Release 2000/0 c1 -00788R001 300220001-4 807 in sequential files, display descriptors are accessed sequentially, just as search descriptors are; however, they are usually reserved for fields not often searched on. The reasons for having both search and display descriptors are simple: ~ You can define only 20 search descriptors per file (only 14 if you select the TEXT and KEYWORD option in POWER+); if you want more keys to search on, they must be defined as display descriptors. ~ Search descriptors have a maximum length of 32 characters; Display descriptors have a maximum length of 80 characters. ~ Display descriptors are usually the fields you won't search on frequently. ~ In both POWER and POWER+,, having display descriptors enables you to define up to 512 fields per record, instead of just 20. CCNVENrIONS Throughout this manual, many sWbols and conventions are used in describing command formats and syntax. There are also some special rules for defining descriptor names and file names in POWER. These conventions are listed below. Command Syntax Rules All POWER command formats are governed by the following syntax rules: * WORDS -IN-UPPER-ME Capital letters identify command words or keywords. They are to be entered literally. If a portion of an upper-case word is underlined, the underlined letters indicate the minimum legal abbreviation. e Words- in-lower-case Lower case letters identify parameters. The user substitutes an appropriate numerical or text value. e Braces ( ) Braces indicate a choice of parameters and/or keywords. At least one choice must be selected. * Brackets [ ] Brackets indicate that the word or parameter enclosed is optional. 1 9 June 1979 Approved For Release 2000/0 UNCtASSMED 01300220001-4 A P~F;r Release 2000/08 p$ ~NCUQGM300220001-4 Hyphen A hyphen identifies a command line option, as in: SPOOL -LIST * Parentheses ( ) Mien parentheses appear in a command format, they must be included literally. 9 Ellipsis The preceding parameter may be repeated. * option The word option indicates one or more keywords or parameters can be given, and that a list of options for the particular command follows. Command Ebmat The general format of many POWER commands is given below. Commands are im uppercase: lowercase words are larguments', or 'parameters'. Arguments are usually optional on a command line and can be any one of several values, depending on the context in which the command is beeing used. variable COMMAND [Snn] descriptor-name) ('value' I W variable) Snn Set number where nn is a number from I to 49. descriptor-name A specific descriptor name used in various search and display commands. Indicates that a keyword value is to be searched on or displayed. 'value' Actual record value corresponding to the descriptor, variable or keyword named previously. Must be enclosed in single quotes. variable A numeric or character variable used in search or computation expressions. REV. 0 1 - 10 Approved For Release 2000/offiftkalfffDoi 300220001-4 Approved For Release 2000/08M, M98iftED1300220001-4 nMODL)CTION Some POWER commands accept one or more options from a list. These are represented as follows: COMAND option-1 option-2 option-n If more than one option is specified on a command line, they are separated by comas or spaces, as indicated in each individual command format. Special Characters Several characters reserved for special uses by POWER cannot be included in descriptor names or file names. These special characters are: period comma left parenthesis right parenthesis slash asterisk + plus minus equal < greater than < less than I single quote rhe only characters listed above which can be used in defining file names are: period and minus 1 Juno 1979 Approved For Release 2000/0 UNCLAMMED 01300220001-4 Approved For Release 2000/08/07 : WIR(EOT788ROO1300220001-4 Appendix B A TENTATIVE RV ASSESSMENT SHEET SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 SECRET TS UT220001 IL8yfflNle -4 Approved For Release(j9ooy~qJ6Cyj%-;f %6k? (U) The information provided as enclosure to this report was obtained in response to a collection requirement provided by This Information was acquired from a new and potentially valuable source of intelligence. Work is currently being pursued to determine the accuracy, reliability, and improvement potential of this source. Your remarks and attention to the evaluation sheet will be the basis for our assessment of this new collection technique. Therefore, the effort you expend will greatly assist us and will ultimately result in you receiving more data of increasing accuracy and reliability. (U) While formulating your judgements concerning the data, the following comments concerning this new source of intelligence may be helpful. (U) Foremost, the data is likely to consist of a mixture of correct and incorrect elements. Specifically: (1) (S) The descriptive elements are generally of higher reliability than judgements or labels as to what is being described (recreational swimming pool may be mistaken for water purification pools, an aircraft hull may be mistaken for a submarine hull, etc.). Therefore, seemingly appropriate descriptive elements should not be rejected because of mislabeling. (2) (S) The data often contain gaps (in a 3-building complex, for example, perhaps only two of the buildings may be described, and an airfield may be added that isn't there). Such gaps or additions should not be taken to mean that the rest of the data is necessarily inaccurate. (S) Therefore, a recommended approach is to first examine the entire information packet to obtain an overall "flavor" of the response., reserving final judgement even in the face of certain errors, and then go back through for detailed analysis. (U) If you have questions regarding the data you have received or on its evaluation please feel free to contact me at any time. Thank you. ISR1 0-4410 This document consists of 5 pages. Copy No. -3 SG1J Classified by: DIA-DT c/o L. Lavelle - Bldg. 44 11'Review on: 3 Nov 2nno SRI International Menlo Park, CA 94025 SECRET - NOT FXLEASABLE TO FORETCN NATIC t Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 r--1 U!W SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 PSYCHOENERGETICS PROGRAM OPERATIONAL TARGET FILE (SRI Internal Use Only) (U) Project Name (S) Viewer (S) Monitor (S) Date Time of Start Time of Finish (S) Client (S) Priority Urgent F~ Routine (U) Target Key ( ) Variance from Standard Protocol (U) Target ID No. Information Provided by Requestor Information Provided to the Monitor Information Provided to the Source Information Requested by Analyst (S) Date Information Delivered to Client (S) Additional Data Request by Client Ye s F-1 No M (S) Dates Additional Data Requests Met Remarks 2 SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 rw (S) SUMMARY EVALUATION SHEET (U) (U) For the summary evaluation, please check the following boxes as to the accuracy of the submitted materiala ACCURACY Site Contact, M C) X Little with Not Correspondence Good Excellent UnknownApplicableM Mixed Results 0 0 0 1 2 3 M M CL (S) Geographical locale descrip- -n -n 0 water etc t ai ti ) 0 err . on ( n, , (s) Large-scale manmade elements M (cities, buildings, silos, ID ID 0 d 1i M d i1 k 0 roa oc nes., s, ra M airfields, etc.) (S) Small-scale manmade elements (antennas., computers., tanks, 00 co m siles, offices.. etc.) ix 4 4 (S) General target ambience (re- 0 0 search., production, adminis > ~ tration, storage, troop move- 0 1:3 0 1:1 E] 0 ments naval activity., air 0 (D activity, weapons testing, etc.) a) 6 (S) Relevant specific activities 4 0 (nuclear testing, missile 00 4 co co firing 1:3 ID ID co . CBW storage, ELINT ;a ' 0 monitoring, etc.) W (S) .Personality information 0 0 (physical descriptions, 0 0 actions, responsibilities, 0 0 0 lansi, etc.) 0 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -- - - - - - - - - - - - - - - - - - - - I Cannot de- 44- be (S) Overall utility None Marginal F-1 Useful Very terminedat this - - - - - - - - - - - - - - - - - - - - - - - - - Useful - - time - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - (U) Definitions for the accuracy scale: 0 Little correspondence . a Self explanatory. 0 9 * I Site contact with . . . . Mixture of correctand incorrect of the . . . elements, former but enough to M mixed results indicate source the target has probably site, accessed 2 Good . . . . . . . . . . Good correspondence with several elements matching., but some incorrect informatior 3 Excellent . . . . Good correspondence unique matchableelementsand relatively with unambiguous M little incorrect nformation. i SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4 DETAILED EVALUATION SHEET (U) Specific Transcript/Drawing Items 1. ( ) 2. 3. 4. 5. 6. 7. S. 10. 11. 12. 0 to 3 point scale of previous page. Evaluation Reference 4 SECRET Approved For Release 2000/08/07 : CIA-RDP96-00788ROO1300220001-4