DATA DESCRIPTIVE LANGUAGE FOR SHARED DATA

L. Haibt

A. Mullery

Thomas J. Watson Research Center

Yorktown Heights, N.Y.

July 19, 1971

Introduction

A primary consequence of the use of networks of computers is the

demand for more efficient shared use of data.

    Many of the impedements to easy shared data follow from the many
diverse ways of representing and making reference to the same data.
Almost all of these problems have been known before data was shared
through computer networks, but the network facility has simply
emphasized the problems.

    For convenience of discussion, representation differences will be
classified in three categories. The first category is one of very local
representation - the bit patterns for the character set, for fixed point
and floating point numbers. These differences are usually imposed by
differences in CPU's and storage devices. Translations from one
representation to another at another at this level can usually be made a
unit at a time (e.g. computer word by computer word) with the most
serious problems occurring when there are some values in one
representation scheme which have no corresponding meaning in the other
representation scheme, as, for expamble, when trying to translate
eight-bit bytes to six-bit bytes.

A second category of differences has to do with the representation

of collections of data, e.g., their size, ordering and location.

    The approach to coping with these problems within our project of
Network/440 has been to work on the development of a descriptive
language which would permit the specification of those aspects of data
representation which would be subject to transformation in moving data
about in a network. Then, the network data managment system would be
able to refer to the descriptions as needed in the data management
function. For example, to a large extent, one could supply two
descriptions to the data manager, one wich indicates how data is now
represented, and one which indicates how a copy of it should look, and
the data managment systems could invoke the necessary transformations to
make the proper copy.

    This approach to specifying data transformation contrasts somewhat
with systems, such as the RAND Form Machine, which provide a formalism
for specifying the particular translation alogrithms for changing form
one form to another. the descriptor-to descriptor approach seems to
simplyfy the programming burden when creating new field formats. Neither
method of specifying translations precludes the use of a Network
Standard Reprsentation.

Structure

    The descriptive language assumes that data may have an inherent
structure independent of other groupings, such as name groupings,
locking groupings, etc., imposed on it. A data structure description
consists of groupings of established data value type codes. The list of
established data value types should be sufficient, through appropriate
groupings, to describe any hierarchical structure of data.

    The data type identifies how the data value is to be interpreted. A
list of data type codes is given below. This list must be able identify
each data type that may exist in a data set in any machine in the
network. However, for data sets that contain only data types of the
machine on which it is stored, it is not necessary that a different code
be defined for different forms of any single type that may exist among
different machines. The data type specified in the description along
with the identification of the machine at which the data is stored is
sufficient to completely describe all such forms of the data types. A
tentative list of machine dependent type codes, compiled by
          F    floating point

          I    fixed

          D    double precision floating point

          C    character string

          X    complex

          P    packed decimal

          L    logical

    It is desirable to be able to construct data sets that contain
either data types not allowable at the machine at which the data set
is stored or, possibly, even types that say not exist at any machine
in the network. For example, one may wish to store eight bit data on a
six bit machine.  This may, in principle at least, be done by defining
a logical data set containing eight bit bytes in terms of a real data
set containing six bit characters. For this, however, data value type
descriptors have to be defined that are machine independent. The basic
machine independent data type is as follows:

          B    bit.

It is not clear at this time that any others are necessary since others can be built from this one. For convenience, other standard machine independent data types may later be defined.

Two other machine independent types are useful in describing

structures. These are:

          Z    null
          
          O    omit.

the null type indicates that there is no data corresponding to this item: however, the item should be counted as existing in the structure. The omit type indicates just the opposite: there is data that should not be counted as an item, it should be ignored.

          ((C,C),(F,F,I))

describes a data collection consisting of two subgroupings, the first subgrouping consisting of two data values of type 'C', and the second subgrouping consisting of two data values of type 'F' followed by a data value of type 'I'. the structure of this data collection is thus a three level tree which may be shown in two dimensions as follows:

          ( )
           |
          ( )---( )
           |     |
           C-C   F-F-I

Properties

    Other properties of data beyond that of the structures and
composition of the data set have also to be described.  These may be
assigned to items of the data collection, where an item may be defined
as an individual data value, or a grouping of these, by modifying the
item description with the specification of the preperties that apply to
it. The notation that will be used will be an infix notation of the
form:

         operand operator |[extent]|

where the operator indicates the property type, the operand the property value and the optional extent the numer of items to which the property applies. Normally the property is assumed to apply to just the following item in the description. If the property is to apply to more than just the following item description, this is indicated by specifying a number as the extent, this number indicating how many of the following item definitions at the same level the property is to apply to.

    Type - The structure description of the data set is a constitutional
or syntactic description of the data set. In some cases it is necessary
to give a discription of the use or meaning of an element. For example,
in some complex data structures, the linkages of the structures may be
represented as data values in the data set. Thus, though the more

What an initial set of such types should be has not been deicded.

Names - Items of a data structure can be given names by modifying

the items description with a notation of the form:

name n |[extent]|.

Depending on the context of its use, the name can refer to the description itself or to the data pertaining to the named part of the description. The name is assumed to be unique only within the scope of extent of the next higher encompassing name unless otherwise indicated by giving another encompassing name as the scope. This may be the name of the whole data set or description, for example. The scope of a name is specified by preceding the inner name by the outer name or names, separated by dots. The name:

          A,BETA

indicates that the scope of the name BETA is A.

    The name applies to just the following item in the description
unless otherwise indicated by including the extent parameter, For
exampel, the description:

          (An(C,C), (Bn[ 2 ]F,Cn[ 2 ]F,I))

indicates that name A is given to the item that contains two data values of type 'C', the name B to two data values, both of type 'F', and the name C to the last two data values, one of type 'F', and the other of type 'I'. Notice that with this notation, extents can overlap. For example, in the above description, the extent of name B overlapped that of name C.

    In a description, the same name can be applied to more than one item
definition either by use of the extent parameter, or by actually
specifying the name at each item to be included in the extent of the
name. If a name is multiply-applied within the same scope, then the name
is assumed to apply to the aggregate of the items to which it has been
given. Thus is possible to apply names to aggregates of items that are

    Lock - During the course of processing data, it may be necessary to
lock out use of some portion of data to other users. Seqmentation of a
data set into units for locking purposes may be indicated by the
notation:

k|[extent]|.

Whether or not the data is locked and the type of lock applied (for example, write protect or read/write protect) is specified at the time the data is used.

    Authorization - Authorization for a user to access data may be
governed by some access code assigned to the data.  This access code can
be specified in the description by modifying the desired elements of the
description with an indication of the code. The notation is:

          code a |[extent ]|

Control.

Two modifiers are provided which govern the existence of items in

the definition. The first is the repetition modifier:

factor r |[extent ]|.

This causes the following item definition or item definitions (if the

extent indicates more than one) to be repeated. Thus the description

          (3rC)

is equivalent to the description

(C,C,C).

The other control modifier is the condition modifier:

condition c |[extent ]|.

If the condition specified is not true, then the following item definition is ignored. The condition is specified by a Boolean expression.

    Since several modifiers may apply to an item definition, there is a
problem concerning the relationship among them. For example, if a
repetition modifier and a conditional modifier apply to an item, does
the condition apply to all the repeated items, or only to the first,
          (A=3c [ 4 ]4rF,I)

is equivalent to

(4rA=3c[ 4 ]F,T),

and if the condition is true, is equivalent to

(F,F,F,F,I),

or, if the condition is not true, is equivalent to

(T).

The other convention is that the modifiers are evaluated in the order in which they appear in the description, perhaps. in reverse order - the modifier immediately preceding an item definition is evaluated first, then the one next preceding, etc. This gives more flexibility of meaning to the mulitple modifiers. For example, the descriptions

          (A=3c3rC)

and

          (3rA=3cC)

are not equivalent. In the first, only the first of the three repetitions is affected by the condition whereas in the second, ll three repetitions are affected. Since this second convention is more flexible, it shall be the one assumed. This convention allows, for example, the repetition modifier to the applied to a named item as shown:

(3rAnC).

The name A applies to the three items (in effect, the name A is applied three times). This facility allows a name to be applied to a vertical column in a two dimensioned array by, for example, the description:

          (3r[ 3 ]C,AnC,C)

Reference

Named descriptions, or parts of descriptions, that have already been

defined may be inserted into a description using the notation:

$ specification.

Is a description, the reference is used as an item definition of a string fo item definitions. The item definitions used are those defined by the name given. Names that apply to the named item or items as a whole in the description in which it is defined are ignored by the description at which is referred. However, names that apply to parts of the named item are carried over to the description at which it is referred. For example the description

          (An(F,F),I,$A)

is equivalent to

(An(F,F),T,(F,F)).

Notice that the name "A" was not carried over to where the description was referenced since it applied to the referred-to item or items as a whole.

    Parts of a data set or description must be able to be specified for
use in a reference. This specification is in terms of the structure of
the data set or description. The specification has the form of a data
set name, or description name, followed by modifiers which particularize
to specifications, to the part desired. The four types of modifiers are
for going down a level, going up a level, going frontwards along a
level, and going backwards.

Down - To go down a level from that previously specified, the

modifier has the following form:

         . item

or

. (item |,extent| |,=value|).

Having gone down a level, the item indicates which particular item at

this level is the first (or only one) desired. This may be a number or a

          A.1.1

specifies the first field of the first record of data set A,

          A.(1*).1

specified the first field of all the records of A,

          A.1.(1,2)

specifies the first two fields of the first record of data

set A,

          A.(1,*).(1,="768174")

specified only the first fields of all the records of A that

have value "768174", and

          A.(1,!)-(1,="768174")

finds the first field that has value "768174".

Up- To go up a level from that previously specified,

the modifier has the following form:

          ' item

or

' (item |,extent| |,=value|).

Going up a level specifies the item up one level that contains the item previously specified. The item indicates which particular item at this level is desired where the containing item is considered the first. For example,

          A.(1,!).(1,=768174")'1

Forward. - To go forward on the same level as that previously

specified, the modifier is as follows:

• item

or

• (item |,extent| |,=value|).

This modifier is useful when an item following the one which has a certain value in a field is desired. It may also be used when the data set name is really a pointer, into the data set, which has beet set previously. Pointers may or may net be described in a section elsewhere. Backward. - To go backward on the same level as that previously specified, the modifier has the following form:

• item

or

• (item |,extent| |,=value|).

An example of the use of this modifier is when an item preceding the one which has a certain value in a field is desired. This might be specified:

          A.(1,!).(2,="768174")'1-1
       
       [ This RFC was put into machine readable form for entry ]
       [ into the online RFC archives Gottfried Janik   9/97   ]