In-memory record sort
aq_ord [-h] Global_Opt Input_Spec Sort_Spec Output_Spec
Global_Opt:
[-verb] [-stat]
Input_Spec:
[-f[,AtrLst] File [File ...]] [-d ColSpec [ColSpec ...]]
Sort_Spec:
-sort[,AtrLst] ColName [ColName ...]
Output_Spec:
[-blk NumRec FilPrefix] [-o[,AtrLst] File] [-c ColName [ColName ...]] |
[-blk_only NumRec FilPrefix]
aq_ord sorts input records according to the value of the sort columns.
Sort is done in memory, so it is fast.
The program offers three sort modes:
All at once sort
In this mode, the sort is done by loading the entire data set into memory. This is the default sort mode. The requirement for this mode is:
Block sort
Data is sorted in blocks of a given number of records. The blocks are first saved to files, then loaded and merged to produce the final result. The requirements for this mode are:
Merge only
This will merge the input files/streams into a single output. The inputs must already be sorted in the same order as desired for the output. There is no memory requirement in this mode regardless of the data size, This support can be used to implement parallel sorts on large data sets over multiple machines.
-verb-statPrint a record count summary line to stderr at the end of processing. The line has the form:
aq_ord: rec=Count err=Count
-f[,AtrLst] File [File ...]Set the input attributes and files. See the aq_tool input specifications manual for details.
Example:
$ aq_ord ... -f,+1l file1 file2 ...
-d ColSpec [ColSpec ...]Optionally define the input data columns.
See the aq_tool input specifications manual for details.
In general, ColSpec has the form Type[,AtrLst]:ColName.
Supported Types are:
S - String.F - Double precision floating point.L - 64-bit unsigned integer.LS - 64-bit signed integer.I - 32-bit unsigned integer.IS - 32-bit signed integer.IP - v4/v6 address.Optional AtrLst is a comma separated list of column specific attributes.
ColName is the column name (case insensitive). It can contain up to
31 alphanumeric and ‘_’ characters. Its first character cannot be a digit.
Example:
$ aq_ord ... -d s:Col1 s,lo:Col2 i,trm:Col3 ...
trm
attribute removes blanks around the value before it is converted to
an internal number.-sort[,AtrLst] ColName [ColName ...]Define the sort column(s).
ColNames must already be defined under -d.
Optional AtrLst is a comma separated list containing:
ncas - Do case insensitive match (default is case sensitive).
For ASCII data only.dec - Sort in descending order. Default order is ascending.
Descending sort is done by inverting the ascending sort result.mrg - Enable the Merge only mode. The inputs are simply merged
according to the sort order, no actual sort is done.Example:
$ aq_ord ... -d i:Col1 s:Col2 ... -sort Col2 Col1
-blk NumRec FilPrefixNumRec records at a time.
The results are saved to FilPrefix-BlkNo.bin files in aq_tool’s internal
binary format. BlkNo is the block number, it starts from 1 and increments
for each NumRec records until the entire input is consumed.
When this is done, the FilPrefix-BlkNo.bin files will be merged to
produce the final result.-blk_only NumRec FilPrefixFilPrefix-BlkNo.bin files
are not merged afterwards. No final result is produced.[-o[,AtrLst] File] [-c ColName [ColName ...]]Output data rows.
Can be used with any of the sort modes except for -blk_only
Multiple sets of “-o ... -c ...” can be specified.
Optional “-o[,AtrLst] File” sets the output attributes and file.
See the aq_tool output specifications manual for details.
Optional “-c ColName [ColName ...]” selects the columns to output.
Normally, each selection is a column name.
In addition, these special forms are supported:
* - An asterisk adds all columns to the output.ColName[:NewName][+NumPrintFormat] - Add ColName to the output.
If :NewName is given, it will be used as the output label.
The +NumPrintFormat spec is for numeric columns. It overrides the
print format of the column (be careful with this format - a wrong spec
can crash the program).^ColName[:NewName][+NumPrintFormat] - Same as the above, but with a
leading ^ mark. It is used to modify the output label and/or format
of a previously selected output column called ColName.
If ^ColName[...] is the first selection after -c, then * will be
included automatically first.~ColName - The leading ~ mark is used to exclude a previously
selected output column called ColName.
If ~ColName is the first selection after -c, then * will be
included automatically first.If -o is given without a -c, then * is assumed.
If -c is given without a prior -o, the selected columns will
be output to stdout.
Example:
$ aq_ord ... -d s:Col1 s:Col2 s:Col3 ... -o - -c Col2 Col1
If successful, the program exits with status 0. Otherwise, the program exits with a non-zero status code along error messages printed to stderr. Applicable exit codes are: