szew.essbase.cols — szew/essbase 0.3.1

Essbase columns export.

What to expect from input:

• Space separated.
• Quoted member names, non-quoted values.
• Max file size 2GB.
• COLUMNS are specified in first line of the file:
  • List of quoted member names of single dense dimension, last field is empty.
  • No members from this dimension ever appear in the file again.
  • N members are specified, up to these many figures can appear in data lines.
• DATA line consists of both full POV updates and figures:
  • Quoted members of non-columns dimensions followed by figures.
  • Dimension order in the data lines should always be the same.
  • Figures are non-quoted #Mi and numeric values, up to N occurrences per line.
  • Last field is always empty string, so last figure is followed by space.
  • Missing values from the left are marked as #Mi, from the right - skipped.

To parse the export file you need to know two things:

• Number of data storing dimensions in the cube.
• Complete mapping of member name to dimension name in those dimensions.

cells clj

(cells)

(cells spec)

Processor will get data point per each cell in file.

Requires complete member to dimension mapping in m->d and correct data storing dimension count in dim-count.

Processor gets seq of [{dimension member} value].

Default processor will return a vector of cells.

Errors out with ex-info if any member is mapped to nil.

dump->tsv clj

(dump->tsv m->d order out-path in-path & in-paths)

Given dump files consolidates them into single, row-expanded TSV.

One row per cell.

Requires complete member to dimension mapping in m->d and complete list of dimension names in order. It will be used to get dim-count right.

members clj

(members)

(members spec)

Processor gets member name per every occurrence in file.

Default processor creates a hash-set of member names.

It will discard all the figures, provided dim-count is correct, and only process members.

records clj

(records)

(records spec)

Processor will get data point per each data-line in file.

Requires complete member to dimension mapping in m->d and correct data storing dimension count in dim-count.

Processor gets seq of [{dimension member} {column value}].

Default processor will return a vector of such data points.

Errors out with ex-info if any member is mapped to nil.

sniff-dimensions clj

(sniff-dimensions cells)

A processor for Cells that will return dimensions of first cell.