parkour.io.dux documentation

add-subconf

(add-subconf job name subconf)
Add demultiplex output `subconf` to `job` as `name`.

add-substep

(add-substep job name step)
Add configuration changes produced by `step` as a demultiplex
sub-configuration of `job`.

combine-output

(combine-output kind)
Sink as (reducer-bound) base combiner output, as `mr/sink-as` kind `kind`.

dsink

(dsink dsinks)
Demultiplexing distributed sink, for other distributed sinks `dsinks`,
a map of names to dsinks.  The distributed sequence of the resulting sink is the
multiplex distributed sequence of all component sinks' sequences.

get-sink

(get-sink context oname)(get-sink context oname base)
Get sink for named output `oname` and optional (file output format only) file
basename `base`.

get-subconfs

(get-subconfs job)
Get map of `job` demultiplex sub-configuration diffs.

map-output

(map-output kind)
Sink as (reducer-bound) base map output, as `mr/sink-as` kind `kind`.

named-keys

(named-keys oname)(named-keys context coll)
Sink as keys to named output.  If used directly as a shaping function, tuples
should be doubles of output name and content.  If invoked with an output name
`oname`, expects just output content.

named-keyvals

(named-keyvals oname)(named-keyvals context coll)
Sink as key-val pairs to named output.  If used directly as a shaping
function, tuples should be doubles of output name and content.  If invoked with
an output name `oname`, expects just output content.

named-vals

(named-vals oname)(named-vals context coll)
Sink as values to named output If used directly as a shaping function, tuples
should be doubles of output name and content.  If invoked with an output name
`oname`, expects just output content.

prefix-keys

(prefix-keys oname)(prefix-keys context coll)
Sink as keys to named output and file prefix.  If used directly as shaping
function, tuples should be triples of output name, prefix, and content.  If
invoked wih an output name `oname`, tuples should be pairs of prefix and
content.

prefix-keyvals

(prefix-keyvals oname)(prefix-keyvals context coll)
Sink as key-val pairs to named output and file prefix.  If used directly as
shaping function, tuples should be triples of output name, prefix, and content.
If invoked wih an output name `oname`, tuples should be pairs of prefix and
content.

prefix-vals

(prefix-vals oname)(prefix-vals context coll)
Sink as values to named output and file prefix.  If used directly as shaping
function, tuples should be triples of output name, prefix, and content.  If
invoked wih an output name `oname`, tuples should be pairs of prefix and
content.

write

(write context oname key val)(write context oname base key val)
Write `key` and `val` to named output `oname` and optional (file output
format only) file basename `base`.