parkour.io.dval documentation

->DVal

(->DVal value form)
Positional factory function for class parkour.io.dval.DVal.

copy-dval

(copy-dval readv sources)(copy-dval readv params sources)
Like `load-dval`, but first copy `sources` to transient locations.

dcpath

(dcpath path)
Distributed-cache–able instance of `path`.  When serialized into a job
configuration, adds `path` to the distributed cache.  When deserialized from a
job configuration, reconstitutes as the cache path when available and as the
original remote path when not (i.e. under local- or mixed-mode job execution).

dseq

(dseq nper dval)
Distributed sequence over a sequence dval.  The dval will be deserialized in
each map task and a range of the sequence records used as the task input.  Each
task will receive `nper` values, the final task receiving fewer if the length of
the number of values is not evenly divisible by `nper`.

dval

(dval readv & args)
Return a dval which acts as a delay over applying var `readv` to `args`.

edn-dval

(edn-dval value)
EDN-serialize `value` to a transient location and yield a wrapping dval.

eval

(eval dval)
Evaluate `dval` form, recomputing value each time.

jser-dval

(jser-dval value)
Java-serialize `value` to a transient location and yield a wrapping dval.

load-dval

(load-dval readv sources)(load-dval readv params sources)
Return a delay-like dval which will realize by applying var `readv` to the
concatenation of `params` and `sources` locally and distributed copies of
`sources` remotely.

parkour.io.dval.proxy$org.apache.hadoop.fs.Path$IObj$82d48561

transient-dval

(transient-dval writef readv value)
Serialize `value` to a transient location by calling `writef` with the path
and `value`.  Return a dval which locally holds `value` and remotely will
deserialize by calling var `readv` with a distributed copy of the transient
serialization path.

value-dval

(value-dval value readv & args)
Return a dval which locally holds `value` and remotely will deserialize as a
delay over applying var `readv` to `args`.